-- Logs begin at Tue 2022-10-04 11:07:19 UTC, end at Tue 2022-10-04 12:17:13 UTC. -- Oct 04 11:38:44.583876 dv-cinder-860212-2-smb systemd[1]: Starting Devstack devstack@keystone.service... Oct 04 11:38:44.593341 dv-cinder-860212-2-smb devstack@keystone.service[98462]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Oct 04 11:38:44.595230 dv-cinder-860212-2-smb devstack@keystone.service[98462]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Oct 4 11:38:44 2022] *** Oct 04 11:38:44.595230 dv-cinder-860212-2-smb devstack@keystone.service[98462]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 04 11:38:44.595230 dv-cinder-860212-2-smb devstack@keystone.service[98462]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 04 11:38:44.595230 dv-cinder-860212-2-smb devstack@keystone.service[98462]: nodename: dv-cinder-860212-2-smb Oct 04 11:38:44.595230 dv-cinder-860212-2-smb devstack@keystone.service[98462]: machine: x86_64 Oct 04 11:38:44.595230 dv-cinder-860212-2-smb devstack@keystone.service[98462]: clock source: unix Oct 04 11:38:44.595230 dv-cinder-860212-2-smb devstack@keystone.service[98462]: pcre jit disabled Oct 04 11:38:44.595230 dv-cinder-860212-2-smb devstack@keystone.service[98462]: detected number of CPU cores: 4 Oct 04 11:38:44.595230 dv-cinder-860212-2-smb devstack@keystone.service[98462]: current working directory: / Oct 04 11:38:44.595230 dv-cinder-860212-2-smb devstack@keystone.service[98462]: detected binary path: /usr/bin/uwsgi-core Oct 04 11:38:44.595765 dv-cinder-860212-2-smb devstack@keystone.service[98462]: your processes number limit is 47680 Oct 04 11:38:44.595765 dv-cinder-860212-2-smb devstack@keystone.service[98462]: your memory page size is 4096 bytes Oct 04 11:38:44.595765 dv-cinder-860212-2-smb devstack@keystone.service[98462]: detected max file descriptor number: 2048 Oct 04 11:38:44.595765 dv-cinder-860212-2-smb devstack@keystone.service[98462]: lock engine: pthread robust mutexes Oct 04 11:38:44.595765 dv-cinder-860212-2-smb devstack@keystone.service[98462]: thunder lock: enabled Oct 04 11:38:44.595765 dv-cinder-860212-2-smb devstack@keystone.service[98462]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Oct 04 11:38:44.595765 dv-cinder-860212-2-smb devstack@keystone.service[98462]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 04 11:38:44.635850 dv-cinder-860212-2-smb devstack@keystone.service[98462]: Python main interpreter initialized at 0x55ba884c29c0 Oct 04 11:38:44.635850 dv-cinder-860212-2-smb devstack@keystone.service[98462]: python threads support enabled Oct 04 11:38:44.635850 dv-cinder-860212-2-smb devstack@keystone.service[98462]: your server socket listen backlog is limited to 100 connections Oct 04 11:38:44.635850 dv-cinder-860212-2-smb devstack@keystone.service[98462]: your mercy for graceful operations on workers is 90 seconds Oct 04 11:38:44.636203 dv-cinder-860212-2-smb devstack@keystone.service[98462]: mapped 403077 bytes (393 KB) for 2 cores Oct 04 11:38:44.636287 dv-cinder-860212-2-smb devstack@keystone.service[98462]: *** Operational MODE: preforking *** Oct 04 11:38:44.636550 dv-cinder-860212-2-smb devstack@keystone.service[98462]: *** uWSGI is running in multiple interpreter mode *** Oct 04 11:38:44.636550 dv-cinder-860212-2-smb devstack@keystone.service[98462]: spawned uWSGI master process (pid: 98462) Oct 04 11:38:44.636772 dv-cinder-860212-2-smb systemd[1]: Started Devstack devstack@keystone.service. Oct 04 11:38:44.639608 dv-cinder-860212-2-smb devstack@keystone.service[98462]: spawned uWSGI worker 1 (pid: 98474, cores: 1) Oct 04 11:38:44.639608 dv-cinder-860212-2-smb devstack@keystone.service[98462]: spawned uWSGI worker 2 (pid: 98475, cores: 1) Oct 04 11:38:44.639608 dv-cinder-860212-2-smb devstack@keystone.service[98462]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 04 11:38:49.010013 dv-cinder-860212-2-smb devstack@keystone.service[98474]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 11:38:49.010013 dv-cinder-860212-2-smb devstack@keystone.service[98474]: from cryptography.utils import int_from_bytes Oct 04 11:38:49.010842 dv-cinder-860212-2-smb devstack@keystone.service[98474]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 11:38:49.010842 dv-cinder-860212-2-smb devstack@keystone.service[98474]: from cryptography.utils import int_from_bytes Oct 04 11:38:49.016089 dv-cinder-860212-2-smb devstack@keystone.service[98475]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 11:38:49.016089 dv-cinder-860212-2-smb devstack@keystone.service[98475]: from cryptography.utils import int_from_bytes Oct 04 11:38:49.016561 dv-cinder-860212-2-smb devstack@keystone.service[98475]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 11:38:49.016561 dv-cinder-860212-2-smb devstack@keystone.service[98475]: from cryptography.utils import int_from_bytes Oct 04 11:38:49.067950 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 04 11:38:49.068135 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 04 11:38:49.068305 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] command line args: [] {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 04 11:38:49.068571 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 04 11:38:49.068774 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] ================================================================================ {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 04 11:38:49.068877 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 04 11:38:49.068959 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 04 11:38:49.069037 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] admin_token = **** {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:38:49.069157 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] command line args: [] {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 04 11:38:49.069245 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] config_dir = [] {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:38:49.069428 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:38:49.069514 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 04 11:38:49.069591 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] ================================================================================ {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 04 11:38:49.069672 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] config_source = [] {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:38:49.069773 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] debug = True {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:38:49.069859 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] admin_token = **** {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:38:49.069971 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:38:49.070231 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] config_dir = [] {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:38:49.070231 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:38:49.070355 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:38:49.070421 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] config_source = [] {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:38:49.070485 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] insecure_debug = False {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:38:49.070628 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] debug = True {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:38:49.070748 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:38:49.070857 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:38:49.071559 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:38:49.071677 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:38:49.071780 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] list_limit = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:38:49.071877 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] insecure_debug = False {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:38:49.071980 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] log_config_append = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:38:49.072127 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:38:49.072231 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:38:49.072335 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] log_dir = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:38:49.072469 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] log_file = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:38:49.072584 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:38:49.072729 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:38:49.072844 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] list_limit = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:38:49.072969 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] log_config_append = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:38:49.073050 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:38:49.073172 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:38:49.073254 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:38:49.073381 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] log_dir = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:38:49.073381 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] log_file = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:38:49.073566 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:38:49.073650 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:38:49.073727 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:38:49.073849 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:38:49.073933 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:38:49.074011 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:38:49.074127 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:38:49.074208 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:38:49.074331 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:38:49.074418 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:38:49.074496 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:38:49.074643 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:38:49.074730 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:38:49.074872 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:38:49.074958 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:38:49.075100 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:38:49.075186 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:38:49.075342 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:38:49.075427 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:38:49.075576 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:38:49.075694 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] notification_format = cadf {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:38:49.075797 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:38:49.075888 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:38:49.076032 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:38:49.076282 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:38:49.076366 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.59/identity {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:38:49.076499 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] publish_errors = False {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:38:49.076572 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] notification_format = cadf {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:38:49.076730 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:38:49.076811 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:38:49.076959 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:38:49.077135 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:38:49.077298 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.59/identity {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:38:49.077385 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:38:49.077481 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] publish_errors = False {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:38:49.077595 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:38:49.077717 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:38:49.077824 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] standard_threads = False {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:38:49.077961 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:38:49.078047 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] strict_password_check = False {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:38:49.078119 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:38:49.078279 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:38:49.078407 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:38:49.078489 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] use_eventlog = False {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:38:49.078567 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:38:49.078650 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] use_journal = False {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:38:49.078770 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] use_json = False {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:38:49.078854 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] standard_threads = False {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:38:49.078926 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] use_stderr = False {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:38:49.079039 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] strict_password_check = False {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:38:49.079118 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] use_syslog = False {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:38:49.079260 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:38:49.079340 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] watch_log_file = False {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:38:49.079411 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] use_eventlog = False {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:38:49.079554 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.079640 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] use_journal = False {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:38:49.079713 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] use_json = False {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:38:49.079789 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.079888 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] use_stderr = False {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:38:49.080051 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.080131 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] use_syslog = False {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:38:49.080272 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.080357 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] watch_log_file = False {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:38:49.080521 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.080627 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.080782 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.080872 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.081030 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.081109 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.081264 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.081347 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.081510 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.081594 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.081749 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.081833 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.081994 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.082081 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.082226 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.082304 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.082470 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.082554 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.082705 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.082792 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.082953 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.083073 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.083199 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.083326 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.083414 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.083539 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.083653 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.083733 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.083906 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.083985 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.084159 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.084246 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.084399 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.084484 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.084679 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.084844 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.084926 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.084998 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.085175 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.085255 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.085415 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.085501 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.085644 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.085728 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.085875 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.085959 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.086105 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.086195 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.086338 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.086418 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.086603 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.087235 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.087686 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.087795 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.087870 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.087941 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.088010 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.088080 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.088188 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.088275 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.088435 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.088515 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.088695 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.088778 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.088932 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.089060 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.089161 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.089256 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.089384 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.089528 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.089637 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.089743 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.089846 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.089933 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.090052 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.090134 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.090257 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.090344 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.090483 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.090569 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.090717 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.090797 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.090964 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.091046 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.091191 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.091281 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.091425 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.091514 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.091654 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.091739 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.091888 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.091969 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.092119 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.092201 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.092359 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.092476 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.092586 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.092733 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.092844 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.092925 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.093082 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.093166 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.093315 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.093394 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.093547 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.093637 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.093780 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.093860 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.094008 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.094097 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.094245 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.094324 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.094480 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.094572 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.094701 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.094778 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.094933 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.095024 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.095185 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.095269 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.095425 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.095506 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.095653 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.095738 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.095887 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.095978 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.096119 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.096199 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.096375 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.096461 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.096624 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.096739 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.096927 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.097006 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.097084 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.097157 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.097320 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.097405 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.097552 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.097633 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.097783 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.097874 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.098027 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] cache.enabled = True {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.098112 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.098260 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.098348 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.098494 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.098575 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.098730 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.098809 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.098980 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] cache.enabled = True {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.099060 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.099221 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.099302 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.099458 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.099538 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.099690 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.099769 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.099920 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.100001 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.100404 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.100498 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.100656 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.100751 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.100902 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.100983 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.101138 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.101217 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.101374 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.101462 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.101607 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.101686 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.101840 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.101922 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.102077 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.102168 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.102334 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.102423 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.102568 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.102655 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.102843 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.102938 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.103013 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.103090 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.103239 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.103331 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.103466 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.103555 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.103697 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.103777 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.103923 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.104002 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.104154 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.104244 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.104385 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.104469 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.104659 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.104742 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.104864 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.104953 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.105105 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.105188 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.105345 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.105426 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.105587 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.105674 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.105818 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] auth.external = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.105899 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.106047 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] auth.mapped = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.106157 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.106323 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.106404 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.106556 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.106642 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.106786 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] auth.password = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.106868 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] auth.external = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.107014 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] auth.token = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.107094 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] auth.mapped = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.107250 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.107339 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.107482 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] catalog.caching = True {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.107563 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.107724 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.107805 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] auth.password = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.107953 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.108042 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] auth.token = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.108201 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.108288 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.108434 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] catalog.caching = True {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.108520 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.108683 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.108777 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.108917 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] credential.caching = True {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.108998 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.109160 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] credential.driver = sql {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.109247 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.109404 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.109493 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.109636 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.109715 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.109874 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.110047 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] credential.caching = True {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.110174 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.110261 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] credential.driver = sql {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.110363 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.110467 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.110606 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.110721 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.110855 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.111010 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.111087 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.111201 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.111324 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.111439 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.111602 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.111692 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.111843 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.111924 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.112099 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.112179 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.112336 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.112424 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.112588 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.112693 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.112849 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] federation.caching = True {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.112929 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.113082 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.113175 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.113324 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] federation.driver = sql {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.113406 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.113568 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.113648 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.113794 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.113883 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] federation.caching = True {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.114037 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.114165 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.114296 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.114459 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] federation.driver = sql {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.114594 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.114723 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.114809 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.114961 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.115051 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.115202 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.115292 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.115441 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.115529 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.115670 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] identity.caching = True {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.115752 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.115915 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.116004 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.116160 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.116249 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.116392 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.116474 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.116642 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.116742 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.116887 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] identity.driver = sql {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.116975 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] identity.caching = True {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.117114 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.117195 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.117349 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.117438 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.117593 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.117674 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.117992 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.118092 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.118155 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.118235 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] identity.driver = sql {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.118300 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.118392 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.118599 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.118728 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.118856 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.118995 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.119121 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.119248 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.119374 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.119500 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.119626 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.119762 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.119898 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.120026 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.120151 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.120277 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.120404 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.120540 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.120734 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.120863 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.120990 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.121115 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.121242 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.121378 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.121508 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.121643 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.121769 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.121900 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.122025 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.122160 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.122287 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.122412 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.122545 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.122672 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.122798 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.122930 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.123056 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.123180 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.123306 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.123451 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.123575 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.123711 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.123858 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.123944 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.124019 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.124092 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.124170 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.124244 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.124322 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.124401 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.124474 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] ldap.password = **** {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.124545 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.124648 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.124725 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.124797 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.124797 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.124968 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.125050 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.125131 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.125131 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.125261 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.125370 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] ldap.password = **** {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.125489 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.125612 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.125739 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.125854 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.125972 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.126100 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.126203 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.126342 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.126452 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.126692 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.126773 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.126926 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.127004 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.127161 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.127249 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.127396 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.127483 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.127626 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] ldap.user = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.127707 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.127864 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.127952 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.128117 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.128198 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.128346 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.128425 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.128584 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.128693 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.128846 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.128927 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.129081 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] ldap.user = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.129161 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.129316 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.129403 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.129547 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.129628 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.129781 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.129861 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.130013 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.130101 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.130247 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.130328 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.130475 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.130555 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.130718 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.130806 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.130956 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.131037 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.131196 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.131276 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.131432 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.131520 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.131670 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.131751 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.131895 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.131974 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.132138 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.132226 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.132372 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.132453 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.132646 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.132761 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.132918 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.133065 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.133196 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.133327 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.134092 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.134313 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.134446 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.134666 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.134792 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.134920 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.135065 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] policy.driver = sql {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.135205 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.135333 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.135467 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.135595 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.135721 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.135846 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.135970 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.136094 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] receipt.caching = True {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.136229 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.136354 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.136481 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.136623 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.136747 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] policy.driver = sql {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.136871 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.137013 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.137138 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.137268 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.137392 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.137475 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.137677 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] resource.caching = True {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.137787 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] receipt.caching = True {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.137869 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.137942 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.138014 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] resource.driver = sql {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.138086 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.138157 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.138237 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.138311 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.138382 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.138453 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.138524 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.138595 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] revoke.caching = True {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.138674 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] resource.caching = True {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.138748 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.138820 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.138891 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.138969 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] resource.driver = sql {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.139042 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] role.cache_time = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.139122 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.139195 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] role.caching = True {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.139267 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.139339 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] role.driver = sql {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.139453 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.139543 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] role.list_limit = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.139694 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] revoke.caching = True {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.139775 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.139947 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.140028 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.140188 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.140311 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.140429 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] role.cache_time = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.140510 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.140695 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] role.caching = True {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.140779 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.140947 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] role.driver = sql {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.141041 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.141180 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] role.list_limit = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.141261 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.141431 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.141512 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.141667 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.141754 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.141907 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.141985 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.142143 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.142224 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.142389 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.142479 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.142635 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.142716 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.142881 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.143022 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.143130 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.143260 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.143363 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.143507 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.143613 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.143754 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.143861 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.144000 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.144110 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.144255 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.144356 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.144515 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.144768 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.144868 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.145006 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.145087 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.145251 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.145333 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.145483 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.145566 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.145713 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.145800 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.145943 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.146024 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.146188 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.146270 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.146441 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.146520 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.146682 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.146762 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.146917 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.146999 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.147149 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.147228 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.147376 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] token.cache_time = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.147454 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.147607 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.147688 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] token.caching = True {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.147838 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.147917 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.148085 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] token.provider = fernet {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.148165 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.148317 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.148399 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.148565 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.148706 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.148827 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.148908 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.149059 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] token.cache_time = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.149181 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.149864 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.149947 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] token.caching = True {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.150122 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.150197 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.150371 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] trust.driver = sql {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.150453 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] token.provider = fernet {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.150604 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.150685 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.150843 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.150924 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.151076 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.151158 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.151319 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.151400 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.151593 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.151674 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.151823 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.151915 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.152062 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.152145 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] trust.driver = sql {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.152324 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.152405 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.152567 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.152677 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] database.connection = **** {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.152835 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.152916 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.153078 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.153158 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.153319 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.153408 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.153555 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.153637 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.153787 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.153941 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.154019 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.154091 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.154239 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.154329 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] database.connection = **** {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.154470 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.154551 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.154708 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.154789 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.154941 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.155029 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.155180 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.155260 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.155410 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.155490 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.155653 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.155742 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.155884 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.155965 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.156123 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.156202 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.156347 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.156435 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.156583 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.156713 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.156836 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.156918 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.156991 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=98475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 04 11:38:49.157077 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.157384 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.157629 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.157879 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.158112 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.158354 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.158590 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:38:49.158760 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=98474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 04 11:38:49.186418 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=98475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 11:38:49.186645 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=98475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 11:38:49.186871 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=98475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 11:38:49.187109 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=98474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 11:38:49.187343 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=98474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 11:38:49.187570 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=98474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 11:38:49.195130 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=98475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 11:38:49.196770 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=98474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 11:38:49.224338 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=98475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 11:38:49.224566 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=98475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 11:38:49.232081 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=98474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 11:38:49.232311 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=98474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 11:38:49.281321 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=98475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 11:38:49.282157 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=98474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 11:38:49.344120 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=98474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 11:38:49.344354 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=98474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 11:38:49.344498 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=98475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 11:38:49.344769 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=98475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 11:38:49.522436 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=98474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 11:38:49.522643 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=98475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 11:38:49.522643 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=98475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 11:38:49.522773 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=98474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 11:38:49.523139 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=98475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 11:38:49.523233 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=98474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 11:38:49.523233 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=98474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 11:38:49.523363 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=98475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 11:38:49.523363 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=98475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 11:38:49.523475 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=98474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 11:38:49.523538 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=98475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 11:38:49.523616 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=98474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 11:38:49.546939 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=98475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 11:38:49.547071 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=98474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 11:38:49.547157 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=98475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 11:38:49.547236 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=98474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 11:38:49.547323 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=98475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 11:38:49.547401 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=98474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 11:38:49.547517 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=98475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 11:38:49.547639 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=98474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 11:38:49.547725 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=98475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 11:38:49.547818 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=98474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 11:38:49.547907 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=98475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 11:38:49.547988 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=98474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 11:38:49.548119 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=98475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 11:38:49.548205 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=98474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 11:38:49.559735 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=98475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 11:38:49.559898 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=98474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 11:38:49.573008 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=98475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 11:38:49.573233 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=98475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 11:38:49.573322 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=98474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 11:38:49.573451 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=98475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 11:38:49.573540 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=98474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 11:38:49.573666 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=98475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 11:38:49.573752 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=98474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 11:38:49.573877 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=98475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 11:38:49.573963 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=98474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 11:38:49.574087 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=98475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 11:38:49.574175 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=98474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 11:38:49.574296 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=98475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 11:38:49.574390 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=98474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 11:38:49.574507 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=98474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 11:38:49.599267 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.599474 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 04 11:38:49.599561 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.599746 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 04 11:38:49.599896 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.600004 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 04 11:38:49.600353 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.600537 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.600666 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 04 11:38:49.600819 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.600907 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.601074 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.601160 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.601328 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.601409 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.601584 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.611010 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.611285 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.611371 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.611556 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.611640 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.611837 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.611935 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.612118 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.619496 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=98475) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 11:38:49.619694 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=98474) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 11:38:49.622401 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=98475) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 11:38:49.622626 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=98474) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 11:38:49.622712 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.622912 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.622995 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.623198 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.623359 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.623483 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.623566 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.623741 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.623823 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.624008 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.624100 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.624280 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.624371 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.624560 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.624729 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.624851 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.624939 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.625111 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.625196 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.625376 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.648025 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.648889 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.650110 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=98475) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 11:38:49.650414 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.650921 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=98474) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 11:38:49.651209 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.655163 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=98475) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 11:38:49.655440 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.655721 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.655968 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=98474) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 11:38:49.656253 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.656534 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.662177 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=98475) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 11:38:49.662460 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.663016 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=98474) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 11:38:49.663304 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.668238 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=98475) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 11:38:49.668535 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.668851 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.669141 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.669292 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=98474) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 11:38:49.669422 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.669562 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.669697 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.669830 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.669964 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.670097 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.670310 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.670478 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.670616 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.670852 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.671123 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.686273 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.687037 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.689114 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.689396 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.690500 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=98475) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 11:38:49.693246 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=98474) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 11:38:49.693740 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.694035 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.697139 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.697436 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.698856 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=98475) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 11:38:49.701634 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=98474) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 11:38:49.702003 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=98475) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 11:38:49.704748 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=98474) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 11:38:49.705266 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.705566 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.705852 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.706133 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.706424 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.706706 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.707922 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.708223 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.708511 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.708825 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.709106 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.709387 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.722785 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=98475) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 11:38:49.723067 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.723335 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.723598 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.725516 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=98474) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 11:38:49.725807 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.726080 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.726345 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.731238 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.732791 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.733815 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.734312 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.734595 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.735335 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.736861 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.737139 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.737278 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=98475) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 11:38:49.737534 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.737815 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.738096 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.738486 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.739842 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=98474) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 11:38:49.740130 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.740423 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.740738 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.741134 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.750292 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=98475) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 11:38:49.750575 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.750851 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.751124 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.751497 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.755722 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.755722 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.755880 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=98474) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 11:38:49.755880 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.755880 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.755880 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.755880 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.755880 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.756215 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.767534 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=98475) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 11:38:49.770455 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=98475) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 11:38:49.770558 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=98474) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 11:38:49.773390 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=98474) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 11:38:49.773479 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.774926 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.776380 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=98475) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 11:38:49.776483 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.776715 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.777075 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.777956 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.779549 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=98474) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 11:38:49.779967 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.780661 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.783600 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.785077 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=98475) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 11:38:49.787494 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.790802 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.790802 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.790802 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.790802 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.791064 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=98474) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 11:38:49.792410 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.792839 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.793131 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.793409 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.797328 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=98475) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 11:38:49.797572 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.797855 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.801281 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=98474) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 11:38:49.801582 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.801866 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.804790 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=98475) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 11:38:49.805073 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.805399 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.806480 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.806480 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.806760 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.807039 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.807396 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.807601 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.807882 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.808171 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.808429 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.808747 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.809017 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=98475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.809475 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=98474) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 11:38:49.809763 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.810044 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.810318 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.810588 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.810857 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.811137 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.811421 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.811692 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.811959 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.812247 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.812517 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.812805 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.813066 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=98474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 11:38:49.843358 dv-cinder-860212-2-smb devstack@keystone.service[98475]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55ba884c29c0 pid: 98475 (default app) Oct 04 11:38:49.846703 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c97437-2e21-43ba-af31-039824a2fd33 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:38:49.846988 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c97437-2e21-43ba-af31-039824a2fd33 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:38:49.847264 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c97437-2e21-43ba-af31-039824a2fd33 None None] PATH_INFO: `/v3` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:38:49.847404 dv-cinder-860212-2-smb devstack@keystone.service[98474]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55ba884c29c0 pid: 98474 (default app) Oct 04 11:38:49.851616 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1/1] 10.222.0.59 () {50 vars in 791 bytes} [Tue Oct 4 11:38:49 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:38:58.024063 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86fb667-e625-4f34-8f1e-089b8c1b269d None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:38:58.024765 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86fb667-e625-4f34-8f1e-089b8c1b269d None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:38:58.024765 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86fb667-e625-4f34-8f1e-089b8c1b269d None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:38:58.029517 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1/2] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:38:58 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 11:38:58.035240 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f81c6b-5a17-4291-a0de-729bf3b6c416 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:38:58.035809 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f81c6b-5a17-4291-a0de-729bf3b6c416 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:38:58.035809 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f81c6b-5a17-4291-a0de-729bf3b6c416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:38:58.115506 dv-cinder-860212-2-smb devstack@keystone.service[98475]: INFO dbcounter [None req-f2f81c6b-5a17-4291-a0de-729bf3b6c416 None None] Registered counter for database keystone Oct 04 11:38:58.137156 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG oslo_db.sqlalchemy.engines [None req-f2f81c6b-5a17-4291-a0de-729bf3b6c416 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=98475) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 11:38:58.143331 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writer thread running {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 11:38:58.324033 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG passlib.handlers.bcrypt [None req-f2f81c6b-5a17-4291-a0de-729bf3b6c416 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=98475) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 04 11:38:58.324347 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG passlib.handlers.bcrypt [None req-f2f81c6b-5a17-4291-a0de-729bf3b6c416 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=98475) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 04 11:38:58.384883 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-f2f81c6b-5a17-4291-a0de-729bf3b6c416 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:38:58.386489 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-f2f81c6b-5a17-4291-a0de-729bf3b6c416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:38:58.516281 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 2/3] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:38:58 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 482 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 04 11:38:58.982078 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86fb667-e625-4f34-8f1e-089b8c1b269d None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:38:59.051821 dv-cinder-860212-2-smb devstack@keystone.service[98474]: INFO dbcounter [None req-c86fb667-e625-4f34-8f1e-089b8c1b269d None None] Registered counter for database keystone Oct 04 11:38:59.072820 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG oslo_db.sqlalchemy.engines [None req-c86fb667-e625-4f34-8f1e-089b8c1b269d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=98474) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 11:38:59.080311 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writer thread running {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 11:38:59.205679 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86fb667-e625-4f34-8f1e-089b8c1b269d None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:38:59.209834 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad8f88e-0478-47b1-95aa-674d77c3e09c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:38:59.210455 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad8f88e-0478-47b1-95aa-674d77c3e09c admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:38:59.210734 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad8f88e-0478-47b1-95aa-674d77c3e09c admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:38:59.211005 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad8f88e-0478-47b1-95aa-674d77c3e09c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:38:59.219681 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad8f88e-0478-47b1-95aa-674d77c3e09c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:38:59.272176 dv-cinder-860212-2-smb devstack@keystone.service[98474]: WARNING keystone.common.rbac_enforcer.enforcer [None req-aad8f88e-0478-47b1-95aa-674d77c3e09c admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 04 11:38:59.272465 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad8f88e-0478-47b1-95aa-674d77c3e09c admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:38:59.282516 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 2/4] 10.222.0.59 () {58 vars in 1324 bytes} [Tue Oct 4 11:38:58 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 04 11:38:59.288569 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f81c6b-5a17-4291-a0de-729bf3b6c416 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:38:59.307042 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f81c6b-5a17-4291-a0de-729bf3b6c416 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:38:59.311421 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a621f1-3e1e-42fd-b3f4-295513c7bf7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:38:59.312520 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a621f1-3e1e-42fd-b3f4-295513c7bf7e admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:38:59.312832 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a621f1-3e1e-42fd-b3f4-295513c7bf7e admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:38:59.313107 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a621f1-3e1e-42fd-b3f4-295513c7bf7e admin admin] PATH_INFO: `/v3/projects/f4d88030405047648869d4fa21dc117c` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:38:59.314689 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a621f1-3e1e-42fd-b3f4-295513c7bf7e admin admin] RBAC: Authorizing `identity:get_project(project_id=f4d88030405047648869d4fa21dc117c)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:38:59.368203 dv-cinder-860212-2-smb devstack@keystone.service[98475]: WARNING keystone.common.rbac_enforcer.enforcer [None req-c9a621f1-3e1e-42fd-b3f4-295513c7bf7e admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 04 11:38:59.368550 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a621f1-3e1e-42fd-b3f4-295513c7bf7e admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:38:59.373052 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 3/5] 10.222.0.59 () {56 vars in 1207 bytes} [Tue Oct 4 11:38:59 2022] GET /identity/v3/projects/f4d88030405047648869d4fa21dc117c => generated 344 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:39:01.511121 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18094206-4f82-4264-a7ec-a3545c0490b5 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:01.511636 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18094206-4f82-4264-a7ec-a3545c0490b5 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:01.511719 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18094206-4f82-4264-a7ec-a3545c0490b5 None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:01.515877 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 3/6] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:39:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:39:01.521455 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cca04e1-2f8a-4fe4-befe-ec5e9d10c7da None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:01.521899 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cca04e1-2f8a-4fe4-befe-ec5e9d10c7da None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:01.522015 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cca04e1-2f8a-4fe4-befe-ec5e9d10c7da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:01.543101 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-4cca04e1-2f8a-4fe4-befe-ec5e9d10c7da None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:39:01.544627 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-4cca04e1-2f8a-4fe4-befe-ec5e9d10c7da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:39:01.552202 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 4/7] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:39:01 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 04 11:39:01.824136 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18094206-4f82-4264-a7ec-a3545c0490b5 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:01.836693 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18094206-4f82-4264-a7ec-a3545c0490b5 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:01.840959 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ee2f0a-558a-4234-9422-5e7ef948cd3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:01.841554 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ee2f0a-558a-4234-9422-5e7ef948cd3b admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:01.841837 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ee2f0a-558a-4234-9422-5e7ef948cd3b admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:01.842113 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ee2f0a-558a-4234-9422-5e7ef948cd3b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:01.849682 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ee2f0a-558a-4234-9422-5e7ef948cd3b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:01.851730 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ee2f0a-558a-4234-9422-5e7ef948cd3b admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:01.860302 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 4/8] 10.222.0.59 () {58 vars in 1324 bytes} [Tue Oct 4 11:39:01 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 11:39:01.865616 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cca04e1-2f8a-4fe4-befe-ec5e9d10c7da None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:01.874619 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cca04e1-2f8a-4fe4-befe-ec5e9d10c7da None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:01.878808 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcb0aff-ea0f-4b59-85c3-f4530b2057ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:01.879418 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcb0aff-ea0f-4b59-85c3-f4530b2057ed admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:01.879696 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcb0aff-ea0f-4b59-85c3-f4530b2057ed admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:01.879966 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcb0aff-ea0f-4b59-85c3-f4530b2057ed admin admin] PATH_INFO: `/v3/users/6d735c10f69940bfb89355f7b5643d4e` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:01.881290 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcb0aff-ea0f-4b59-85c3-f4530b2057ed admin admin] RBAC: Authorizing `identity:get_user(user_id=6d735c10f69940bfb89355f7b5643d4e)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:01.883809 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcb0aff-ea0f-4b59-85c3-f4530b2057ed admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:01.885392 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 5/9] 10.222.0.59 () {56 vars in 1198 bytes} [Tue Oct 4 11:39:01 2022] GET /identity/v3/users/6d735c10f69940bfb89355f7b5643d4e => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 11:39:04.094632 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8539c1af-d6aa-4209-ba96-8cb4108cee61 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:04.095175 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8539c1af-d6aa-4209-ba96-8cb4108cee61 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:04.095175 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8539c1af-d6aa-4209-ba96-8cb4108cee61 None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:04.096514 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 5/10] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:39:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:39:04.102806 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cc11a0-043f-402c-be1e-970f9b441e54 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:04.103305 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cc11a0-043f-402c-be1e-970f9b441e54 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:04.103514 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cc11a0-043f-402c-be1e-970f9b441e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:04.124218 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-26cc11a0-043f-402c-be1e-970f9b441e54 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:39:04.125875 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-26cc11a0-043f-402c-be1e-970f9b441e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:39:04.208244 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 6/11] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:39:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 11:39:04.209952 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f471bd06-fc99-40be-b21a-26920730fb4a None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:04.210242 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f471bd06-fc99-40be-b21a-26920730fb4a None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:04.210516 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f471bd06-fc99-40be-b21a-26920730fb4a None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:04.212745 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 6/12] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:39:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:39:04.218031 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9547c1b3-7fbf-4a77-a559-2853c923f45d None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:04.218381 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9547c1b3-7fbf-4a77-a559-2853c923f45d None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:04.218660 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9547c1b3-7fbf-4a77-a559-2853c923f45d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:04.237861 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-9547c1b3-7fbf-4a77-a559-2853c923f45d None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:39:04.239049 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-9547c1b3-7fbf-4a77-a559-2853c923f45d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:39:04.255495 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:04.309179 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 7/13] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:39:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 11:39:04.478570 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f471bd06-fc99-40be-b21a-26920730fb4a None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:04.586427 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9547c1b3-7fbf-4a77-a559-2853c923f45d None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:04.623436 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f471bd06-fc99-40be-b21a-26920730fb4a None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:04.656979 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab358b01-4735-4543-af96-8eaf53394368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:04.657828 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab358b01-4735-4543-af96-8eaf53394368 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:04.658109 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab358b01-4735-4543-af96-8eaf53394368 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:04.658384 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab358b01-4735-4543-af96-8eaf53394368 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:04.669333 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab358b01-4735-4543-af96-8eaf53394368 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 11:39:04.680169 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-ab358b01-4735-4543-af96-8eaf53394368 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 11:39:04.680169 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:39:04.680169 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:39:04.680169 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:39:04.680169 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:39:04.680169 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:39:04.680169 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:39:04.680169 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:39:04.680169 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:39:04.680169 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:39:04.680169 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:39:04.680169 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:39:04.680169 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 11:39:04.680169 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 11:39:04.680169 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 11:39:04.680169 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 11:39:04.681177 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 11:39:04.681177 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 11:39:04.681177 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 11:39:04.681177 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 11:39:04.681177 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:39:04.681177 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:39:04.681177 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:39:04.681177 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:39:04.681177 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:39:04.681177 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:39:04.681177 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:39:04.681177 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:39:04.681177 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:39:04.681177 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:39:04.681177 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:39:04.681177 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:39:04.682301 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:39:04.682301 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:39:04.682301 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:39:04.682301 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:39:04.682301 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 11:39:04.682301 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 11:39:04.682301 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 11:39:04.682301 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 11:39:04.682301 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 11:39:04.682301 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 11:39:04.682301 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 11:39:04.682301 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:39:04.682301 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 7/14] 10.222.0.59 () {56 vars in 1096 bytes} [Tue Oct 4 11:39:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 11:39:04.686991 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab358b01-4735-4543-af96-8eaf53394368 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:04.692134 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9547c1b3-7fbf-4a77-a559-2853c923f45d None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:04.720616 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:04.727363 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d835e4f-3fe5-459a-899c-a1ca5af5e5be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:04.727978 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d835e4f-3fe5-459a-899c-a1ca5af5e5be None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:04.728258 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d835e4f-3fe5-459a-899c-a1ca5af5e5be None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:04.728534 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d835e4f-3fe5-459a-899c-a1ca5af5e5be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:04.750231 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:04.788189 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab358b01-4735-4543-af96-8eaf53394368 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:04.796001 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d835e4f-3fe5-459a-899c-a1ca5af5e5be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:04.797527 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d835e4f-3fe5-459a-899c-a1ca5af5e5be None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:04.821741 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3f8afd-e679-4154-b550-eba8620dc70a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:04.822347 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3f8afd-e679-4154-b550-eba8620dc70a None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:04.822622 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3f8afd-e679-4154-b550-eba8620dc70a None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:04.822895 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3f8afd-e679-4154-b550-eba8620dc70a None admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:04.823558 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3f8afd-e679-4154-b550-eba8620dc70a None admin] RBAC: Adding query filter params (name=admin) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:39:04.823861 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3f8afd-e679-4154-b550-eba8620dc70a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:04.825256 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3f8afd-e679-4154-b550-eba8620dc70a None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:04.836763 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 8/15] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Oct 4 11:39:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 11:39:04.842390 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3f8afd-e679-4154-b550-eba8620dc70a None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:04.895320 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 8/16] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Oct 4 11:39:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 04 11:39:04.901232 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d835e4f-3fe5-459a-899c-a1ca5af5e5be None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:04.932918 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:04.938973 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3f8afd-e679-4154-b550-eba8620dc70a None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:04.951837 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:04.971387 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ffc7cd-48ea-47e1-9bc0-4342828b3132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:04.972015 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ffc7cd-48ea-47e1-9bc0-4342828b3132 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:04.972293 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ffc7cd-48ea-47e1-9bc0-4342828b3132 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:04.972565 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ffc7cd-48ea-47e1-9bc0-4342828b3132 None admin] PATH_INFO: `/v3/users/6d735c10f69940bfb89355f7b5643d4e` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:04.974116 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ffc7cd-48ea-47e1-9bc0-4342828b3132 None admin] RBAC: Authorizing `identity:get_user(user_id=6d735c10f69940bfb89355f7b5643d4e)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:04.975797 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ffc7cd-48ea-47e1-9bc0-4342828b3132 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:04.977992 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 9/17] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Oct 4 11:39:04 2022] GET /identity/v3/users/6d735c10f69940bfb89355f7b5643d4e => generated 247 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 11:39:04.983368 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ffc7cd-48ea-47e1-9bc0-4342828b3132 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:04.998949 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d835e4f-3fe5-459a-899c-a1ca5af5e5be None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:05.033752 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1419f89f-38bf-445c-8879-4cdafe49e8fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:05.034308 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1419f89f-38bf-445c-8879-4cdafe49e8fc None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:05.034592 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1419f89f-38bf-445c-8879-4cdafe49e8fc None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:05.034864 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1419f89f-38bf-445c-8879-4cdafe49e8fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:05.045526 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1419f89f-38bf-445c-8879-4cdafe49e8fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:05.047000 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1419f89f-38bf-445c-8879-4cdafe49e8fc None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:05.065813 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-1419f89f-38bf-445c-8879-4cdafe49e8fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:39:05.065813 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:39:05.065813 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:39:05.065813 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:39:05.065813 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:39:05.065813 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:39:05.065813 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:39:05.065813 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:39:05.065813 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:39:05.065813 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:39:05.065813 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:39:05.065813 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:39:05.065813 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 11:39:05.065813 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 11:39:05.065813 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 11:39:05.065813 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 11:39:05.066748 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:39:05.066748 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:39:05.066748 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:39:05.066748 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:39:05.066748 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:39:05.066748 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:39:05.066748 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:39:05.066748 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:39:05.066748 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:39:05.066748 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:39:05.066748 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:39:05.066748 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:39:05.066748 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:39:05.066748 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:39:05.066748 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:39:05.066748 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:39:05.066748 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 11:39:05.067849 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 11:39:05.067849 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:39:05.067849 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:39:05.067849 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 9/18] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Oct 4 11:39:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 11:39:05.072611 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1419f89f-38bf-445c-8879-4cdafe49e8fc None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:05.081335 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ffc7cd-48ea-47e1-9bc0-4342828b3132 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:05.115061 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8680333c-63c9-45c8-b533-64009d23e73b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:05.115792 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8680333c-63c9-45c8-b533-64009d23e73b None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:05.116003 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8680333c-63c9-45c8-b533-64009d23e73b None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:05.116268 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8680333c-63c9-45c8-b533-64009d23e73b None admin] PATH_INFO: `/v3/domains/default` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:05.117653 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8680333c-63c9-45c8-b533-64009d23e73b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:05.118995 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8680333c-63c9-45c8-b533-64009d23e73b None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:05.120526 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 10/19] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Oct 4 11:39:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 11:39:05.126397 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8680333c-63c9-45c8-b533-64009d23e73b None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:05.160038 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:05.177041 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1419f89f-38bf-445c-8879-4cdafe49e8fc None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:05.179346 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:05.210182 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f25ba2d-f333-4750-aeb9-d3dcbcd6d6a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:05.211478 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f25ba2d-f333-4750-aeb9-d3dcbcd6d6a1 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:05.211846 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f25ba2d-f333-4750-aeb9-d3dcbcd6d6a1 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:05.212132 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f25ba2d-f333-4750-aeb9-d3dcbcd6d6a1 None admin] PATH_INFO: `/v3/domains` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:05.212898 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f25ba2d-f333-4750-aeb9-d3dcbcd6d6a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:39:05.213198 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f25ba2d-f333-4750-aeb9-d3dcbcd6d6a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:05.214588 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f25ba2d-f333-4750-aeb9-d3dcbcd6d6a1 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:05.230776 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8680333c-63c9-45c8-b533-64009d23e73b None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:05.232417 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 10/20] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Oct 4 11:39:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 11:39:05.269595 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8d20f1-fed0-4eed-9624-7820d0af9c36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:05.270234 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8d20f1-fed0-4eed-9624-7820d0af9c36 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:05.270517 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8d20f1-fed0-4eed-9624-7820d0af9c36 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:05.270813 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8d20f1-fed0-4eed-9624-7820d0af9c36 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:05.271539 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8d20f1-fed0-4eed-9624-7820d0af9c36 None admin] RBAC: Adding query filter params (role.id=d6e7421d1ff9451c808004b818354550, scope.domain.id=default, user.id=6d735c10f69940bfb89355f7b5643d4e) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:39:05.271844 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8d20f1-fed0-4eed-9624-7820d0af9c36 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:05.273890 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8d20f1-fed0-4eed-9624-7820d0af9c36 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:05.283896 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 11/21] 10.222.0.59 () {56 vars in 1322 bytes} [Tue Oct 4 11:39:05 2022] GET /identity/v3/role_assignments?user.id=6d735c10f69940bfb89355f7b5643d4e&scope.domain.id=default&role.id=d6e7421d1ff9451c808004b818354550 => generated 233 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 11:39:07.755087 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51faa9c4-73b6-416b-b827-fcbcce75a0b3 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:07.755590 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51faa9c4-73b6-416b-b827-fcbcce75a0b3 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:07.755662 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51faa9c4-73b6-416b-b827-fcbcce75a0b3 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:07.757002 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 11/22] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:39:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:39:07.763262 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bd5a77-7af8-40a2-8bf3-b595fab1a689 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:07.764131 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bd5a77-7af8-40a2-8bf3-b595fab1a689 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:07.764679 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bd5a77-7af8-40a2-8bf3-b595fab1a689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:07.786862 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG passlib.handlers.bcrypt [None req-b3bd5a77-7af8-40a2-8bf3-b595fab1a689 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=98474) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 04 11:39:07.787554 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG passlib.handlers.bcrypt [None req-b3bd5a77-7af8-40a2-8bf3-b595fab1a689 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=98474) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 04 11:39:07.845675 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-b3bd5a77-7af8-40a2-8bf3-b595fab1a689 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:39:07.847742 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-b3bd5a77-7af8-40a2-8bf3-b595fab1a689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:39:07.939991 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239a9d6c-6425-428c-8f93-cf8cc43c7554 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:07.940663 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239a9d6c-6425-428c-8f93-cf8cc43c7554 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:07.941317 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239a9d6c-6425-428c-8f93-cf8cc43c7554 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:07.948632 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 12/23] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:39:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:39:07.960134 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bc9eeb-154e-4dfc-aaf1-236900175f52 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:07.960865 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bc9eeb-154e-4dfc-aaf1-236900175f52 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:07.961364 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bc9eeb-154e-4dfc-aaf1-236900175f52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:07.966272 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 12/24] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:39:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 11:39:07.997714 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-a1bc9eeb-154e-4dfc-aaf1-236900175f52 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:39:07.999257 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-a1bc9eeb-154e-4dfc-aaf1-236900175f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:39:08.082288 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e73163e-cb92-4060-b320-3f6c1038a65a None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:08.082772 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e73163e-cb92-4060-b320-3f6c1038a65a None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:08.083255 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e73163e-cb92-4060-b320-3f6c1038a65a None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:08.085152 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 13/25] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:39:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:39:08.091720 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5289df47-e78f-4286-bb61-0e2c87ed7fab None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:08.092313 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5289df47-e78f-4286-bb61-0e2c87ed7fab None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:08.092845 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5289df47-e78f-4286-bb61-0e2c87ed7fab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:08.096341 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 13/26] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:39:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 11:39:08.137643 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-5289df47-e78f-4286-bb61-0e2c87ed7fab None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:39:08.139199 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-5289df47-e78f-4286-bb61-0e2c87ed7fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:39:08.165138 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:08.242336 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 14/27] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:39:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Oct 04 11:39:08.425772 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bc9eeb-154e-4dfc-aaf1-236900175f52 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:08.468904 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5289df47-e78f-4286-bb61-0e2c87ed7fab None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:08.601815 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bc9eeb-154e-4dfc-aaf1-236900175f52 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:08.629543 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:08.654373 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74d2e98-ae53-402f-894e-aa5cbdf86711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:08.655037 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74d2e98-ae53-402f-894e-aa5cbdf86711 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:08.655318 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74d2e98-ae53-402f-894e-aa5cbdf86711 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:08.655648 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74d2e98-ae53-402f-894e-aa5cbdf86711 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:08.681301 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74d2e98-ae53-402f-894e-aa5cbdf86711 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 11:39:08.687747 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-f74d2e98-ae53-402f-894e-aa5cbdf86711 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 11:39:08.687747 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:39:08.687747 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:39:08.687747 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:39:08.687747 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:39:08.687747 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:39:08.687747 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:39:08.687747 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:39:08.687747 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:39:08.687747 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:39:08.687747 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:39:08.687747 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:39:08.687747 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 11:39:08.687747 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 11:39:08.687747 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 11:39:08.687747 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 11:39:08.688728 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 11:39:08.688728 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 11:39:08.688728 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 11:39:08.688728 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 11:39:08.688728 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:39:08.688728 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:39:08.688728 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:39:08.688728 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:39:08.688728 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:39:08.688728 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:39:08.688728 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:39:08.688728 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:39:08.688728 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:39:08.688728 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:39:08.688728 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:39:08.688728 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:39:08.689498 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:39:08.689498 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:39:08.689498 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:39:08.689498 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:39:08.689498 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 11:39:08.689498 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 11:39:08.689498 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 11:39:08.689498 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 11:39:08.689498 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 11:39:08.689498 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 11:39:08.689498 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 11:39:08.689498 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:39:08.700993 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 14/28] 10.222.0.59 () {56 vars in 1096 bytes} [Tue Oct 4 11:39:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:39:08.702227 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594d7fc4-9522-41a0-9d1e-ae4730d3f467 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:08.702509 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594d7fc4-9522-41a0-9d1e-ae4730d3f467 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:08.702781 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594d7fc4-9522-41a0-9d1e-ae4730d3f467 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:08.704185 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 15/29] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:39:08 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:39:08.709815 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5289df47-e78f-4286-bb61-0e2c87ed7fab None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:08.713823 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55214c94-f4d8-45af-aaa9-8b47cea8ba32 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:08.714110 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55214c94-f4d8-45af-aaa9-8b47cea8ba32 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:08.714384 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55214c94-f4d8-45af-aaa9-8b47cea8ba32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:08.740429 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-55214c94-f4d8-45af-aaa9-8b47cea8ba32 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:39:08.741955 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-55214c94-f4d8-45af-aaa9-8b47cea8ba32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:39:08.750516 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4f9b39-509b-4661-b580-f26e45afb5e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:08.751189 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4f9b39-509b-4661-b580-f26e45afb5e3 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:08.751876 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4f9b39-509b-4661-b580-f26e45afb5e3 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:08.752152 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4f9b39-509b-4661-b580-f26e45afb5e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:08.776868 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4f9b39-509b-4661-b580-f26e45afb5e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:08.778511 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4f9b39-509b-4661-b580-f26e45afb5e3 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:08.799087 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-4e4f9b39-509b-4661-b580-f26e45afb5e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:39:08.799087 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:39:08.799087 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:39:08.799087 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:39:08.799087 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:39:08.799087 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:39:08.799087 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:39:08.799087 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:39:08.799087 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:39:08.799087 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:39:08.799087 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:39:08.799087 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:39:08.799087 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 11:39:08.799087 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 11:39:08.799087 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 11:39:08.799087 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 11:39:08.800190 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:39:08.800190 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:39:08.800190 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:39:08.800190 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:39:08.800190 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:39:08.800190 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:39:08.800190 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:39:08.800190 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:39:08.800190 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:39:08.800190 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:39:08.800190 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:39:08.800190 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:39:08.800190 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:39:08.800190 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:39:08.800190 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:39:08.800190 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:39:08.800190 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 11:39:08.801066 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 11:39:08.801066 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:39:08.801066 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:39:08.801066 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 15/30] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Oct 4 11:39:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 11:39:08.805371 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4f9b39-509b-4661-b580-f26e45afb5e3 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:08.821002 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:08.830118 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 16/31] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:39:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 11:39:08.831049 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55214c94-f4d8-45af-aaa9-8b47cea8ba32 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:08.937304 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:08.965785 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55214c94-f4d8-45af-aaa9-8b47cea8ba32 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:08.982323 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4f9b39-509b-4661-b580-f26e45afb5e3 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:09.026078 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c407fff-9d2d-4466-82d6-ad4378b66ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:09.027160 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c407fff-9d2d-4466-82d6-ad4378b66ab8 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:09.027639 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c407fff-9d2d-4466-82d6-ad4378b66ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:09.028085 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c407fff-9d2d-4466-82d6-ad4378b66ab8 None admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:09.029351 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c407fff-9d2d-4466-82d6-ad4378b66ab8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:39:09.029864 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c407fff-9d2d-4466-82d6-ad4378b66ab8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:09.031655 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c407fff-9d2d-4466-82d6-ad4378b66ab8 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:09.051545 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 17/32] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Oct 4 11:39:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:39:09.052853 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c407fff-9d2d-4466-82d6-ad4378b66ab8 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:09.094060 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe90fd6-f9eb-456c-ab79-e11c64330e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:09.104720 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe90fd6-f9eb-456c-ab79-e11c64330e00 None admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:09.104720 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe90fd6-f9eb-456c-ab79-e11c64330e00 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:09.104720 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe90fd6-f9eb-456c-ab79-e11c64330e00 None admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:09.108621 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe90fd6-f9eb-456c-ab79-e11c64330e00 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:09.108621 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe90fd6-f9eb-456c-ab79-e11c64330e00 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:09.166441 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c407fff-9d2d-4466-82d6-ad4378b66ab8 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:09.203448 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de82af1-51ba-4765-9bb6-bffb2fe209cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:09.203979 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de82af1-51ba-4765-9bb6-bffb2fe209cc None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:09.204260 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de82af1-51ba-4765-9bb6-bffb2fe209cc None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:09.204532 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de82af1-51ba-4765-9bb6-bffb2fe209cc None admin] PATH_INFO: `/v3/domains` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:09.205205 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de82af1-51ba-4765-9bb6-bffb2fe209cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:39:09.205510 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de82af1-51ba-4765-9bb6-bffb2fe209cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:09.207144 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de82af1-51ba-4765-9bb6-bffb2fe209cc None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:09.222382 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 18/33] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Oct 4 11:39:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:39:09.222382 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de82af1-51ba-4765-9bb6-bffb2fe209cc None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:09.230551 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:09.334983 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de82af1-51ba-4765-9bb6-bffb2fe209cc None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:09.358247 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 16/34] 10.222.0.59 () {60 vars in 1131 bytes} [Tue Oct 4 11:39:08 2022] POST /identity/v3/roles => generated 225 bytes in 557 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 11:39:09.359535 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe90fd6-f9eb-456c-ab79-e11c64330e00 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:09.395233 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc9d436-ee60-42fa-afb4-421512137be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:09.395883 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc9d436-ee60-42fa-afb4-421512137be3 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:09.396162 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc9d436-ee60-42fa-afb4-421512137be3 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:09.396432 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc9d436-ee60-42fa-afb4-421512137be3 None admin] PATH_INFO: `/v3/users/6d735c10f69940bfb89355f7b5643d4e` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:09.399337 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc9d436-ee60-42fa-afb4-421512137be3 None admin] RBAC: Authorizing `identity:get_user(user_id=6d735c10f69940bfb89355f7b5643d4e)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:09.400929 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc9d436-ee60-42fa-afb4-421512137be3 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:09.402626 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 19/35] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Oct 4 11:39:09 2022] GET /identity/v3/users/6d735c10f69940bfb89355f7b5643d4e => generated 247 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:39:09.406933 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc9d436-ee60-42fa-afb4-421512137be3 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:09.476993 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:09.528126 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe90fd6-f9eb-456c-ab79-e11c64330e00 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:09.566072 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:09.567551 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce20cc5-6dbe-44dc-9a4b-2085251b3000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:09.568352 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce20cc5-6dbe-44dc-9a4b-2085251b3000 None admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:09.568677 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce20cc5-6dbe-44dc-9a4b-2085251b3000 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:09.568953 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce20cc5-6dbe-44dc-9a4b-2085251b3000 None admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:09.569636 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce20cc5-6dbe-44dc-9a4b-2085251b3000 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:09.571245 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce20cc5-6dbe-44dc-9a4b-2085251b3000 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:09.607843 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc9d436-ee60-42fa-afb4-421512137be3 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:09.645884 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3154fdba-b08b-4f44-ba47-339c832d1aa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:09.646489 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3154fdba-b08b-4f44-ba47-339c832d1aa1 None admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:09.646771 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3154fdba-b08b-4f44-ba47-339c832d1aa1 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:09.647042 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3154fdba-b08b-4f44-ba47-339c832d1aa1 None admin] PATH_INFO: `/v3/projects` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:09.647686 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3154fdba-b08b-4f44-ba47-339c832d1aa1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:09.649773 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3154fdba-b08b-4f44-ba47-339c832d1aa1 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:09.654619 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 17/36] 10.222.0.59 () {60 vars in 1131 bytes} [Tue Oct 4 11:39:09 2022] POST /identity/v3/roles => generated 219 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 11:39:09.655442 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce20cc5-6dbe-44dc-9a4b-2085251b3000 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:09.769754 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce20cc5-6dbe-44dc-9a4b-2085251b3000 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:09.800225 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:09.810085 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377e0606-98ee-4b9a-aa2c-b66a7a56dae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:09.810740 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377e0606-98ee-4b9a-aa2c-b66a7a56dae6 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:09.811021 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377e0606-98ee-4b9a-aa2c-b66a7a56dae6 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:09.811297 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377e0606-98ee-4b9a-aa2c-b66a7a56dae6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:09.812864 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377e0606-98ee-4b9a-aa2c-b66a7a56dae6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:09.814328 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377e0606-98ee-4b9a-aa2c-b66a7a56dae6 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:09.820927 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 18/37] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Oct 4 11:39:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:39:09.820927 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567d9ca7-0678-4c79-a49d-387655fba0e5 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:09.820927 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567d9ca7-0678-4c79-a49d-387655fba0e5 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:09.820927 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567d9ca7-0678-4c79-a49d-387655fba0e5 None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:09.820927 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 19/38] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:39:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:39:09.820927 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7411846-e794-4ec2-8d25-fe87b8cb0d70 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:09.820927 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7411846-e794-4ec2-8d25-fe87b8cb0d70 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:09.832274 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7411846-e794-4ec2-8d25-fe87b8cb0d70 None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:09.832274 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 20/39] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:39:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:39:09.832274 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7411846-e794-4ec2-8d25-fe87b8cb0d70 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:09.950151 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7411846-e794-4ec2-8d25-fe87b8cb0d70 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:09.964194 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 20/40] 10.222.0.59 () {60 vars in 1141 bytes} [Tue Oct 4 11:39:09 2022] POST /identity/v3/projects => generated 301 bytes in 561 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 11:39:09.965651 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87cb2ba-2a4f-498e-875c-4add46f84117 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:09.965938 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87cb2ba-2a4f-498e-875c-4add46f84117 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:09.966214 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87cb2ba-2a4f-498e-875c-4add46f84117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:09.987135 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-a87cb2ba-2a4f-498e-875c-4add46f84117 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:39:09.988755 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-a87cb2ba-2a4f-498e-875c-4add46f84117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:39:09.999109 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc90124f-79b3-437b-bca6-dab30ad29ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:09.999930 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc90124f-79b3-437b-bca6-dab30ad29ff4 None admin] REQUEST_METHOD: `PUT` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:10.000282 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc90124f-79b3-437b-bca6-dab30ad29ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:10.000663 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc90124f-79b3-437b-bca6-dab30ad29ff4 None admin] PATH_INFO: `/v3/domains/default/users/6d735c10f69940bfb89355f7b5643d4e/roles/d6e7421d1ff9451c808004b818354550` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:10.002999 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc90124f-79b3-437b-bca6-dab30ad29ff4 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=6d735c10f69940bfb89355f7b5643d4e, role_id=d6e7421d1ff9451c808004b818354550)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:10.004640 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc90124f-79b3-437b-bca6-dab30ad29ff4 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:10.080714 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 21/41] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:39:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 11:39:10.080714 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95deebea-35e1-449b-a5e3-6ecca8144280 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:10.080714 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95deebea-35e1-449b-a5e3-6ecca8144280 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:10.080714 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95deebea-35e1-449b-a5e3-6ecca8144280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:10.091002 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 21/42] 10.222.0.59 () {58 vars in 1361 bytes} [Tue Oct 4 11:39:09 2022] PUT /identity/v3/domains/default/users/6d735c10f69940bfb89355f7b5643d4e/roles/d6e7421d1ff9451c808004b818354550 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 11:39:10.106361 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-95deebea-35e1-449b-a5e3-6ecca8144280 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:39:10.107727 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-95deebea-35e1-449b-a5e3-6ecca8144280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:39:10.174707 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:10.197680 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 22/43] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:39:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 11:39:10.355620 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc90124f-79b3-437b-bca6-dab30ad29ff4 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:10.412954 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:10.456317 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc90124f-79b3-437b-bca6-dab30ad29ff4 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:10.476854 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95deebea-35e1-449b-a5e3-6ecca8144280 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:10.504761 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7d5412-f056-4652-b06a-34ec837a9882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:10.505732 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7d5412-f056-4652-b06a-34ec837a9882 None admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:10.506177 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7d5412-f056-4652-b06a-34ec837a9882 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:10.506622 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7d5412-f056-4652-b06a-34ec837a9882 None admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:10.507578 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7d5412-f056-4652-b06a-34ec837a9882 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:10.509327 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7d5412-f056-4652-b06a-34ec837a9882 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:10.587435 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 22/44] 10.222.0.59 () {60 vars in 1131 bytes} [Tue Oct 4 11:39:10 2022] POST /identity/v3/roles => generated 223 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 11:39:10.590375 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95deebea-35e1-449b-a5e3-6ecca8144280 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:10.632175 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ba4f1d-0f3a-4515-bf43-00d947794719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:10.632846 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ba4f1d-0f3a-4515-bf43-00d947794719 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:10.633122 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ba4f1d-0f3a-4515-bf43-00d947794719 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:10.633433 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ba4f1d-0f3a-4515-bf43-00d947794719 None admin] PATH_INFO: `/v3/domains/default` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:10.634677 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ba4f1d-0f3a-4515-bf43-00d947794719 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:10.636483 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ba4f1d-0f3a-4515-bf43-00d947794719 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:10.638245 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 23/45] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Oct 4 11:39:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 11:39:10.644298 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7d5412-f056-4652-b06a-34ec837a9882 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:10.756670 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7d5412-f056-4652-b06a-34ec837a9882 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:10.776831 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:10.795264 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3418ebe4-4c20-4d1f-9f5d-693fda4bfa84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:10.795892 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3418ebe4-4c20-4d1f-9f5d-693fda4bfa84 None admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:10.796173 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3418ebe4-4c20-4d1f-9f5d-693fda4bfa84 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:10.796534 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3418ebe4-4c20-4d1f-9f5d-693fda4bfa84 None admin] PATH_INFO: `/v3/projects` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:10.797192 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3418ebe4-4c20-4d1f-9f5d-693fda4bfa84 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:10.798661 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3418ebe4-4c20-4d1f-9f5d-693fda4bfa84 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:10.895257 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 23/46] 10.222.0.59 () {60 vars in 1141 bytes} [Tue Oct 4 11:39:10 2022] POST /identity/v3/projects => generated 312 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 11:39:12.269024 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9391e89a-0c7a-4ffe-a31c-499822a81915 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:12.269537 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9391e89a-0c7a-4ffe-a31c-499822a81915 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:12.269620 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9391e89a-0c7a-4ffe-a31c-499822a81915 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:12.271069 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 24/47] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:39:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:39:12.276717 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402d583e-aaeb-410d-b179-29092aad65a6 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:12.277099 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402d583e-aaeb-410d-b179-29092aad65a6 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:12.277272 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402d583e-aaeb-410d-b179-29092aad65a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:12.295197 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-402d583e-aaeb-410d-b179-29092aad65a6 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:39:12.296710 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-402d583e-aaeb-410d-b179-29092aad65a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:39:12.361051 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 24/48] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:39:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 11:39:12.624371 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9391e89a-0c7a-4ffe-a31c-499822a81915 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:12.682878 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:12.729437 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9391e89a-0c7a-4ffe-a31c-499822a81915 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:12.763841 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b239224-27a2-460a-aa82-97af8a638d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:12.764469 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b239224-27a2-460a-aa82-97af8a638d3f None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:12.764781 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b239224-27a2-460a-aa82-97af8a638d3f None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:12.765062 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b239224-27a2-460a-aa82-97af8a638d3f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:12.775222 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b239224-27a2-460a-aa82-97af8a638d3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 11:39:12.780445 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-2b239224-27a2-460a-aa82-97af8a638d3f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 11:39:12.780445 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:39:12.780445 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:39:12.780445 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:39:12.780445 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:39:12.780445 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:39:12.780445 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:39:12.780445 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:39:12.780445 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:39:12.780445 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:39:12.780445 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:39:12.780445 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:39:12.780445 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 11:39:12.780445 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 11:39:12.780445 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 11:39:12.780445 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 11:39:12.781343 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 11:39:12.781343 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 11:39:12.781343 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 11:39:12.781343 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 11:39:12.781343 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:39:12.781343 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:39:12.781343 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:39:12.781343 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:39:12.781343 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:39:12.781343 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:39:12.781343 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:39:12.781343 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:39:12.781343 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:39:12.781343 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:39:12.781343 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:39:12.781343 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:39:12.782129 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:39:12.782129 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:39:12.782129 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:39:12.782129 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:39:12.782129 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 11:39:12.782129 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 11:39:12.782129 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 11:39:12.782129 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 11:39:12.782129 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 11:39:12.782129 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 11:39:12.782129 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 11:39:12.782129 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:39:12.782129 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 25/49] 10.222.0.59 () {56 vars in 1096 bytes} [Tue Oct 4 11:39:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:39:12.787348 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402d583e-aaeb-410d-b179-29092aad65a6 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:12.879767 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:12.884328 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402d583e-aaeb-410d-b179-29092aad65a6 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:12.918177 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f602840-fe77-4215-980a-3b8c95ec53e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:12.918789 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f602840-fe77-4215-980a-3b8c95ec53e6 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:12.919073 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f602840-fe77-4215-980a-3b8c95ec53e6 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:12.919350 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f602840-fe77-4215-980a-3b8c95ec53e6 None admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:12.920015 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f602840-fe77-4215-980a-3b8c95ec53e6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:39:12.920320 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f602840-fe77-4215-980a-3b8c95ec53e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:12.921752 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f602840-fe77-4215-980a-3b8c95ec53e6 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:12.930578 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 25/50] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Oct 4 11:39:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:39:12.936297 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b239224-27a2-460a-aa82-97af8a638d3f None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:13.046539 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b239224-27a2-460a-aa82-97af8a638d3f None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:13.061041 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:13.064937 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb51d80-0ffc-4700-bced-3746a8c7e12b None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:13.065232 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb51d80-0ffc-4700-bced-3746a8c7e12b None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:13.065518 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb51d80-0ffc-4700-bced-3746a8c7e12b None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:13.066869 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 26/51] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:39:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 11:39:13.072329 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d167b3c5-4507-4dfc-b519-8a7aaed0dd7d None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:13.075903 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d167b3c5-4507-4dfc-b519-8a7aaed0dd7d None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:13.075903 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d167b3c5-4507-4dfc-b519-8a7aaed0dd7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:13.081652 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f9a9e8-13a4-453e-a764-6e2f7abb0fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:13.082282 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f9a9e8-13a4-453e-a764-6e2f7abb0fc1 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:13.082566 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f9a9e8-13a4-453e-a764-6e2f7abb0fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:13.082840 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f9a9e8-13a4-453e-a764-6e2f7abb0fc1 None admin] PATH_INFO: `/v3/users/6d735c10f69940bfb89355f7b5643d4e` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:13.084014 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f9a9e8-13a4-453e-a764-6e2f7abb0fc1 None admin] RBAC: Authorizing `identity:get_user(user_id=6d735c10f69940bfb89355f7b5643d4e)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:13.085540 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f9a9e8-13a4-453e-a764-6e2f7abb0fc1 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:13.087664 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 26/52] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Oct 4 11:39:12 2022] GET /identity/v3/users/6d735c10f69940bfb89355f7b5643d4e => generated 247 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:39:13.091078 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-d167b3c5-4507-4dfc-b519-8a7aaed0dd7d None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:39:13.092285 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-d167b3c5-4507-4dfc-b519-8a7aaed0dd7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:39:13.092981 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f9a9e8-13a4-453e-a764-6e2f7abb0fc1 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:13.159836 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 27/53] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:39:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 11:39:13.206025 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f9a9e8-13a4-453e-a764-6e2f7abb0fc1 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:13.238869 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936e0ddf-4485-4a86-a2e2-93ab2499a071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:13.239493 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936e0ddf-4485-4a86-a2e2-93ab2499a071 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:13.239771 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936e0ddf-4485-4a86-a2e2-93ab2499a071 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:13.240040 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936e0ddf-4485-4a86-a2e2-93ab2499a071 None admin] PATH_INFO: `/v3/domains/default` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:13.241153 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936e0ddf-4485-4a86-a2e2-93ab2499a071 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:13.243250 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936e0ddf-4485-4a86-a2e2-93ab2499a071 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:13.244832 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 27/54] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Oct 4 11:39:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 11:39:13.250549 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d167b3c5-4507-4dfc-b519-8a7aaed0dd7d None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:13.437049 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936e0ddf-4485-4a86-a2e2-93ab2499a071 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:13.442423 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:13.452705 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d167b3c5-4507-4dfc-b519-8a7aaed0dd7d None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:13.485940 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a7a612-cc45-4a27-b5ca-54c8e9f586ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:13.486545 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a7a612-cc45-4a27-b5ca-54c8e9f586ff None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:13.486830 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a7a612-cc45-4a27-b5ca-54c8e9f586ff None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:13.487114 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a7a612-cc45-4a27-b5ca-54c8e9f586ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:13.487839 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a7a612-cc45-4a27-b5ca-54c8e9f586ff None admin] RBAC: Adding query filter params (role.id=d6e7421d1ff9451c808004b818354550, scope.domain.id=default, user.id=6d735c10f69940bfb89355f7b5643d4e) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:39:13.488150 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a7a612-cc45-4a27-b5ca-54c8e9f586ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:13.488413 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:13.489622 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a7a612-cc45-4a27-b5ca-54c8e9f586ff None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:13.495944 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 28/55] 10.222.0.59 () {56 vars in 1322 bytes} [Tue Oct 4 11:39:13 2022] GET /identity/v3/role_assignments?user.id=6d735c10f69940bfb89355f7b5643d4e&scope.domain.id=default&role.id=d6e7421d1ff9451c808004b818354550 => generated 530 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:39:13.545435 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936e0ddf-4485-4a86-a2e2-93ab2499a071 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:13.583850 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0164c72-43dd-4c90-949c-8434e25eedee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:13.584490 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0164c72-43dd-4c90-949c-8434e25eedee None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:13.584796 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0164c72-43dd-4c90-949c-8434e25eedee None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:13.585070 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0164c72-43dd-4c90-949c-8434e25eedee None admin] PATH_INFO: `/v3/domains/default` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:13.586412 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0164c72-43dd-4c90-949c-8434e25eedee None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:13.587893 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0164c72-43dd-4c90-949c-8434e25eedee None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:13.589528 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 28/56] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Oct 4 11:39:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 11:39:13.595316 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a7a612-cc45-4a27-b5ca-54c8e9f586ff None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:13.700135 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a7a612-cc45-4a27-b5ca-54c8e9f586ff None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:13.734168 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee8ca92-c6ba-40b8-9999-97efc083c15f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:13.734788 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee8ca92-c6ba-40b8-9999-97efc083c15f None admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:13.735074 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee8ca92-c6ba-40b8-9999-97efc083c15f None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:13.735350 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee8ca92-c6ba-40b8-9999-97efc083c15f None admin] PATH_INFO: `/v3/projects` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:13.736014 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee8ca92-c6ba-40b8-9999-97efc083c15f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:13.737496 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee8ca92-c6ba-40b8-9999-97efc083c15f None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:13.869860 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 29/57] 10.222.0.59 () {60 vars in 1140 bytes} [Tue Oct 4 11:39:13 2022] POST /identity/v3/projects => generated 298 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 11:39:16.052003 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4322de3-2e47-45fa-bc97-77a152ed02b6 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:16.052545 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4322de3-2e47-45fa-bc97-77a152ed02b6 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:16.052545 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4322de3-2e47-45fa-bc97-77a152ed02b6 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:16.053956 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 29/58] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:39:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:39:16.059390 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a161399a-7f51-465d-bfa1-c209b9240222 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:16.059796 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a161399a-7f51-465d-bfa1-c209b9240222 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:16.059950 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a161399a-7f51-465d-bfa1-c209b9240222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:16.073047 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:16.078919 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-a161399a-7f51-465d-bfa1-c209b9240222 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:39:16.080109 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-a161399a-7f51-465d-bfa1-c209b9240222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:39:16.145330 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 30/59] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:39:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 11:39:16.440120 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4322de3-2e47-45fa-bc97-77a152ed02b6 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:16.550494 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4322de3-2e47-45fa-bc97-77a152ed02b6 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:16.569037 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:16.587194 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0358191-e66c-4ca1-bc5f-af0e1b014bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:16.587821 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0358191-e66c-4ca1-bc5f-af0e1b014bf2 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:16.588106 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0358191-e66c-4ca1-bc5f-af0e1b014bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:16.588381 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0358191-e66c-4ca1-bc5f-af0e1b014bf2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:16.589513 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0358191-e66c-4ca1-bc5f-af0e1b014bf2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:16.590967 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0358191-e66c-4ca1-bc5f-af0e1b014bf2 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:16.592507 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 30/60] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Oct 4 11:39:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 11:39:16.598217 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a161399a-7f51-465d-bfa1-c209b9240222 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:16.693253 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a161399a-7f51-465d-bfa1-c209b9240222 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:16.726755 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704f7e93-b502-494e-9f60-75535f02a229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:16.727355 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704f7e93-b502-494e-9f60-75535f02a229 None admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:16.727639 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704f7e93-b502-494e-9f60-75535f02a229 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:16.727916 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704f7e93-b502-494e-9f60-75535f02a229 None admin] PATH_INFO: `/v3/users` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:16.728579 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704f7e93-b502-494e-9f60-75535f02a229 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:16.730034 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704f7e93-b502-494e-9f60-75535f02a229 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:16.742117 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:16.842260 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 31/61] 10.222.0.59 () {60 vars in 1132 bytes} [Tue Oct 4 11:39:16 2022] POST /identity/v3/users => generated 275 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 11:39:20.085529 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bf41f8-41cf-42a7-b8d7-4793b318b624 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:20.086708 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bf41f8-41cf-42a7-b8d7-4793b318b624 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:20.086708 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bf41f8-41cf-42a7-b8d7-4793b318b624 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:20.087539 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 31/62] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:39:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:39:20.096976 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b8a6d7-0426-4b69-9258-db4d929ca37a None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:20.097390 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b8a6d7-0426-4b69-9258-db4d929ca37a None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:20.097538 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b8a6d7-0426-4b69-9258-db4d929ca37a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:20.125646 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-12b8a6d7-0426-4b69-9258-db4d929ca37a None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:39:20.126849 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-12b8a6d7-0426-4b69-9258-db4d929ca37a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:39:20.221182 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 32/63] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:39:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 11:39:20.367059 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675bbb7d-a952-4779-82b4-c720c1d5f095 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:20.367677 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675bbb7d-a952-4779-82b4-c720c1d5f095 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:20.368162 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675bbb7d-a952-4779-82b4-c720c1d5f095 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:20.369770 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 32/64] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:39:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:39:20.371670 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d25d03-934e-486c-93bc-1b6533afc2de None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:20.371962 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d25d03-934e-486c-93bc-1b6533afc2de None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:20.372237 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d25d03-934e-486c-93bc-1b6533afc2de None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:20.373584 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 33/65] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:39:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:39:20.375781 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e06ece-3b86-4fca-8538-d709716dcab9 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:20.376072 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e06ece-3b86-4fca-8538-d709716dcab9 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:20.376359 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e06ece-3b86-4fca-8538-d709716dcab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:20.378629 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcc9904-0746-448e-b1a1-91843d823146 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:20.379127 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcc9904-0746-448e-b1a1-91843d823146 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:20.379600 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcc9904-0746-448e-b1a1-91843d823146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:20.405759 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-66e06ece-3b86-4fca-8538-d709716dcab9 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:39:20.409384 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-66e06ece-3b86-4fca-8538-d709716dcab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:39:20.412440 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-dfcc9904-0746-448e-b1a1-91843d823146 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:39:20.413890 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-dfcc9904-0746-448e-b1a1-91843d823146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:39:20.526494 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 34/66] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:39:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 11:39:20.531166 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 33/67] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:39:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 11:39:20.610390 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcc9904-0746-448e-b1a1-91843d823146 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:20.688324 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:20.752980 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcc9904-0746-448e-b1a1-91843d823146 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:20.807280 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b01f6d8-24c4-47cf-b64e-161aec0a0597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:20.807931 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b01f6d8-24c4-47cf-b64e-161aec0a0597 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:20.808218 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b01f6d8-24c4-47cf-b64e-161aec0a0597 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:20.808496 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b01f6d8-24c4-47cf-b64e-161aec0a0597 None admin] PATH_INFO: `/v3/roles/member` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:20.810416 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8bda4e-0662-40f7-85bf-29fdd8b5ab78 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:20.810920 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8bda4e-0662-40f7-85bf-29fdd8b5ab78 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:20.811400 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8bda4e-0662-40f7-85bf-29fdd8b5ab78 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:20.812958 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 34/68] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:39:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:39:20.818416 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d1c24d-c7cb-4283-a718-c0df116ac083 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:20.818944 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d1c24d-c7cb-4283-a718-c0df116ac083 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:20.819453 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d1c24d-c7cb-4283-a718-c0df116ac083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:20.825628 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b01f6d8-24c4-47cf-b64e-161aec0a0597 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 11:39:20.830714 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-8b01f6d8-24c4-47cf-b64e-161aec0a0597 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 11:39:20.830714 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:39:20.830714 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:39:20.830714 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:39:20.830714 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:39:20.830714 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:39:20.830714 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:39:20.830714 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:39:20.830714 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:39:20.830714 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:39:20.830714 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:39:20.830714 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:39:20.830714 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 11:39:20.830714 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 11:39:20.830714 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 11:39:20.830714 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 11:39:20.831673 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 11:39:20.831673 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 11:39:20.831673 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 11:39:20.831673 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 11:39:20.831673 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:39:20.831673 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:39:20.831673 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:39:20.831673 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:39:20.831673 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:39:20.831673 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:39:20.831673 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:39:20.831673 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:39:20.831673 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:39:20.831673 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:39:20.831673 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:39:20.831673 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:39:20.833090 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:39:20.833090 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:39:20.833090 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:39:20.833090 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:39:20.833090 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 11:39:20.833090 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 11:39:20.833090 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 11:39:20.833090 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 11:39:20.833090 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 11:39:20.833090 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 11:39:20.833090 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 11:39:20.833090 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:39:20.833090 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 35/69] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Oct 4 11:39:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:39:20.838231 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b01f6d8-24c4-47cf-b64e-161aec0a0597 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:20.844013 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-e5d1c24d-c7cb-4283-a718-c0df116ac083 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:39:20.845641 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-e5d1c24d-c7cb-4283-a718-c0df116ac083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:39:20.936737 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 35/70] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:39:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 11:39:20.938006 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d1c24d-c7cb-4283-a718-c0df116ac083 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:20.973577 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b01f6d8-24c4-47cf-b64e-161aec0a0597 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:20.988956 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:21.003058 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:21.011594 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2afc3df-a38f-47d5-9677-7187aed4bd88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:21.012208 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2afc3df-a38f-47d5-9677-7187aed4bd88 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:21.012491 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2afc3df-a38f-47d5-9677-7187aed4bd88 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:21.012805 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2afc3df-a38f-47d5-9677-7187aed4bd88 None admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:21.013468 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2afc3df-a38f-47d5-9677-7187aed4bd88 None admin] RBAC: Adding query filter params (name=member) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:39:21.013773 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2afc3df-a38f-47d5-9677-7187aed4bd88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:21.015150 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2afc3df-a38f-47d5-9677-7187aed4bd88 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:21.023830 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 36/71] 10.222.0.59 () {56 vars in 1101 bytes} [Tue Oct 4 11:39:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 11:39:21.024854 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2afc3df-a38f-47d5-9677-7187aed4bd88 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:21.064503 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d1c24d-c7cb-4283-a718-c0df116ac083 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:21.100339 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a2a8ff-1198-4cb3-acbc-43256d086e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:21.101595 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a2a8ff-1198-4cb3-acbc-43256d086e9b None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:21.101828 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a2a8ff-1198-4cb3-acbc-43256d086e9b None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:21.102106 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a2a8ff-1198-4cb3-acbc-43256d086e9b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:21.112247 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a2a8ff-1198-4cb3-acbc-43256d086e9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 11:39:21.117533 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-90a2a8ff-1198-4cb3-acbc-43256d086e9b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 11:39:21.117533 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:39:21.117533 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:39:21.117533 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:39:21.117533 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:39:21.117533 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:39:21.117533 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:39:21.117533 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:39:21.117533 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:39:21.117533 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:39:21.117533 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:39:21.117533 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:39:21.117533 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 11:39:21.117533 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 11:39:21.117533 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 11:39:21.117533 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 11:39:21.118400 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 11:39:21.118400 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 11:39:21.118400 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 11:39:21.118400 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 11:39:21.118400 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:39:21.118400 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:39:21.118400 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:39:21.118400 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:39:21.118400 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:39:21.118400 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:39:21.118400 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:39:21.118400 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:39:21.118400 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:39:21.118400 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:39:21.118400 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:39:21.118400 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:39:21.119180 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:39:21.119180 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:39:21.119180 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:39:21.119180 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:39:21.119180 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 11:39:21.119180 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 11:39:21.119180 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 11:39:21.119180 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 11:39:21.119180 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 11:39:21.119180 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 11:39:21.119180 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 11:39:21.119180 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:39:21.119180 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 36/72] 10.222.0.59 () {56 vars in 1096 bytes} [Tue Oct 4 11:39:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:39:21.120798 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349232f8-d545-4036-8b7d-7e8ed3344380 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:21.120798 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349232f8-d545-4036-8b7d-7e8ed3344380 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:21.120798 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349232f8-d545-4036-8b7d-7e8ed3344380 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:21.121675 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 37/73] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:39:21 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:39:21.122194 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349232f8-d545-4036-8b7d-7e8ed3344380 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:21.137408 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2afc3df-a38f-47d5-9677-7187aed4bd88 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:21.173685 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8a45e3-8047-493a-a485-334948850609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:21.174545 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8a45e3-8047-493a-a485-334948850609 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:21.174818 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8a45e3-8047-493a-a485-334948850609 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:21.175095 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8a45e3-8047-493a-a485-334948850609 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:21.185797 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8a45e3-8047-493a-a485-334948850609 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 11:39:21.191009 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-2e8a45e3-8047-493a-a485-334948850609 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 11:39:21.191009 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:39:21.191009 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:39:21.191009 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:39:21.191009 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:39:21.191009 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:39:21.191009 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:39:21.191009 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:39:21.191009 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:39:21.191009 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:39:21.191009 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:39:21.191009 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:39:21.191009 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 11:39:21.191009 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 11:39:21.191009 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 11:39:21.191009 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 11:39:21.191917 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 11:39:21.191917 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 11:39:21.191917 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 11:39:21.191917 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 11:39:21.191917 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:39:21.191917 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:39:21.191917 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:39:21.191917 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:39:21.191917 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:39:21.191917 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:39:21.191917 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:39:21.191917 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:39:21.191917 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:39:21.191917 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:39:21.191917 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:39:21.191917 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:39:21.193125 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:39:21.193125 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:39:21.193125 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:39:21.193125 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:39:21.193125 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 11:39:21.193125 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 11:39:21.193125 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 11:39:21.193125 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 11:39:21.193125 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 11:39:21.193125 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 11:39:21.193125 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 11:39:21.193125 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:39:21.193125 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 37/74] 10.222.0.59 () {56 vars in 1114 bytes} [Tue Oct 4 11:39:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:39:21.193125 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8a45e3-8047-493a-a485-334948850609 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:21.229430 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:21.236697 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349232f8-d545-4036-8b7d-7e8ed3344380 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:21.244191 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:21.270516 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5355e21e-6cd6-46c9-ba97-bc2ec129d17b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:21.271142 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5355e21e-6cd6-46c9-ba97-bc2ec129d17b None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:21.271444 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5355e21e-6cd6-46c9-ba97-bc2ec129d17b None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:21.271748 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5355e21e-6cd6-46c9-ba97-bc2ec129d17b None admin] PATH_INFO: `/v3/users/47abe7c6472d45e6b9c35ceab8d4ffc5` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:21.285385 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5355e21e-6cd6-46c9-ba97-bc2ec129d17b None admin] RBAC: Authorizing `identity:get_user(user_id=47abe7c6472d45e6b9c35ceab8d4ffc5)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:21.286968 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5355e21e-6cd6-46c9-ba97-bc2ec129d17b None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:21.288586 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 38/75] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Oct 4 11:39:21 2022] GET /identity/v3/users/47abe7c6472d45e6b9c35ceab8d4ffc5 => generated 275 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:39:21.293305 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1e80b1-f125-4fd6-8e55-9af98e02eab2 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:21.293305 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1e80b1-f125-4fd6-8e55-9af98e02eab2 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:21.293305 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1e80b1-f125-4fd6-8e55-9af98e02eab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:21.296661 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8a45e3-8047-493a-a485-334948850609 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:21.308983 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-2a1e80b1-f125-4fd6-8e55-9af98e02eab2 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:39:21.310144 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-2a1e80b1-f125-4fd6-8e55-9af98e02eab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:39:21.330726 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eda7e0-2b78-409f-9c68-0bace6930399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:21.331366 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eda7e0-2b78-409f-9c68-0bace6930399 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:21.331650 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eda7e0-2b78-409f-9c68-0bace6930399 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:21.331928 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eda7e0-2b78-409f-9c68-0bace6930399 None admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:21.332587 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6eda7e0-2b78-409f-9c68-0bace6930399 None admin] RBAC: Adding query filter params (name=admin) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:39:21.332927 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6eda7e0-2b78-409f-9c68-0bace6930399 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:21.334379 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6eda7e0-2b78-409f-9c68-0bace6930399 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:21.342588 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 38/76] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Oct 4 11:39:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:39:21.343610 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eda7e0-2b78-409f-9c68-0bace6930399 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:21.376908 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 39/77] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:39:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 11:39:21.381493 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1e80b1-f125-4fd6-8e55-9af98e02eab2 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:21.443057 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:21.449166 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eda7e0-2b78-409f-9c68-0bace6930399 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:21.483179 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:21.486329 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2536f3-198c-41e7-a2a1-974ae8153569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:21.487042 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2536f3-198c-41e7-a2a1-974ae8153569 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:21.487326 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2536f3-198c-41e7-a2a1-974ae8153569 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:21.487599 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2536f3-198c-41e7-a2a1-974ae8153569 None admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:21.488255 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2536f3-198c-41e7-a2a1-974ae8153569 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:39:21.488580 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2536f3-198c-41e7-a2a1-974ae8153569 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:21.489683 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1e80b1-f125-4fd6-8e55-9af98e02eab2 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:21.489941 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2536f3-198c-41e7-a2a1-974ae8153569 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:21.503726 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 39/78] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Oct 4 11:39:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:39:21.503726 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2536f3-198c-41e7-a2a1-974ae8153569 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:21.535101 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00df88a6-a9c0-44fc-ba6f-5b4dfc917aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:21.535742 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00df88a6-a9c0-44fc-ba6f-5b4dfc917aa5 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:21.536030 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00df88a6-a9c0-44fc-ba6f-5b4dfc917aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:21.536309 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00df88a6-a9c0-44fc-ba6f-5b4dfc917aa5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:21.546923 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00df88a6-a9c0-44fc-ba6f-5b4dfc917aa5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 11:39:21.551699 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-00df88a6-a9c0-44fc-ba6f-5b4dfc917aa5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 11:39:21.551699 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:39:21.551699 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:39:21.551699 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:39:21.551699 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:39:21.551699 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:39:21.551699 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:39:21.551699 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:39:21.551699 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:39:21.551699 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:39:21.551699 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:39:21.551699 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:39:21.551699 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 11:39:21.551699 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 11:39:21.551699 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 11:39:21.551699 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 11:39:21.552551 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 11:39:21.552551 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 11:39:21.552551 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 11:39:21.552551 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 11:39:21.552551 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:39:21.552551 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:39:21.552551 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:39:21.552551 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:39:21.552551 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:39:21.552551 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:39:21.552551 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:39:21.552551 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:39:21.552551 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:39:21.552551 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:39:21.552551 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:39:21.552551 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:39:21.553342 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:39:21.553342 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:39:21.553342 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:39:21.553342 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:39:21.553342 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 11:39:21.553342 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 11:39:21.553342 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 11:39:21.553342 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 11:39:21.553342 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 11:39:21.553342 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 11:39:21.553342 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 11:39:21.553342 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:39:21.553342 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 40/79] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Oct 4 11:39:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:39:21.555042 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00df88a6-a9c0-44fc-ba6f-5b4dfc917aa5 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:21.610673 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2536f3-198c-41e7-a2a1-974ae8153569 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:21.646406 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94104bbf-0e77-4a2b-80c8-b459d9919226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:21.647022 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94104bbf-0e77-4a2b-80c8-b459d9919226 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:21.647309 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94104bbf-0e77-4a2b-80c8-b459d9919226 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:21.648258 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94104bbf-0e77-4a2b-80c8-b459d9919226 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:21.664435 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00df88a6-a9c0-44fc-ba6f-5b4dfc917aa5 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:21.675121 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:21.699553 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccb40f1-583e-498e-a4d0-130a10f1488d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:21.700188 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccb40f1-583e-498e-a4d0-130a10f1488d None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:21.700472 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccb40f1-583e-498e-a4d0-130a10f1488d None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:21.700791 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccb40f1-583e-498e-a4d0-130a10f1488d None admin] PATH_INFO: `/v3/users/6d735c10f69940bfb89355f7b5643d4e` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:21.701933 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccb40f1-583e-498e-a4d0-130a10f1488d None admin] RBAC: Authorizing `identity:get_user(user_id=6d735c10f69940bfb89355f7b5643d4e)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:21.703401 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccb40f1-583e-498e-a4d0-130a10f1488d None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:21.705222 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 41/80] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Oct 4 11:39:21 2022] GET /identity/v3/users/6d735c10f69940bfb89355f7b5643d4e => generated 247 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:39:21.710777 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccb40f1-583e-498e-a4d0-130a10f1488d None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:21.717254 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94104bbf-0e77-4a2b-80c8-b459d9919226 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:21.718711 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94104bbf-0e77-4a2b-80c8-b459d9919226 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:21.734948 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:21.810111 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccb40f1-583e-498e-a4d0-130a10f1488d None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:21.816553 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 40/81] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Oct 4 11:39:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 11:39:21.817470 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94104bbf-0e77-4a2b-80c8-b459d9919226 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:21.848286 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b392f1-62ae-407d-afcd-74f720dad433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:21.848947 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b392f1-62ae-407d-afcd-74f720dad433 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:21.849238 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b392f1-62ae-407d-afcd-74f720dad433 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:21.849513 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b392f1-62ae-407d-afcd-74f720dad433 None admin] PATH_INFO: `/v3/users/47abe7c6472d45e6b9c35ceab8d4ffc5` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:21.851342 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b392f1-62ae-407d-afcd-74f720dad433 None admin] RBAC: Authorizing `identity:get_user(user_id=47abe7c6472d45e6b9c35ceab8d4ffc5)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:21.852808 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b392f1-62ae-407d-afcd-74f720dad433 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:21.854361 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 42/82] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Oct 4 11:39:21 2022] GET /identity/v3/users/47abe7c6472d45e6b9c35ceab8d4ffc5 => generated 275 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:39:21.855115 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b392f1-62ae-407d-afcd-74f720dad433 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:21.878879 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:21.920909 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94104bbf-0e77-4a2b-80c8-b459d9919226 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:21.945277 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:21.954239 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b392f1-62ae-407d-afcd-74f720dad433 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:21.954634 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5082919-6217-43a9-bfff-b513d38b036d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:21.955241 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5082919-6217-43a9-bfff-b513d38b036d None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:21.955520 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5082919-6217-43a9-bfff-b513d38b036d None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:21.955792 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5082919-6217-43a9-bfff-b513d38b036d None admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:21.956452 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5082919-6217-43a9-bfff-b513d38b036d None admin] RBAC: Adding query filter params (name=member) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:39:21.956790 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5082919-6217-43a9-bfff-b513d38b036d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:21.958184 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5082919-6217-43a9-bfff-b513d38b036d None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:21.966691 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 41/83] 10.222.0.59 () {56 vars in 1101 bytes} [Tue Oct 4 11:39:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:39:21.967487 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5082919-6217-43a9-bfff-b513d38b036d None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:21.990327 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbbdd54-5ece-4f7b-bcf0-08e2704fad8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:21.990880 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbbdd54-5ece-4f7b-bcf0-08e2704fad8a None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:21.991226 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbbdd54-5ece-4f7b-bcf0-08e2704fad8a None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:21.991533 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbbdd54-5ece-4f7b-bcf0-08e2704fad8a None admin] PATH_INFO: `/v3/domains/default` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:21.992668 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbbdd54-5ece-4f7b-bcf0-08e2704fad8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:21.994121 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbbdd54-5ece-4f7b-bcf0-08e2704fad8a None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:21.995670 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 43/84] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Oct 4 11:39:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:39:21.996423 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbbdd54-5ece-4f7b-bcf0-08e2704fad8a None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:22.066410 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5082919-6217-43a9-bfff-b513d38b036d None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:22.087056 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:22.095953 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbbdd54-5ece-4f7b-bcf0-08e2704fad8a None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:22.101457 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f081b6-1732-4da7-840b-a13e14947f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:22.102072 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f081b6-1732-4da7-840b-a13e14947f2d None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:22.102357 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f081b6-1732-4da7-840b-a13e14947f2d None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:22.102635 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f081b6-1732-4da7-840b-a13e14947f2d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:22.129328 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f0ea70-53c5-4fcc-9990-4cb6c9e7fc88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:22.129958 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f0ea70-53c5-4fcc-9990-4cb6c9e7fc88 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:22.130237 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f0ea70-53c5-4fcc-9990-4cb6c9e7fc88 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:22.130514 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f0ea70-53c5-4fcc-9990-4cb6c9e7fc88 None admin] PATH_INFO: `/v3/projects/3cce5af9f73d46be89fb61b08e04e408` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:22.131625 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f0ea70-53c5-4fcc-9990-4cb6c9e7fc88 None admin] RBAC: Authorizing `identity:get_project(project_id=3cce5af9f73d46be89fb61b08e04e408)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:22.134079 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f0ea70-53c5-4fcc-9990-4cb6c9e7fc88 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:22.135723 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 44/85] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Oct 4 11:39:21 2022] GET /identity/v3/projects/3cce5af9f73d46be89fb61b08e04e408 => generated 298 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:39:22.136482 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f0ea70-53c5-4fcc-9990-4cb6c9e7fc88 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:22.166019 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:22.175204 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f081b6-1732-4da7-840b-a13e14947f2d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:22.176806 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f081b6-1732-4da7-840b-a13e14947f2d None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:22.235587 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f0ea70-53c5-4fcc-9990-4cb6c9e7fc88 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:22.268900 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eae292b-e269-46e2-8610-0230a01585da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:22.269436 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae292b-e269-46e2-8610-0230a01585da None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:22.269721 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae292b-e269-46e2-8610-0230a01585da None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:22.269998 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae292b-e269-46e2-8610-0230a01585da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:22.281064 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 42/86] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Oct 4 11:39:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 11:39:22.285488 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f081b6-1732-4da7-840b-a13e14947f2d None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:22.306950 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:22.339845 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eae292b-e269-46e2-8610-0230a01585da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:22.340942 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eae292b-e269-46e2-8610-0230a01585da None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:22.368340 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:22.385468 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f081b6-1732-4da7-840b-a13e14947f2d None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:22.419633 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8620876e-b140-4df5-a973-565495228740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:22.420269 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8620876e-b140-4df5-a973-565495228740 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:22.420549 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8620876e-b140-4df5-a973-565495228740 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:22.420850 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8620876e-b140-4df5-a973-565495228740 None admin] PATH_INFO: `/v3/users/47abe7c6472d45e6b9c35ceab8d4ffc5` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:22.421978 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8620876e-b140-4df5-a973-565495228740 None admin] RBAC: Authorizing `identity:get_user(user_id=47abe7c6472d45e6b9c35ceab8d4ffc5)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:22.423403 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8620876e-b140-4df5-a973-565495228740 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:22.425008 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 43/87] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Oct 4 11:39:22 2022] GET /identity/v3/users/47abe7c6472d45e6b9c35ceab8d4ffc5 => generated 275 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:39:22.429919 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8620876e-b140-4df5-a973-565495228740 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:22.442582 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 45/88] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Oct 4 11:39:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 11:39:22.443409 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eae292b-e269-46e2-8610-0230a01585da None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:22.521440 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:22.535592 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8620876e-b140-4df5-a973-565495228740 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:22.550429 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eae292b-e269-46e2-8610-0230a01585da None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:22.569984 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e9c5b9-d584-453d-90d1-c05cbe0d49d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:22.570669 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e9c5b9-d584-453d-90d1-c05cbe0d49d4 None admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:22.570947 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e9c5b9-d584-453d-90d1-c05cbe0d49d4 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:22.571222 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e9c5b9-d584-453d-90d1-c05cbe0d49d4 None admin] PATH_INFO: `/v3/users` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:22.571870 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e9c5b9-d584-453d-90d1-c05cbe0d49d4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:22.573335 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e9c5b9-d584-453d-90d1-c05cbe0d49d4 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:22.576131 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:22.584545 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a17ed1-f40b-450f-b4c3-24dd45ec2bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:22.585469 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a17ed1-f40b-450f-b4c3-24dd45ec2bc4 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:22.585469 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a17ed1-f40b-450f-b4c3-24dd45ec2bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:22.585757 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a17ed1-f40b-450f-b4c3-24dd45ec2bc4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:22.589641 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a17ed1-f40b-450f-b4c3-24dd45ec2bc4 None admin] RBAC: Adding query filter params (role.id=ab4307f3b7994c1c80036fa7db93b6b9, scope.project.id=3cce5af9f73d46be89fb61b08e04e408, user.id=47abe7c6472d45e6b9c35ceab8d4ffc5) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:39:22.589641 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a17ed1-f40b-450f-b4c3-24dd45ec2bc4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:22.589641 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a17ed1-f40b-450f-b4c3-24dd45ec2bc4 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:22.595029 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 46/89] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Oct 4 11:39:22 2022] GET /identity/v3/role_assignments?user.id=47abe7c6472d45e6b9c35ceab8d4ffc5&scope.project.id=3cce5af9f73d46be89fb61b08e04e408&role.id=ab4307f3b7994c1c80036fa7db93b6b9 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:39:22.595794 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a17ed1-f40b-450f-b4c3-24dd45ec2bc4 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:22.671770 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 44/90] 10.222.0.59 () {60 vars in 1132 bytes} [Tue Oct 4 11:39:22 2022] POST /identity/v3/users => generated 289 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 11:39:22.672461 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e9c5b9-d584-453d-90d1-c05cbe0d49d4 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:22.729015 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a17ed1-f40b-450f-b4c3-24dd45ec2bc4 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:22.778034 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57199c3d-cce6-407c-8c88-69bcec18d1cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:22.778601 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57199c3d-cce6-407c-8c88-69bcec18d1cb None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:22.778884 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57199c3d-cce6-407c-8c88-69bcec18d1cb None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:22.779160 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57199c3d-cce6-407c-8c88-69bcec18d1cb None admin] PATH_INFO: `/v3/projects/3cce5af9f73d46be89fb61b08e04e408` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:22.780420 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57199c3d-cce6-407c-8c88-69bcec18d1cb None admin] RBAC: Authorizing `identity:get_project(project_id=3cce5af9f73d46be89fb61b08e04e408)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:22.782092 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57199c3d-cce6-407c-8c88-69bcec18d1cb None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:22.783911 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 47/91] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Oct 4 11:39:22 2022] GET /identity/v3/projects/3cce5af9f73d46be89fb61b08e04e408 => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:39:22.784866 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57199c3d-cce6-407c-8c88-69bcec18d1cb None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:22.837578 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e9c5b9-d584-453d-90d1-c05cbe0d49d4 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:22.870162 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:22.881044 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cd9fec-7a22-4aa1-bfa1-bb1e53f19a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:22.882492 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cd9fec-7a22-4aa1-bfa1-bb1e53f19a53 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:22.887378 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cd9fec-7a22-4aa1-bfa1-bb1e53f19a53 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:22.887378 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cd9fec-7a22-4aa1-bfa1-bb1e53f19a53 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:22.900733 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:22.926541 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57199c3d-cce6-407c-8c88-69bcec18d1cb None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:22.971017 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688f7057-f32b-41a0-9dff-ad9bcedb1c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:22.971656 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688f7057-f32b-41a0-9dff-ad9bcedb1c99 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:22.972027 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688f7057-f32b-41a0-9dff-ad9bcedb1c99 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:22.972309 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688f7057-f32b-41a0-9dff-ad9bcedb1c99 None admin] PATH_INFO: `/v3/projects/3cce5af9f73d46be89fb61b08e04e408` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:22.973716 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688f7057-f32b-41a0-9dff-ad9bcedb1c99 None admin] RBAC: Authorizing `identity:get_project(project_id=3cce5af9f73d46be89fb61b08e04e408)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:22.973904 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cd9fec-7a22-4aa1-bfa1-bb1e53f19a53 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:22.975432 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688f7057-f32b-41a0-9dff-ad9bcedb1c99 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:22.975731 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cd9fec-7a22-4aa1-bfa1-bb1e53f19a53 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:22.977167 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 48/92] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Oct 4 11:39:22 2022] GET /identity/v3/projects/3cce5af9f73d46be89fb61b08e04e408 => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:39:22.978237 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688f7057-f32b-41a0-9dff-ad9bcedb1c99 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:23.105521 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 45/93] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Oct 4 11:39:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 11:39:23.106786 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cd9fec-7a22-4aa1-bfa1-bb1e53f19a53 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:23.111607 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688f7057-f32b-41a0-9dff-ad9bcedb1c99 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:23.139587 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:23.150332 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e71ee4-c5a6-43ab-ac5e-18436382be76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:23.154949 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e71ee4-c5a6-43ab-ac5e-18436382be76 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:23.154949 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e71ee4-c5a6-43ab-ac5e-18436382be76 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:23.154949 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e71ee4-c5a6-43ab-ac5e-18436382be76 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:23.154949 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e71ee4-c5a6-43ab-ac5e-18436382be76 None admin] RBAC: Adding query filter params (role.id=d6e7421d1ff9451c808004b818354550, scope.project.id=3cce5af9f73d46be89fb61b08e04e408, user.id=6d735c10f69940bfb89355f7b5643d4e) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:39:23.154949 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e71ee4-c5a6-43ab-ac5e-18436382be76 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:23.154949 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e71ee4-c5a6-43ab-ac5e-18436382be76 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:23.159783 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 49/94] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Oct 4 11:39:22 2022] GET /identity/v3/role_assignments?user.id=6d735c10f69940bfb89355f7b5643d4e&scope.project.id=3cce5af9f73d46be89fb61b08e04e408&role.id=d6e7421d1ff9451c808004b818354550 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:39:23.160672 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e71ee4-c5a6-43ab-ac5e-18436382be76 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:23.162308 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:23.225308 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cd9fec-7a22-4aa1-bfa1-bb1e53f19a53 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:23.262847 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de34bec-43c4-4f02-a535-a1125a15ba72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:23.263885 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de34bec-43c4-4f02-a535-a1125a15ba72 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:23.264398 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de34bec-43c4-4f02-a535-a1125a15ba72 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:23.264927 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de34bec-43c4-4f02-a535-a1125a15ba72 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:23.265909 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de34bec-43c4-4f02-a535-a1125a15ba72 None admin] RBAC: Adding query filter params (role.id=b6018afb40c74d19b8cadc402256f23d, scope.project.id=3cce5af9f73d46be89fb61b08e04e408, user.id=47abe7c6472d45e6b9c35ceab8d4ffc5) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:39:23.266427 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de34bec-43c4-4f02-a535-a1125a15ba72 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:23.268124 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de34bec-43c4-4f02-a535-a1125a15ba72 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:23.275225 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 46/95] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Oct 4 11:39:23 2022] GET /identity/v3/role_assignments?user.id=47abe7c6472d45e6b9c35ceab8d4ffc5&scope.project.id=3cce5af9f73d46be89fb61b08e04e408&role.id=b6018afb40c74d19b8cadc402256f23d => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:39:23.282274 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e71ee4-c5a6-43ab-ac5e-18436382be76 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:23.325587 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa52d81-f76c-4a04-9e9f-8400fe9cce43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:23.326243 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa52d81-f76c-4a04-9e9f-8400fe9cce43 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:23.326526 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa52d81-f76c-4a04-9e9f-8400fe9cce43 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:23.326803 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa52d81-f76c-4a04-9e9f-8400fe9cce43 None admin] PATH_INFO: `/v3/projects/a8ae92ad99594cf1b23c984f44ecbc47` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:23.328015 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa52d81-f76c-4a04-9e9f-8400fe9cce43 None admin] RBAC: Authorizing `identity:get_project(project_id=a8ae92ad99594cf1b23c984f44ecbc47)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:23.329550 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa52d81-f76c-4a04-9e9f-8400fe9cce43 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:23.331306 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 50/96] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Oct 4 11:39:23 2022] GET /identity/v3/projects/a8ae92ad99594cf1b23c984f44ecbc47 => generated 312 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:39:23.338341 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de34bec-43c4-4f02-a535-a1125a15ba72 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:23.486070 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de34bec-43c4-4f02-a535-a1125a15ba72 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:23.501391 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:23.538610 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56febcb6-9472-4c41-8ecb-709f097aa966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:23.538610 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56febcb6-9472-4c41-8ecb-709f097aa966 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:23.538610 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56febcb6-9472-4c41-8ecb-709f097aa966 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:23.538610 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56febcb6-9472-4c41-8ecb-709f097aa966 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:23.539123 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56febcb6-9472-4c41-8ecb-709f097aa966 None admin] RBAC: Adding query filter params (role.id=ab4307f3b7994c1c80036fa7db93b6b9, scope.project.id=a8ae92ad99594cf1b23c984f44ecbc47, user.id=47abe7c6472d45e6b9c35ceab8d4ffc5) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:39:23.539123 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56febcb6-9472-4c41-8ecb-709f097aa966 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:23.539123 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56febcb6-9472-4c41-8ecb-709f097aa966 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:23.550789 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 47/97] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Oct 4 11:39:23 2022] GET /identity/v3/role_assignments?user.id=47abe7c6472d45e6b9c35ceab8d4ffc5&scope.project.id=a8ae92ad99594cf1b23c984f44ecbc47&role.id=ab4307f3b7994c1c80036fa7db93b6b9 => generated 259 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:39:25.745173 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836144b6-3996-48cb-b30a-60271cba9620 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:25.746235 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836144b6-3996-48cb-b30a-60271cba9620 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:25.746777 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836144b6-3996-48cb-b30a-60271cba9620 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:25.748323 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 51/98] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:39:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:39:25.753575 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccd991c-043a-4684-a60e-7dece36ecca6 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:25.754373 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccd991c-043a-4684-a60e-7dece36ecca6 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:25.754856 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccd991c-043a-4684-a60e-7dece36ecca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:25.785690 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-bccd991c-043a-4684-a60e-7dece36ecca6 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:39:25.787215 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-bccd991c-043a-4684-a60e-7dece36ecca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:39:25.867645 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 48/99] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:39:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 11:39:26.159368 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e09ec0-ce1a-4a0c-a0a9-7662ed88d3e8 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:26.160012 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e09ec0-ce1a-4a0c-a0a9-7662ed88d3e8 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:26.160540 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e09ec0-ce1a-4a0c-a0a9-7662ed88d3e8 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:26.162279 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 52/100] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:39:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:39:26.169540 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535b7095-8300-4c4b-b231-5814784556a7 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:26.170090 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535b7095-8300-4c4b-b231-5814784556a7 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:26.170569 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535b7095-8300-4c4b-b231-5814784556a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:26.201629 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-535b7095-8300-4c4b-b231-5814784556a7 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:39:26.203264 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-535b7095-8300-4c4b-b231-5814784556a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:39:26.346456 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 49/101] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:39:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 11:39:26.462133 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e09ec0-ce1a-4a0c-a0a9-7662ed88d3e8 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:26.587692 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:26.602449 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b14d83b-0c54-4a21-822a-0e450fc73859 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:26.602753 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b14d83b-0c54-4a21-822a-0e450fc73859 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:26.603012 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b14d83b-0c54-4a21-822a-0e450fc73859 None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:26.604525 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 50/102] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:39:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:39:26.610226 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada65205-8141-486d-b431-1f1a126bdf24 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:26.610513 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada65205-8141-486d-b431-1f1a126bdf24 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:26.610794 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada65205-8141-486d-b431-1f1a126bdf24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:26.653094 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-ada65205-8141-486d-b431-1f1a126bdf24 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:39:26.655813 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-ada65205-8141-486d-b431-1f1a126bdf24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:39:26.677036 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e09ec0-ce1a-4a0c-a0a9-7662ed88d3e8 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:26.732540 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:26.739804 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a164051c-331f-4a4d-9e25-643b68e843b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:26.740443 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a164051c-331f-4a4d-9e25-643b68e843b3 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:26.740760 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a164051c-331f-4a4d-9e25-643b68e843b3 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:26.741957 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a164051c-331f-4a4d-9e25-643b68e843b3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:26.753619 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a164051c-331f-4a4d-9e25-643b68e843b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 11:39:26.761242 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-a164051c-331f-4a4d-9e25-643b68e843b3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 11:39:26.761242 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:39:26.761242 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:39:26.761242 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:39:26.761242 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:39:26.761242 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:39:26.761242 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:39:26.761242 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:39:26.761242 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:39:26.761242 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:39:26.761242 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:39:26.761242 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:39:26.761242 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 11:39:26.761242 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 11:39:26.761242 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 11:39:26.761242 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 11:39:26.762175 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 11:39:26.762175 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 11:39:26.762175 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 11:39:26.762175 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 11:39:26.762175 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:39:26.762175 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:39:26.762175 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:39:26.762175 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:39:26.762175 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:39:26.762175 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:39:26.762175 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:39:26.762175 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:39:26.762175 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:39:26.762175 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:39:26.762175 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:39:26.762175 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:39:26.762943 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:39:26.762943 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:39:26.762943 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:39:26.762943 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:39:26.762943 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 11:39:26.762943 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 11:39:26.762943 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 11:39:26.762943 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 11:39:26.762943 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 11:39:26.762943 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 11:39:26.762943 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 11:39:26.762943 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:39:26.763520 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 53/103] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Oct 4 11:39:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:39:26.765277 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18128af7-5ffe-47da-b282-d850db6ef419 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:26.765981 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18128af7-5ffe-47da-b282-d850db6ef419 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:26.766286 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18128af7-5ffe-47da-b282-d850db6ef419 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:26.772128 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 54/104] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:39:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:39:26.772128 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e672f79-dcd2-40b2-ae48-359b382e27ff None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:26.772359 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e672f79-dcd2-40b2-ae48-359b382e27ff None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:26.772548 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e672f79-dcd2-40b2-ae48-359b382e27ff None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:26.775567 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 55/105] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:39:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:39:26.781683 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e672f79-dcd2-40b2-ae48-359b382e27ff None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:26.801187 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 51/106] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:39:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 11:39:26.802655 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada65205-8141-486d-b431-1f1a126bdf24 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:26.925627 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada65205-8141-486d-b431-1f1a126bdf24 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:26.956726 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e672f79-dcd2-40b2-ae48-359b382e27ff None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:26.962405 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe9fb15-84d0-46b3-ae23-505d3d26d4b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:26.963019 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe9fb15-84d0-46b3-ae23-505d3d26d4b0 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:26.963301 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe9fb15-84d0-46b3-ae23-505d3d26d4b0 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:26.963571 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe9fb15-84d0-46b3-ae23-505d3d26d4b0 None admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:26.964231 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe9fb15-84d0-46b3-ae23-505d3d26d4b0 None admin] RBAC: Adding query filter params (name=member) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:39:26.964531 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe9fb15-84d0-46b3-ae23-505d3d26d4b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:26.965941 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe9fb15-84d0-46b3-ae23-505d3d26d4b0 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:26.974509 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 52/107] 10.222.0.59 () {56 vars in 1101 bytes} [Tue Oct 4 11:39:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:39:26.976662 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:26.978036 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af70ee9e-2ee2-48d3-8c86-68fd9bde5bb0 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:26.978325 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af70ee9e-2ee2-48d3-8c86-68fd9bde5bb0 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:26.978602 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af70ee9e-2ee2-48d3-8c86-68fd9bde5bb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:26.996574 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cae9da-766c-4e2d-ba77-46cae39cb574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:26.997157 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cae9da-766c-4e2d-ba77-46cae39cb574 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:26.997346 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-af70ee9e-2ee2-48d3-8c86-68fd9bde5bb0 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:39:26.997451 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cae9da-766c-4e2d-ba77-46cae39cb574 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:26.997699 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cae9da-766c-4e2d-ba77-46cae39cb574 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:26.998511 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-af70ee9e-2ee2-48d3-8c86-68fd9bde5bb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:39:27.008579 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cae9da-766c-4e2d-ba77-46cae39cb574 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 11:39:27.013346 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-e3cae9da-766c-4e2d-ba77-46cae39cb574 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 11:39:27.013346 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:39:27.013346 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:39:27.013346 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:39:27.013346 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:39:27.013346 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:39:27.013346 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:39:27.013346 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:39:27.013346 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:39:27.013346 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:39:27.013346 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:39:27.013346 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:39:27.013346 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 11:39:27.013346 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 11:39:27.013346 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 11:39:27.013346 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 11:39:27.014235 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 11:39:27.014235 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 11:39:27.014235 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 11:39:27.014235 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 11:39:27.014235 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:39:27.014235 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:39:27.014235 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:39:27.014235 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:39:27.014235 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:39:27.014235 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:39:27.014235 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:39:27.014235 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:39:27.014235 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:39:27.014235 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:39:27.014235 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:39:27.014235 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:39:27.015014 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:39:27.015014 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:39:27.015014 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:39:27.015014 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:39:27.015014 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 11:39:27.015014 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 11:39:27.015014 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 11:39:27.015014 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 11:39:27.015014 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 11:39:27.015014 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 11:39:27.015014 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 11:39:27.015014 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:39:27.015014 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 56/108] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Oct 4 11:39:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:39:27.015669 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa7ad89-3a82-4c2b-9135-818eb1391e11 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:27.016232 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa7ad89-3a82-4c2b-9135-818eb1391e11 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:27.016232 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa7ad89-3a82-4c2b-9135-818eb1391e11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:27.022643 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:27.034891 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-1fa7ad89-3a82-4c2b-9135-818eb1391e11 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:39:27.036149 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-1fa7ad89-3a82-4c2b-9135-818eb1391e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:39:27.080353 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 53/109] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:39:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 11:39:27.080353 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefb84b7-788e-42a6-aaeb-37300b543063 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:27.080353 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefb84b7-788e-42a6-aaeb-37300b543063 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:27.080353 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefb84b7-788e-42a6-aaeb-37300b543063 None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:27.080353 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 54/110] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:39:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:39:27.080353 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefb84b7-788e-42a6-aaeb-37300b543063 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:27.108673 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 57/111] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:39:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 11:39:27.109506 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa7ad89-3a82-4c2b-9135-818eb1391e11 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:27.206529 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefb84b7-788e-42a6-aaeb-37300b543063 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:27.214220 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa7ad89-3a82-4c2b-9135-818eb1391e11 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:27.224572 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:27.251700 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3127305b-7653-48e2-8c7e-289caae89852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:27.251893 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2864d5-e6a5-4e4e-b210-6e793ea5bd32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:27.252405 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2864d5-e6a5-4e4e-b210-6e793ea5bd32 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:27.252792 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2864d5-e6a5-4e4e-b210-6e793ea5bd32 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:27.252980 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3127305b-7653-48e2-8c7e-289caae89852 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:27.253082 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2864d5-e6a5-4e4e-b210-6e793ea5bd32 None admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:27.253491 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3127305b-7653-48e2-8c7e-289caae89852 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:27.253728 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2864d5-e6a5-4e4e-b210-6e793ea5bd32 None admin] RBAC: Adding query filter params (name=reader) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:39:27.254033 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3127305b-7653-48e2-8c7e-289caae89852 None admin] PATH_INFO: `/v3/users/47abe7c6472d45e6b9c35ceab8d4ffc5` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:27.254146 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2864d5-e6a5-4e4e-b210-6e793ea5bd32 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:27.255392 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3127305b-7653-48e2-8c7e-289caae89852 None admin] RBAC: Authorizing `identity:get_user(user_id=47abe7c6472d45e6b9c35ceab8d4ffc5)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:27.255509 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2864d5-e6a5-4e4e-b210-6e793ea5bd32 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:27.257986 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3127305b-7653-48e2-8c7e-289caae89852 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:27.260129 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 55/112] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Oct 4 11:39:27 2022] GET /identity/v3/users/47abe7c6472d45e6b9c35ceab8d4ffc5 => generated 275 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:39:27.266465 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3127305b-7653-48e2-8c7e-289caae89852 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:27.269215 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 58/113] 10.222.0.59 () {56 vars in 1101 bytes} [Tue Oct 4 11:39:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:39:27.270604 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf37a8d-593d-41df-b251-32087aaa8bb3 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:27.270891 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf37a8d-593d-41df-b251-32087aaa8bb3 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:27.271173 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf37a8d-593d-41df-b251-32087aaa8bb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:27.290792 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-eaf37a8d-593d-41df-b251-32087aaa8bb3 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:39:27.291981 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-eaf37a8d-593d-41df-b251-32087aaa8bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:39:27.296668 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:27.373005 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 59/114] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:39:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 11:39:27.373005 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf37a8d-593d-41df-b251-32087aaa8bb3 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:27.395094 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3127305b-7653-48e2-8c7e-289caae89852 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:27.434929 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4805598c-870c-4c65-adab-217de0653248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:27.435588 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4805598c-870c-4c65-adab-217de0653248 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:27.435853 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4805598c-870c-4c65-adab-217de0653248 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:27.436134 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4805598c-870c-4c65-adab-217de0653248 None admin] PATH_INFO: `/v3/domains/default` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:27.438532 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4805598c-870c-4c65-adab-217de0653248 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:27.439982 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4805598c-870c-4c65-adab-217de0653248 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:27.442057 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 56/115] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Oct 4 11:39:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:39:27.448170 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4805598c-870c-4c65-adab-217de0653248 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:27.494527 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:27.497866 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf37a8d-593d-41df-b251-32087aaa8bb3 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:27.541233 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e4163a-8228-461e-adac-45c5bb82f870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:27.541868 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e4163a-8228-461e-adac-45c5bb82f870 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:27.542155 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e4163a-8228-461e-adac-45c5bb82f870 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:27.542435 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e4163a-8228-461e-adac-45c5bb82f870 None admin] PATH_INFO: `/v3/projects/3cce5af9f73d46be89fb61b08e04e408` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:27.543560 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e4163a-8228-461e-adac-45c5bb82f870 None admin] RBAC: Authorizing `identity:get_project(project_id=3cce5af9f73d46be89fb61b08e04e408)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:27.545052 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e4163a-8228-461e-adac-45c5bb82f870 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:27.546684 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 60/116] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Oct 4 11:39:27 2022] GET /identity/v3/projects/3cce5af9f73d46be89fb61b08e04e408 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:39:27.547441 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e4163a-8228-461e-adac-45c5bb82f870 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:27.551886 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:27.561979 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4805598c-870c-4c65-adab-217de0653248 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:27.599754 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1e33fd-6db9-4ffb-bcab-ab885a06a003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:27.600825 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1e33fd-6db9-4ffb-bcab-ab885a06a003 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:27.601193 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1e33fd-6db9-4ffb-bcab-ab885a06a003 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:27.601475 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1e33fd-6db9-4ffb-bcab-ab885a06a003 None admin] PATH_INFO: `/v3/users/463ce5b316d942c6b709c01afe2fa163` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:27.618981 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1e33fd-6db9-4ffb-bcab-ab885a06a003 None admin] RBAC: Authorizing `identity:get_user(user_id=463ce5b316d942c6b709c01afe2fa163)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:27.620439 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1e33fd-6db9-4ffb-bcab-ab885a06a003 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:27.626665 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 57/117] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Oct 4 11:39:27 2022] GET /identity/v3/users/463ce5b316d942c6b709c01afe2fa163 => generated 289 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:39:27.626665 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1e33fd-6db9-4ffb-bcab-ab885a06a003 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:27.651411 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e4163a-8228-461e-adac-45c5bb82f870 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:27.685224 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb385588-4be4-474f-8a30-efcc78445068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:27.685845 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb385588-4be4-474f-8a30-efcc78445068 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:27.686181 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb385588-4be4-474f-8a30-efcc78445068 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:27.686467 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb385588-4be4-474f-8a30-efcc78445068 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:27.697081 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb385588-4be4-474f-8a30-efcc78445068 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 11:39:27.702697 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-bb385588-4be4-474f-8a30-efcc78445068 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 11:39:27.702697 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:39:27.702697 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:39:27.702697 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:39:27.702697 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:39:27.702697 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:39:27.702697 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:39:27.702697 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:39:27.702697 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:39:27.702697 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:39:27.702697 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:39:27.702697 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:39:27.702697 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 11:39:27.702697 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 11:39:27.702697 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 11:39:27.702697 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 11:39:27.703555 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 11:39:27.703555 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 11:39:27.703555 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 11:39:27.703555 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 11:39:27.703555 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:39:27.703555 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:39:27.703555 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:39:27.703555 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:39:27.703555 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:39:27.703555 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:39:27.703555 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:39:27.703555 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:39:27.703555 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:39:27.703555 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:39:27.703555 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:39:27.703555 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:39:27.704309 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:39:27.704309 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:39:27.704309 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:39:27.704309 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:39:27.704309 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 11:39:27.704309 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 11:39:27.704309 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 11:39:27.704309 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 11:39:27.704309 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 11:39:27.704309 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 11:39:27.704309 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 11:39:27.704309 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:39:27.704309 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 61/118] 10.222.0.59 () {56 vars in 1096 bytes} [Tue Oct 4 11:39:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:39:27.705832 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb385588-4be4-474f-8a30-efcc78445068 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:27.727829 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1e33fd-6db9-4ffb-bcab-ab885a06a003 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:27.734162 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:27.762421 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96345868-31a4-4f43-ab97-22f349d195bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:27.763167 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96345868-31a4-4f43-ab97-22f349d195bd None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:27.763457 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96345868-31a4-4f43-ab97-22f349d195bd None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:27.763734 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96345868-31a4-4f43-ab97-22f349d195bd None admin] PATH_INFO: `/v3/roles/member` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:27.773833 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96345868-31a4-4f43-ab97-22f349d195bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 11:39:27.778746 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-96345868-31a4-4f43-ab97-22f349d195bd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 11:39:27.778746 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:39:27.778746 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:39:27.778746 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:39:27.778746 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:39:27.778746 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:39:27.778746 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:39:27.778746 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:39:27.778746 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:39:27.778746 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:39:27.778746 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:39:27.778746 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:39:27.778746 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 11:39:27.778746 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 11:39:27.778746 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 11:39:27.778746 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 11:39:27.779599 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 11:39:27.779599 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 11:39:27.779599 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 11:39:27.779599 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 11:39:27.779599 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:39:27.779599 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:39:27.779599 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:39:27.779599 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:39:27.779599 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:39:27.779599 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:39:27.779599 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:39:27.779599 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:39:27.779599 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:39:27.779599 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:39:27.779599 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:39:27.779599 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:39:27.781308 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:39:27.781308 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:39:27.781308 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:39:27.781308 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:39:27.781308 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 11:39:27.781308 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 11:39:27.781308 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 11:39:27.781308 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 11:39:27.781308 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 11:39:27.781308 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 11:39:27.781308 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 11:39:27.781308 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:39:27.781308 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 58/119] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Oct 4 11:39:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:39:27.781308 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96345868-31a4-4f43-ab97-22f349d195bd None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:27.792352 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:27.807182 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb385588-4be4-474f-8a30-efcc78445068 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:27.841270 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5c3be1-c43d-4164-b998-b2ff1950bbbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:27.841872 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5c3be1-c43d-4164-b998-b2ff1950bbbd None admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:27.842151 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5c3be1-c43d-4164-b998-b2ff1950bbbd None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:27.842425 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5c3be1-c43d-4164-b998-b2ff1950bbbd None admin] PATH_INFO: `/v3/projects` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:27.843069 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5c3be1-c43d-4164-b998-b2ff1950bbbd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:27.844504 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5c3be1-c43d-4164-b998-b2ff1950bbbd None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:27.880160 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96345868-31a4-4f43-ab97-22f349d195bd None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:27.913140 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c70408-7de0-4bef-9fc9-3b9b835768bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:27.913792 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c70408-7de0-4bef-9fc9-3b9b835768bf None admin] REQUEST_METHOD: `PUT` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:27.914070 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c70408-7de0-4bef-9fc9-3b9b835768bf None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:27.914340 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c70408-7de0-4bef-9fc9-3b9b835768bf None admin] PATH_INFO: `/v3/projects/3cce5af9f73d46be89fb61b08e04e408/users/47abe7c6472d45e6b9c35ceab8d4ffc5/roles/ab4307f3b7994c1c80036fa7db93b6b9` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:27.916289 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c70408-7de0-4bef-9fc9-3b9b835768bf None admin] RBAC: Authorizing `identity:create_grant(project_id=3cce5af9f73d46be89fb61b08e04e408, user_id=47abe7c6472d45e6b9c35ceab8d4ffc5, role_id=ab4307f3b7994c1c80036fa7db93b6b9)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:27.917754 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c70408-7de0-4bef-9fc9-3b9b835768bf None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:27.951282 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 62/120] 10.222.0.59 () {60 vars in 1141 bytes} [Tue Oct 4 11:39:27 2022] POST /identity/v3/projects => generated 302 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 11:39:27.952197 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5c3be1-c43d-4164-b998-b2ff1950bbbd None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:28.040941 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:28.062519 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5c3be1-c43d-4164-b998-b2ff1950bbbd None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:28.065817 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 59/121] 10.222.0.59 () {58 vars in 1439 bytes} [Tue Oct 4 11:39:27 2022] PUT /identity/v3/projects/3cce5af9f73d46be89fb61b08e04e408/users/47abe7c6472d45e6b9c35ceab8d4ffc5/roles/ab4307f3b7994c1c80036fa7db93b6b9 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 11:39:28.077771 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c70408-7de0-4bef-9fc9-3b9b835768bf None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:28.105303 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143fed1e-3833-40e8-beb8-f6ec6ac6fc11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:28.106050 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143fed1e-3833-40e8-beb8-f6ec6ac6fc11 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:28.106338 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143fed1e-3833-40e8-beb8-f6ec6ac6fc11 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:28.106617 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143fed1e-3833-40e8-beb8-f6ec6ac6fc11 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:28.185943 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:28.209954 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143fed1e-3833-40e8-beb8-f6ec6ac6fc11 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:28.211438 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143fed1e-3833-40e8-beb8-f6ec6ac6fc11 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:28.226946 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c70408-7de0-4bef-9fc9-3b9b835768bf None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:28.268071 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343b4743-6834-483c-8b80-57e834cdf0ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:28.268740 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343b4743-6834-483c-8b80-57e834cdf0ed None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:28.269152 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343b4743-6834-483c-8b80-57e834cdf0ed None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:28.269286 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343b4743-6834-483c-8b80-57e834cdf0ed None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:28.282963 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343b4743-6834-483c-8b80-57e834cdf0ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 11:39:28.289302 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-343b4743-6834-483c-8b80-57e834cdf0ed None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 11:39:28.289302 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:39:28.289302 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:39:28.289302 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:39:28.289302 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:39:28.289302 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:39:28.289302 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:39:28.289302 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:39:28.289302 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:39:28.289302 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:39:28.289302 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:39:28.289302 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:39:28.289302 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 11:39:28.289302 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 11:39:28.289302 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 11:39:28.289302 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 11:39:28.290189 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 11:39:28.290189 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 11:39:28.290189 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 11:39:28.290189 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 11:39:28.290189 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:39:28.290189 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:39:28.290189 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:39:28.290189 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:39:28.290189 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:39:28.290189 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:39:28.290189 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:39:28.290189 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:39:28.290189 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:39:28.290189 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:39:28.290189 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:39:28.290189 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:39:28.291011 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:39:28.291011 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:39:28.291011 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:39:28.291011 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:39:28.291011 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 11:39:28.291011 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 11:39:28.291011 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 11:39:28.291011 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 11:39:28.291011 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 11:39:28.291011 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 11:39:28.291011 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 11:39:28.291011 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:39:28.291011 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 60/122] 10.222.0.59 () {56 vars in 1114 bytes} [Tue Oct 4 11:39:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:39:28.291692 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343b4743-6834-483c-8b80-57e834cdf0ed None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:28.316699 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:28.339096 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 63/123] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Oct 4 11:39:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 11:39:28.339771 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143fed1e-3833-40e8-beb8-f6ec6ac6fc11 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:28.415475 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343b4743-6834-483c-8b80-57e834cdf0ed None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:28.447211 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:28.448259 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143fed1e-3833-40e8-beb8-f6ec6ac6fc11 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:28.457044 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638ebc2d-53ab-4ad4-96d1-89e6478da76e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:28.457663 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638ebc2d-53ab-4ad4-96d1-89e6478da76e None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:28.457944 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638ebc2d-53ab-4ad4-96d1-89e6478da76e None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:28.460760 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638ebc2d-53ab-4ad4-96d1-89e6478da76e None admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:28.460760 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638ebc2d-53ab-4ad4-96d1-89e6478da76e None admin] RBAC: Adding query filter params (name=admin) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:39:28.460760 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638ebc2d-53ab-4ad4-96d1-89e6478da76e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:28.462325 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638ebc2d-53ab-4ad4-96d1-89e6478da76e None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:28.471849 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 61/124] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Oct 4 11:39:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:39:28.473008 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638ebc2d-53ab-4ad4-96d1-89e6478da76e None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:28.487187 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcf6055-9da9-423c-a963-da3ee52a3d14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:28.488137 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcf6055-9da9-423c-a963-da3ee52a3d14 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:28.488637 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcf6055-9da9-423c-a963-da3ee52a3d14 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:28.489109 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcf6055-9da9-423c-a963-da3ee52a3d14 None admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:28.490095 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcf6055-9da9-423c-a963-da3ee52a3d14 None admin] RBAC: Adding query filter params (name=member) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:39:28.490603 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcf6055-9da9-423c-a963-da3ee52a3d14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:28.493122 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcf6055-9da9-423c-a963-da3ee52a3d14 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:28.507464 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 64/125] 10.222.0.59 () {56 vars in 1101 bytes} [Tue Oct 4 11:39:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:39:28.514043 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcf6055-9da9-423c-a963-da3ee52a3d14 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:28.566244 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:28.595795 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638ebc2d-53ab-4ad4-96d1-89e6478da76e None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:28.639065 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcf6055-9da9-423c-a963-da3ee52a3d14 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:28.646667 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b036c5-42b4-486a-9bc3-9200f5767d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:28.647992 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b036c5-42b4-486a-9bc3-9200f5767d1a None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:28.648481 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b036c5-42b4-486a-9bc3-9200f5767d1a None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:28.649186 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b036c5-42b4-486a-9bc3-9200f5767d1a None admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:28.649465 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b036c5-42b4-486a-9bc3-9200f5767d1a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:39:28.649768 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b036c5-42b4-486a-9bc3-9200f5767d1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:28.651127 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b036c5-42b4-486a-9bc3-9200f5767d1a None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:28.659910 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 62/126] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Oct 4 11:39:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:39:28.660753 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b036c5-42b4-486a-9bc3-9200f5767d1a None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:28.685752 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59c5971-cd2d-48ba-ad72-ea902b45934f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:28.686992 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59c5971-cd2d-48ba-ad72-ea902b45934f None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:28.687474 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59c5971-cd2d-48ba-ad72-ea902b45934f None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:28.688378 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59c5971-cd2d-48ba-ad72-ea902b45934f None admin] PATH_INFO: `/v3/projects/3cce5af9f73d46be89fb61b08e04e408` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:28.690373 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59c5971-cd2d-48ba-ad72-ea902b45934f None admin] RBAC: Authorizing `identity:get_project(project_id=3cce5af9f73d46be89fb61b08e04e408)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:28.692709 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59c5971-cd2d-48ba-ad72-ea902b45934f None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:28.695868 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 65/127] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Oct 4 11:39:28 2022] GET /identity/v3/projects/3cce5af9f73d46be89fb61b08e04e408 => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:39:28.697139 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59c5971-cd2d-48ba-ad72-ea902b45934f None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:28.718667 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:28.789612 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b036c5-42b4-486a-9bc3-9200f5767d1a None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:28.826334 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60634b43-5425-445d-91c9-ca2694d07764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:28.826891 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60634b43-5425-445d-91c9-ca2694d07764 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:28.827172 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60634b43-5425-445d-91c9-ca2694d07764 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:28.827457 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60634b43-5425-445d-91c9-ca2694d07764 None admin] PATH_INFO: `/v3/users/6d735c10f69940bfb89355f7b5643d4e` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:28.829589 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60634b43-5425-445d-91c9-ca2694d07764 None admin] RBAC: Authorizing `identity:get_user(user_id=6d735c10f69940bfb89355f7b5643d4e)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:28.832193 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60634b43-5425-445d-91c9-ca2694d07764 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:28.835265 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 63/128] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Oct 4 11:39:28 2022] GET /identity/v3/users/6d735c10f69940bfb89355f7b5643d4e => generated 247 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:39:28.835804 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59c5971-cd2d-48ba-ad72-ea902b45934f None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:28.836931 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60634b43-5425-445d-91c9-ca2694d07764 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:28.847765 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:28.877449 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86043a9-ae1c-4ea1-ab4d-eb8ab13ac6f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:28.878712 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86043a9-ae1c-4ea1-ab4d-eb8ab13ac6f3 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:28.879462 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86043a9-ae1c-4ea1-ab4d-eb8ab13ac6f3 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:28.880413 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86043a9-ae1c-4ea1-ab4d-eb8ab13ac6f3 None admin] PATH_INFO: `/v3/users/47abe7c6472d45e6b9c35ceab8d4ffc5` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:28.882353 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86043a9-ae1c-4ea1-ab4d-eb8ab13ac6f3 None admin] RBAC: Authorizing `identity:get_user(user_id=47abe7c6472d45e6b9c35ceab8d4ffc5)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:28.885148 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86043a9-ae1c-4ea1-ab4d-eb8ab13ac6f3 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:28.891395 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 66/129] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Oct 4 11:39:28 2022] GET /identity/v3/users/47abe7c6472d45e6b9c35ceab8d4ffc5 => generated 275 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:39:28.891395 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86043a9-ae1c-4ea1-ab4d-eb8ab13ac6f3 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:28.984294 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60634b43-5425-445d-91c9-ca2694d07764 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:29.001469 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86043a9-ae1c-4ea1-ab4d-eb8ab13ac6f3 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:29.014306 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:29.033890 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e1088d-2564-4a03-aa91-bfae1d74d922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:29.035209 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e1088d-2564-4a03-aa91-bfae1d74d922 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:29.035764 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e1088d-2564-4a03-aa91-bfae1d74d922 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:29.036277 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e1088d-2564-4a03-aa91-bfae1d74d922 None admin] PATH_INFO: `/v3/users/47abe7c6472d45e6b9c35ceab8d4ffc5` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:29.038531 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e1088d-2564-4a03-aa91-bfae1d74d922 None admin] RBAC: Authorizing `identity:get_user(user_id=47abe7c6472d45e6b9c35ceab8d4ffc5)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:29.039099 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd5f973-05dc-4bd0-ac37-05e4e2d1c609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:29.039820 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd5f973-05dc-4bd0-ac37-05e4e2d1c609 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:29.040179 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd5f973-05dc-4bd0-ac37-05e4e2d1c609 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:29.040528 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd5f973-05dc-4bd0-ac37-05e4e2d1c609 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:29.040985 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e1088d-2564-4a03-aa91-bfae1d74d922 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:29.041527 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd5f973-05dc-4bd0-ac37-05e4e2d1c609 None admin] RBAC: Adding query filter params (role.id=c5fcdf1a59b947a38d056240a270eb26, scope.project.id=3cce5af9f73d46be89fb61b08e04e408, user.id=463ce5b316d942c6b709c01afe2fa163) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:39:29.041911 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd5f973-05dc-4bd0-ac37-05e4e2d1c609 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:29.043262 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 64/130] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Oct 4 11:39:28 2022] GET /identity/v3/users/47abe7c6472d45e6b9c35ceab8d4ffc5 => generated 275 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:39:29.043903 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd5f973-05dc-4bd0-ac37-05e4e2d1c609 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:29.044485 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e1088d-2564-4a03-aa91-bfae1d74d922 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:29.050839 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 67/131] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Oct 4 11:39:28 2022] GET /identity/v3/role_assignments?user.id=463ce5b316d942c6b709c01afe2fa163&scope.project.id=3cce5af9f73d46be89fb61b08e04e408&role.id=c5fcdf1a59b947a38d056240a270eb26 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:39:29.051879 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd5f973-05dc-4bd0-ac37-05e4e2d1c609 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:29.118528 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:29.174838 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e1088d-2564-4a03-aa91-bfae1d74d922 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:29.196974 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd5f973-05dc-4bd0-ac37-05e4e2d1c609 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:29.217727 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d73957-bef2-4838-b778-b5f47cac6f59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:29.218650 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d73957-bef2-4838-b778-b5f47cac6f59 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:29.219134 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d73957-bef2-4838-b778-b5f47cac6f59 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:29.219582 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d73957-bef2-4838-b778-b5f47cac6f59 None admin] PATH_INFO: `/v3/projects/3cce5af9f73d46be89fb61b08e04e408` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:29.221450 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d73957-bef2-4838-b778-b5f47cac6f59 None admin] RBAC: Authorizing `identity:get_project(project_id=3cce5af9f73d46be89fb61b08e04e408)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:29.223618 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d73957-bef2-4838-b778-b5f47cac6f59 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:29.227523 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 65/132] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Oct 4 11:39:29 2022] GET /identity/v3/projects/3cce5af9f73d46be89fb61b08e04e408 => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:39:29.228991 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d73957-bef2-4838-b778-b5f47cac6f59 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:29.249747 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bfb21e-5ec8-4855-8143-ed53eb6b3b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:29.250403 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bfb21e-5ec8-4855-8143-ed53eb6b3b90 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:29.250689 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bfb21e-5ec8-4855-8143-ed53eb6b3b90 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:29.250986 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bfb21e-5ec8-4855-8143-ed53eb6b3b90 None admin] PATH_INFO: `/v3/projects/a8ae92ad99594cf1b23c984f44ecbc47` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:29.252766 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bfb21e-5ec8-4855-8143-ed53eb6b3b90 None admin] RBAC: Authorizing `identity:get_project(project_id=a8ae92ad99594cf1b23c984f44ecbc47)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:29.255938 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bfb21e-5ec8-4855-8143-ed53eb6b3b90 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:29.259566 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 68/133] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Oct 4 11:39:29 2022] GET /identity/v3/projects/a8ae92ad99594cf1b23c984f44ecbc47 => generated 312 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:39:29.260204 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bfb21e-5ec8-4855-8143-ed53eb6b3b90 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:29.348086 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:29.393544 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bfb21e-5ec8-4855-8143-ed53eb6b3b90 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:29.406975 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d73957-bef2-4838-b778-b5f47cac6f59 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:29.410067 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:29.441048 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f52863-cab0-45c0-a8b5-b2da16a395a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:29.441819 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f52863-cab0-45c0-a8b5-b2da16a395a8 None admin] REQUEST_METHOD: `PUT` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:29.442110 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f52863-cab0-45c0-a8b5-b2da16a395a8 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:29.444494 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f52863-cab0-45c0-a8b5-b2da16a395a8 None admin] PATH_INFO: `/v3/projects/3cce5af9f73d46be89fb61b08e04e408/users/6d735c10f69940bfb89355f7b5643d4e/roles/d6e7421d1ff9451c808004b818354550` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:29.445348 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f52863-cab0-45c0-a8b5-b2da16a395a8 None admin] RBAC: Authorizing `identity:create_grant(project_id=3cce5af9f73d46be89fb61b08e04e408, user_id=6d735c10f69940bfb89355f7b5643d4e, role_id=d6e7421d1ff9451c808004b818354550)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:29.447324 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f52863-cab0-45c0-a8b5-b2da16a395a8 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:29.463507 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3c52bf-6fca-4b9b-9c4a-8b4faf712151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:29.464539 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3c52bf-6fca-4b9b-9c4a-8b4faf712151 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:29.465037 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3c52bf-6fca-4b9b-9c4a-8b4faf712151 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:29.465458 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3c52bf-6fca-4b9b-9c4a-8b4faf712151 None admin] PATH_INFO: `/v3/projects/3cce5af9f73d46be89fb61b08e04e408` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:29.466888 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3c52bf-6fca-4b9b-9c4a-8b4faf712151 None admin] RBAC: Authorizing `identity:get_project(project_id=3cce5af9f73d46be89fb61b08e04e408)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:29.468548 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3c52bf-6fca-4b9b-9c4a-8b4faf712151 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:29.470660 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 66/134] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Oct 4 11:39:29 2022] GET /identity/v3/projects/3cce5af9f73d46be89fb61b08e04e408 => generated 298 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:39:29.475829 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3c52bf-6fca-4b9b-9c4a-8b4faf712151 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:29.530879 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 69/135] 10.222.0.59 () {58 vars in 1439 bytes} [Tue Oct 4 11:39:29 2022] PUT /identity/v3/projects/3cce5af9f73d46be89fb61b08e04e408/users/6d735c10f69940bfb89355f7b5643d4e/roles/d6e7421d1ff9451c808004b818354550 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 11:39:29.531715 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f52863-cab0-45c0-a8b5-b2da16a395a8 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:29.656349 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3c52bf-6fca-4b9b-9c4a-8b4faf712151 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:29.708114 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:29.721399 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a969ed5b-c391-4f99-91b8-6dc7708ede57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:29.722382 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a969ed5b-c391-4f99-91b8-6dc7708ede57 None admin] REQUEST_METHOD: `PUT` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:29.722836 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a969ed5b-c391-4f99-91b8-6dc7708ede57 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:29.723260 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a969ed5b-c391-4f99-91b8-6dc7708ede57 None admin] PATH_INFO: `/v3/projects/a8ae92ad99594cf1b23c984f44ecbc47/users/47abe7c6472d45e6b9c35ceab8d4ffc5/roles/ab4307f3b7994c1c80036fa7db93b6b9` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:29.726316 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a969ed5b-c391-4f99-91b8-6dc7708ede57 None admin] RBAC: Authorizing `identity:create_grant(project_id=a8ae92ad99594cf1b23c984f44ecbc47, user_id=47abe7c6472d45e6b9c35ceab8d4ffc5, role_id=ab4307f3b7994c1c80036fa7db93b6b9)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:29.727960 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a969ed5b-c391-4f99-91b8-6dc7708ede57 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:29.747937 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f52863-cab0-45c0-a8b5-b2da16a395a8 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:29.823782 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 67/136] 10.222.0.59 () {58 vars in 1439 bytes} [Tue Oct 4 11:39:29 2022] PUT /identity/v3/projects/a8ae92ad99594cf1b23c984f44ecbc47/users/47abe7c6472d45e6b9c35ceab8d4ffc5/roles/ab4307f3b7994c1c80036fa7db93b6b9 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 11:39:29.826101 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c99df5-0893-4b50-b35a-afd64d535fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:29.826779 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c99df5-0893-4b50-b35a-afd64d535fea None admin] REQUEST_METHOD: `PUT` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:29.827064 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c99df5-0893-4b50-b35a-afd64d535fea None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:29.827348 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c99df5-0893-4b50-b35a-afd64d535fea None admin] PATH_INFO: `/v3/projects/3cce5af9f73d46be89fb61b08e04e408/users/47abe7c6472d45e6b9c35ceab8d4ffc5/roles/b6018afb40c74d19b8cadc402256f23d` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:29.829961 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c99df5-0893-4b50-b35a-afd64d535fea None admin] RBAC: Authorizing `identity:create_grant(project_id=3cce5af9f73d46be89fb61b08e04e408, user_id=47abe7c6472d45e6b9c35ceab8d4ffc5, role_id=b6018afb40c74d19b8cadc402256f23d)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:29.838747 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c99df5-0893-4b50-b35a-afd64d535fea None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:29.951588 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 70/137] 10.222.0.59 () {58 vars in 1439 bytes} [Tue Oct 4 11:39:29 2022] PUT /identity/v3/projects/3cce5af9f73d46be89fb61b08e04e408/users/47abe7c6472d45e6b9c35ceab8d4ffc5/roles/b6018afb40c74d19b8cadc402256f23d => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 11:39:30.415545 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cc61e7-f916-44dd-9a2c-d62e8d809501 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:30.416395 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cc61e7-f916-44dd-9a2c-d62e8d809501 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:30.416836 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cc61e7-f916-44dd-9a2c-d62e8d809501 None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:30.418394 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 68/138] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:39:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 11:39:30.430761 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94f87c4-93d8-4eff-b713-8aa565837cbd None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:30.431053 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94f87c4-93d8-4eff-b713-8aa565837cbd None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:30.431350 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94f87c4-93d8-4eff-b713-8aa565837cbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:30.455016 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-a94f87c4-93d8-4eff-b713-8aa565837cbd None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:39:30.456263 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-a94f87c4-93d8-4eff-b713-8aa565837cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:39:30.495940 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:30.555810 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 71/139] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:39:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 11:39:31.095194 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5723698-fd3b-495b-b673-c968daaf04aa None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:31.095911 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5723698-fd3b-495b-b673-c968daaf04aa None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:31.096421 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5723698-fd3b-495b-b673-c968daaf04aa None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:31.098068 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 69/140] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:39:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:39:31.105074 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94f87c4-93d8-4eff-b713-8aa565837cbd None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:31.121146 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d8975e-104d-4793-b839-ed0b06fd19d0 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:31.121784 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d8975e-104d-4793-b839-ed0b06fd19d0 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:31.122271 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d8975e-104d-4793-b839-ed0b06fd19d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:31.155160 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-83d8975e-104d-4793-b839-ed0b06fd19d0 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:39:31.156879 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-83d8975e-104d-4793-b839-ed0b06fd19d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:39:31.292519 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 70/141] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:39:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 11:39:31.312258 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94f87c4-93d8-4eff-b713-8aa565837cbd None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:31.375732 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0b223c-e8b9-443b-9cff-2faff998ff4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:31.376289 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0b223c-e8b9-443b-9cff-2faff998ff4e None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:31.376572 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0b223c-e8b9-443b-9cff-2faff998ff4e None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:31.376872 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0b223c-e8b9-443b-9cff-2faff998ff4e None admin] PATH_INFO: `/v3/domains/default` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:31.381301 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0b223c-e8b9-443b-9cff-2faff998ff4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:31.383870 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0b223c-e8b9-443b-9cff-2faff998ff4e None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:31.385462 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 72/142] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Oct 4 11:39:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:39:31.391102 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d8975e-104d-4793-b839-ed0b06fd19d0 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:31.614673 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d8975e-104d-4793-b839-ed0b06fd19d0 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:31.648709 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:31.681194 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eaa4e7-44ec-409f-84c4-5759e44c8850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:31.681826 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eaa4e7-44ec-409f-84c4-5759e44c8850 None admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:31.682125 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eaa4e7-44ec-409f-84c4-5759e44c8850 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:31.682408 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eaa4e7-44ec-409f-84c4-5759e44c8850 None admin] PATH_INFO: `/v3/users` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:31.683080 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81eaa4e7-44ec-409f-84c4-5759e44c8850 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:31.684527 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81eaa4e7-44ec-409f-84c4-5759e44c8850 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:31.778280 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0b223c-e8b9-443b-9cff-2faff998ff4e None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:31.804512 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 71/143] 10.222.0.59 () {60 vars in 1132 bytes} [Tue Oct 4 11:39:31 2022] POST /identity/v3/users => generated 283 bytes in 414 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 11:39:31.831290 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:31.938674 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0b223c-e8b9-443b-9cff-2faff998ff4e None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:31.984368 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d09994e-fcc3-4dd4-9cc4-e871176db9d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:31.985125 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d09994e-fcc3-4dd4-9cc4-e871176db9d7 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:31.985415 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d09994e-fcc3-4dd4-9cc4-e871176db9d7 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:31.985705 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d09994e-fcc3-4dd4-9cc4-e871176db9d7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:32.000323 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d09994e-fcc3-4dd4-9cc4-e871176db9d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 11:39:32.005370 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-0d09994e-fcc3-4dd4-9cc4-e871176db9d7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 11:39:32.005370 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:39:32.005370 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:39:32.005370 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:39:32.005370 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:39:32.005370 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:39:32.005370 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:39:32.005370 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:39:32.005370 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:39:32.005370 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:39:32.005370 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:39:32.005370 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:39:32.005370 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 11:39:32.005370 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 11:39:32.005370 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 11:39:32.005370 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 11:39:32.006831 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 11:39:32.006831 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 11:39:32.006831 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 11:39:32.006831 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 11:39:32.006831 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:39:32.006831 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:39:32.006831 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:39:32.006831 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:39:32.006831 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:39:32.006831 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:39:32.006831 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:39:32.006831 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:39:32.006831 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:39:32.006831 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:39:32.006831 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:39:32.006831 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:39:32.007792 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:39:32.007792 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:39:32.007792 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:39:32.007792 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:39:32.007792 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 11:39:32.007792 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 11:39:32.007792 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 11:39:32.007792 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 11:39:32.007792 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 11:39:32.007792 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 11:39:32.007792 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 11:39:32.007792 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:39:32.007792 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 73/144] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Oct 4 11:39:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 11:39:32.014569 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eaa4e7-44ec-409f-84c4-5759e44c8850 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:32.123748 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eaa4e7-44ec-409f-84c4-5759e44c8850 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:32.159933 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfc64ff-a3ba-4c94-acdf-516879e296b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:32.160559 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfc64ff-a3ba-4c94-acdf-516879e296b9 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:32.160881 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfc64ff-a3ba-4c94-acdf-516879e296b9 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:32.161157 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfc64ff-a3ba-4c94-acdf-516879e296b9 None admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:32.161835 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfc64ff-a3ba-4c94-acdf-516879e296b9 None admin] RBAC: Adding query filter params (name=member) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:39:32.162143 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfc64ff-a3ba-4c94-acdf-516879e296b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:32.164130 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfc64ff-a3ba-4c94-acdf-516879e296b9 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:32.173357 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 72/145] 10.222.0.59 () {56 vars in 1101 bytes} [Tue Oct 4 11:39:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:39:32.182927 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d09994e-fcc3-4dd4-9cc4-e871176db9d7 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:32.307067 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:32.323120 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d09994e-fcc3-4dd4-9cc4-e871176db9d7 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:32.368124 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129ca59b-00f6-4339-95aa-808596370481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:32.368793 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129ca59b-00f6-4339-95aa-808596370481 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:32.369077 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129ca59b-00f6-4339-95aa-808596370481 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:32.369361 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129ca59b-00f6-4339-95aa-808596370481 None admin] PATH_INFO: `/v3/users/47abe7c6472d45e6b9c35ceab8d4ffc5` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:32.370520 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129ca59b-00f6-4339-95aa-808596370481 None admin] RBAC: Authorizing `identity:get_user(user_id=47abe7c6472d45e6b9c35ceab8d4ffc5)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:32.372055 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129ca59b-00f6-4339-95aa-808596370481 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:32.373676 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 74/146] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Oct 4 11:39:32 2022] GET /identity/v3/users/47abe7c6472d45e6b9c35ceab8d4ffc5 => generated 275 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:39:32.379418 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfc64ff-a3ba-4c94-acdf-516879e296b9 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:32.415981 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:32.516024 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfc64ff-a3ba-4c94-acdf-516879e296b9 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:32.563916 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d36149b-2713-4971-875f-8692cda3ccec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:32.564464 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d36149b-2713-4971-875f-8692cda3ccec None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:32.564776 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d36149b-2713-4971-875f-8692cda3ccec None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:32.565052 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d36149b-2713-4971-875f-8692cda3ccec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:32.625039 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1c7940-c2f7-4791-9eff-0ddc6aabb84f None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:32.625364 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1c7940-c2f7-4791-9eff-0ddc6aabb84f None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:32.625594 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1c7940-c2f7-4791-9eff-0ddc6aabb84f None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:32.626942 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 75/147] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:39:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:39:32.638772 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa69bd9c-ac07-494b-ba0c-e90d01b39856 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:32.639114 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa69bd9c-ac07-494b-ba0c-e90d01b39856 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:32.639345 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa69bd9c-ac07-494b-ba0c-e90d01b39856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:32.667568 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-fa69bd9c-ac07-494b-ba0c-e90d01b39856 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:39:32.669192 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-fa69bd9c-ac07-494b-ba0c-e90d01b39856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:39:32.670262 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d36149b-2713-4971-875f-8692cda3ccec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:32.671774 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d36149b-2713-4971-875f-8692cda3ccec None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:32.704993 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:32.804754 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 76/148] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:39:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 11:39:32.806067 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87662fe-a58a-4d8a-8e9f-be92fd48eb34 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:32.806349 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87662fe-a58a-4d8a-8e9f-be92fd48eb34 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:32.806625 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87662fe-a58a-4d8a-8e9f-be92fd48eb34 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:32.808364 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 77/149] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:39:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:39:32.814025 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734e72ef-69cc-41a2-b083-3b3183063144 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:32.814163 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734e72ef-69cc-41a2-b083-3b3183063144 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:32.814440 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734e72ef-69cc-41a2-b083-3b3183063144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:32.831874 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 73/150] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Oct 4 11:39:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 11:39:32.839921 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-734e72ef-69cc-41a2-b083-3b3183063144 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:39:32.840074 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d36149b-2713-4971-875f-8692cda3ccec None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:32.841162 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-734e72ef-69cc-41a2-b083-3b3183063144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:39:32.933708 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 78/151] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:39:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 11:39:32.949276 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f5b20c-dec1-4af7-828f-5734b7bbea1e None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:32.949583 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f5b20c-dec1-4af7-828f-5734b7bbea1e None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:32.949848 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f5b20c-dec1-4af7-828f-5734b7bbea1e None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:32.951191 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 79/152] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:39:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:39:32.957206 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977bfa21-4d34-46d4-a528-95218b32f349 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:32.957493 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977bfa21-4d34-46d4-a528-95218b32f349 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:32.957880 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977bfa21-4d34-46d4-a528-95218b32f349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:32.978382 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-977bfa21-4d34-46d4-a528-95218b32f349 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:39:32.979595 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-977bfa21-4d34-46d4-a528-95218b32f349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:39:32.984408 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d36149b-2713-4971-875f-8692cda3ccec None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:32.995633 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:33.043591 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:33.055805 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a4a93b-e3fc-4308-9aba-bc207fb3585e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:33.056449 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a4a93b-e3fc-4308-9aba-bc207fb3585e None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:33.056799 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a4a93b-e3fc-4308-9aba-bc207fb3585e None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:33.057072 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a4a93b-e3fc-4308-9aba-bc207fb3585e None admin] PATH_INFO: `/v3/projects/3cce5af9f73d46be89fb61b08e04e408` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:33.059085 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a4a93b-e3fc-4308-9aba-bc207fb3585e None admin] RBAC: Authorizing `identity:get_project(project_id=3cce5af9f73d46be89fb61b08e04e408)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:33.060543 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a4a93b-e3fc-4308-9aba-bc207fb3585e None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:33.067236 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 74/153] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Oct 4 11:39:32 2022] GET /identity/v3/projects/3cce5af9f73d46be89fb61b08e04e408 => generated 298 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 11:39:33.074175 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a4a93b-e3fc-4308-9aba-bc207fb3585e None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:33.134065 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 80/154] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:39:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 11:39:33.228915 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977bfa21-4d34-46d4-a528-95218b32f349 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:33.279319 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a4a93b-e3fc-4308-9aba-bc207fb3585e None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:33.358903 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819e943b-d9e6-4516-b261-5460b68030b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:33.359498 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819e943b-d9e6-4516-b261-5460b68030b7 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:33.359780 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819e943b-d9e6-4516-b261-5460b68030b7 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:33.360053 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819e943b-d9e6-4516-b261-5460b68030b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:33.360819 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819e943b-d9e6-4516-b261-5460b68030b7 None admin] RBAC: Adding query filter params (role.id=ab4307f3b7994c1c80036fa7db93b6b9, scope.project.id=3cce5af9f73d46be89fb61b08e04e408, user.id=47abe7c6472d45e6b9c35ceab8d4ffc5) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:39:33.361127 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819e943b-d9e6-4516-b261-5460b68030b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:33.362570 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819e943b-d9e6-4516-b261-5460b68030b7 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:33.373473 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 75/155] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Oct 4 11:39:33 2022] GET /identity/v3/role_assignments?user.id=47abe7c6472d45e6b9c35ceab8d4ffc5&scope.project.id=3cce5af9f73d46be89fb61b08e04e408&role.id=ab4307f3b7994c1c80036fa7db93b6b9 => generated 608 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:39:33.404684 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0cf98c-083d-4ce0-b530-b6893084ae09 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:33.405002 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0cf98c-083d-4ce0-b530-b6893084ae09 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:33.405285 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0cf98c-083d-4ce0-b530-b6893084ae09 None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:33.406877 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 76/156] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:39:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:39:33.410106 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977bfa21-4d34-46d4-a528-95218b32f349 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:33.411838 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1de2082-2a87-4a19-9e03-e85fde72c646 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:33.412335 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1de2082-2a87-4a19-9e03-e85fde72c646 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:33.414020 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1de2082-2a87-4a19-9e03-e85fde72c646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:33.454941 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-f1de2082-2a87-4a19-9e03-e85fde72c646 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:39:33.456163 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-f1de2082-2a87-4a19-9e03-e85fde72c646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:39:33.483456 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82683542-7bd0-42bd-bb2b-0025d324003f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:33.484113 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82683542-7bd0-42bd-bb2b-0025d324003f None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:33.484389 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82683542-7bd0-42bd-bb2b-0025d324003f None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:33.484678 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82683542-7bd0-42bd-bb2b-0025d324003f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:33.511974 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82683542-7bd0-42bd-bb2b-0025d324003f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 11:39:33.516928 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-82683542-7bd0-42bd-bb2b-0025d324003f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 11:39:33.516928 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:39:33.516928 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:39:33.516928 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:39:33.516928 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:39:33.516928 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:39:33.516928 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:39:33.516928 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:39:33.516928 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:39:33.516928 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:39:33.516928 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:39:33.516928 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:39:33.516928 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 11:39:33.516928 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 11:39:33.516928 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 11:39:33.516928 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 11:39:33.518078 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 11:39:33.518078 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 11:39:33.518078 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 11:39:33.518078 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 11:39:33.518078 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:39:33.518078 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:39:33.518078 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:39:33.518078 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:39:33.518078 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:39:33.518078 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:39:33.518078 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:39:33.518078 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:39:33.518078 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:39:33.518078 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:39:33.518078 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:39:33.518078 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:39:33.518954 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:39:33.518954 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:39:33.518954 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:39:33.518954 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:39:33.518954 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 11:39:33.518954 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 11:39:33.518954 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 11:39:33.518954 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 11:39:33.518954 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 11:39:33.518954 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 11:39:33.518954 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 11:39:33.518954 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:39:33.518954 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 81/157] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Oct 4 11:39:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:39:33.520124 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82683542-7bd0-42bd-bb2b-0025d324003f None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:33.531642 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:33.610108 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:33.625474 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 77/158] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:39:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 11:39:33.626448 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1de2082-2a87-4a19-9e03-e85fde72c646 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:33.717045 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82683542-7bd0-42bd-bb2b-0025d324003f None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:33.768384 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1de2082-2a87-4a19-9e03-e85fde72c646 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:33.779404 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f479b52-bc25-4c3b-98dc-5a833c2bde3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:33.780057 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f479b52-bc25-4c3b-98dc-5a833c2bde3e None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:33.780336 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f479b52-bc25-4c3b-98dc-5a833c2bde3e None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:33.780632 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f479b52-bc25-4c3b-98dc-5a833c2bde3e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:33.806194 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f479b52-bc25-4c3b-98dc-5a833c2bde3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 11:39:33.814040 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-2f479b52-bc25-4c3b-98dc-5a833c2bde3e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 11:39:33.814040 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:39:33.814040 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:39:33.814040 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:39:33.814040 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:39:33.814040 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:39:33.814040 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:39:33.814040 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:39:33.814040 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:39:33.814040 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:39:33.814040 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:39:33.814040 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:39:33.814040 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 11:39:33.814040 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 11:39:33.814040 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 11:39:33.814040 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 11:39:33.814952 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 11:39:33.814952 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 11:39:33.814952 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 11:39:33.814952 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 11:39:33.814952 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:39:33.814952 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:39:33.814952 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:39:33.814952 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:39:33.814952 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:39:33.814952 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:39:33.814952 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:39:33.814952 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:39:33.814952 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:39:33.814952 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:39:33.814952 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:39:33.814952 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:39:33.815850 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:39:33.815850 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:39:33.815850 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:39:33.815850 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:39:33.815850 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 11:39:33.815850 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 11:39:33.815850 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 11:39:33.815850 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 11:39:33.815850 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 11:39:33.815850 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 11:39:33.815850 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 11:39:33.815850 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:39:33.815850 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 82/159] 10.222.0.59 () {56 vars in 1096 bytes} [Tue Oct 4 11:39:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:39:33.816502 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f479b52-bc25-4c3b-98dc-5a833c2bde3e None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:33.839833 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d91619-5719-4ef3-adff-b49f837ea2ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:33.840459 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d91619-5719-4ef3-adff-b49f837ea2ee None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:33.840763 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d91619-5719-4ef3-adff-b49f837ea2ee None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:33.841039 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d91619-5719-4ef3-adff-b49f837ea2ee None admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:33.841714 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d91619-5719-4ef3-adff-b49f837ea2ee None admin] RBAC: Adding query filter params (name=reader) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:39:33.842009 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d91619-5719-4ef3-adff-b49f837ea2ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:33.843439 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d91619-5719-4ef3-adff-b49f837ea2ee None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:33.860707 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 78/160] 10.222.0.59 () {56 vars in 1101 bytes} [Tue Oct 4 11:39:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:39:33.860707 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d91619-5719-4ef3-adff-b49f837ea2ee None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:33.950259 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:33.957447 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:34.012114 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d91619-5719-4ef3-adff-b49f837ea2ee None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:34.035430 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f479b52-bc25-4c3b-98dc-5a833c2bde3e None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:34.051107 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b465d6f-4df9-4bea-8e21-0b89ec17fce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:34.051729 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b465d6f-4df9-4bea-8e21-0b89ec17fce6 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:34.052060 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b465d6f-4df9-4bea-8e21-0b89ec17fce6 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:34.052336 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b465d6f-4df9-4bea-8e21-0b89ec17fce6 None admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:34.053349 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b465d6f-4df9-4bea-8e21-0b89ec17fce6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:39:34.053961 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b465d6f-4df9-4bea-8e21-0b89ec17fce6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:34.055184 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b465d6f-4df9-4bea-8e21-0b89ec17fce6 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:34.064265 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 79/161] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Oct 4 11:39:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:39:34.070284 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b465d6f-4df9-4bea-8e21-0b89ec17fce6 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:34.118329 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3570e41-56b1-4510-a529-3f25083bdac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:34.118892 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3570e41-56b1-4510-a529-3f25083bdac9 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:34.119169 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3570e41-56b1-4510-a529-3f25083bdac9 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:34.119434 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3570e41-56b1-4510-a529-3f25083bdac9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:34.148075 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3570e41-56b1-4510-a529-3f25083bdac9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 11:39:34.153347 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-f3570e41-56b1-4510-a529-3f25083bdac9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 11:39:34.153347 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:39:34.153347 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:39:34.153347 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:39:34.153347 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:39:34.153347 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:39:34.153347 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:39:34.153347 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:39:34.153347 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:39:34.153347 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:39:34.153347 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:39:34.153347 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:39:34.153347 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 11:39:34.153347 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 11:39:34.153347 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 11:39:34.153347 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 11:39:34.154226 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 11:39:34.154226 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 11:39:34.154226 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 11:39:34.154226 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 11:39:34.154226 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:39:34.154226 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:39:34.154226 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:39:34.154226 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:39:34.154226 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:39:34.154226 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:39:34.154226 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:39:34.154226 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:39:34.154226 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:39:34.154226 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:39:34.154226 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:39:34.154226 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:39:34.155012 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:39:34.155012 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:39:34.155012 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:39:34.155012 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:39:34.155012 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 11:39:34.155012 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 11:39:34.155012 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 11:39:34.155012 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 11:39:34.155012 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 11:39:34.155012 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 11:39:34.155012 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 11:39:34.155012 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:39:34.155012 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 83/162] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Oct 4 11:39:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:39:34.155678 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3570e41-56b1-4510-a529-3f25083bdac9 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:34.184141 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b465d6f-4df9-4bea-8e21-0b89ec17fce6 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:34.202829 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:34.221462 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279560e9-16c6-4af5-bb09-9e3dad3ec744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:34.226647 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279560e9-16c6-4af5-bb09-9e3dad3ec744 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:34.226647 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279560e9-16c6-4af5-bb09-9e3dad3ec744 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:34.226647 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279560e9-16c6-4af5-bb09-9e3dad3ec744 None admin] PATH_INFO: `/v3/users/463ce5b316d942c6b709c01afe2fa163` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:34.226647 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279560e9-16c6-4af5-bb09-9e3dad3ec744 None admin] RBAC: Authorizing `identity:get_user(user_id=463ce5b316d942c6b709c01afe2fa163)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:34.226647 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279560e9-16c6-4af5-bb09-9e3dad3ec744 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:34.227732 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 80/163] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Oct 4 11:39:34 2022] GET /identity/v3/users/463ce5b316d942c6b709c01afe2fa163 => generated 289 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:39:34.234392 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279560e9-16c6-4af5-bb09-9e3dad3ec744 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:34.343345 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279560e9-16c6-4af5-bb09-9e3dad3ec744 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:34.380648 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43233970-880e-4a78-aeda-c501425c94de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:34.381388 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43233970-880e-4a78-aeda-c501425c94de None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:34.381681 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43233970-880e-4a78-aeda-c501425c94de None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:34.381964 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43233970-880e-4a78-aeda-c501425c94de None admin] PATH_INFO: `/v3/users/6d735c10f69940bfb89355f7b5643d4e` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:34.382558 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3570e41-56b1-4510-a529-3f25083bdac9 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:34.383078 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43233970-880e-4a78-aeda-c501425c94de None admin] RBAC: Authorizing `identity:get_user(user_id=6d735c10f69940bfb89355f7b5643d4e)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:34.384522 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43233970-880e-4a78-aeda-c501425c94de None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:34.386792 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 81/164] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Oct 4 11:39:34 2022] GET /identity/v3/users/6d735c10f69940bfb89355f7b5643d4e => generated 247 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:39:34.397307 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43233970-880e-4a78-aeda-c501425c94de None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:34.448468 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:34.461768 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9845cae1-be0f-4fb8-85b8-e229cdbb682f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:34.462677 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9845cae1-be0f-4fb8-85b8-e229cdbb682f None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:34.463291 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9845cae1-be0f-4fb8-85b8-e229cdbb682f None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:34.463710 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9845cae1-be0f-4fb8-85b8-e229cdbb682f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:34.477261 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9845cae1-be0f-4fb8-85b8-e229cdbb682f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 11:39:34.482690 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-9845cae1-be0f-4fb8-85b8-e229cdbb682f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 11:39:34.482690 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:39:34.482690 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:39:34.482690 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:39:34.482690 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:39:34.482690 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:39:34.482690 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:39:34.482690 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:39:34.482690 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:39:34.482690 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:39:34.482690 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:39:34.482690 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:39:34.482690 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 11:39:34.482690 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 11:39:34.482690 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 11:39:34.482690 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 11:39:34.483777 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 11:39:34.483777 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 11:39:34.483777 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 11:39:34.483777 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 11:39:34.483777 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:39:34.483777 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:39:34.483777 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:39:34.483777 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:39:34.483777 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:39:34.483777 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:39:34.483777 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:39:34.483777 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:39:34.483777 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:39:34.483777 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:39:34.483777 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:39:34.483777 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:39:34.484871 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:39:34.484871 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:39:34.484871 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:39:34.484871 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:39:34.484871 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 11:39:34.484871 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 11:39:34.484871 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 11:39:34.484871 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 11:39:34.484871 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 11:39:34.484871 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 11:39:34.484871 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 11:39:34.484871 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:39:34.487907 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 84/165] 10.222.0.59 () {56 vars in 1114 bytes} [Tue Oct 4 11:39:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:39:34.488998 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9845cae1-be0f-4fb8-85b8-e229cdbb682f None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:34.535875 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:34.589373 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43233970-880e-4a78-aeda-c501425c94de None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:34.632494 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d635f9c7-698b-4436-b3f5-6349849868df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:34.633634 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d635f9c7-698b-4436-b3f5-6349849868df None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:34.633908 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d635f9c7-698b-4436-b3f5-6349849868df None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:34.634174 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d635f9c7-698b-4436-b3f5-6349849868df None admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:34.634839 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d635f9c7-698b-4436-b3f5-6349849868df None admin] RBAC: Adding query filter params (name=member) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:39:34.635137 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d635f9c7-698b-4436-b3f5-6349849868df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:34.636504 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d635f9c7-698b-4436-b3f5-6349849868df None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:34.645816 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 82/166] 10.222.0.59 () {56 vars in 1101 bytes} [Tue Oct 4 11:39:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:39:34.647054 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d635f9c7-698b-4436-b3f5-6349849868df None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:34.729056 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9845cae1-be0f-4fb8-85b8-e229cdbb682f None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:34.795730 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cdbc26-3dc9-4b49-a1c7-8da362152a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:34.798879 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cdbc26-3dc9-4b49-a1c7-8da362152a9d None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:34.799160 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cdbc26-3dc9-4b49-a1c7-8da362152a9d None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:34.799487 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cdbc26-3dc9-4b49-a1c7-8da362152a9d None admin] PATH_INFO: `/v3/projects/3cce5af9f73d46be89fb61b08e04e408` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:34.800838 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cdbc26-3dc9-4b49-a1c7-8da362152a9d None admin] RBAC: Authorizing `identity:get_project(project_id=3cce5af9f73d46be89fb61b08e04e408)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:34.802329 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cdbc26-3dc9-4b49-a1c7-8da362152a9d None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:34.804468 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 85/167] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Oct 4 11:39:34 2022] GET /identity/v3/projects/3cce5af9f73d46be89fb61b08e04e408 => generated 298 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:39:34.806255 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cdbc26-3dc9-4b49-a1c7-8da362152a9d None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:34.825908 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d635f9c7-698b-4436-b3f5-6349849868df None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:34.852814 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:34.886428 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41662c55-682f-4ce8-9314-2eb0653f5fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:34.886990 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41662c55-682f-4ce8-9314-2eb0653f5fe5 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:34.887268 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41662c55-682f-4ce8-9314-2eb0653f5fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:34.887544 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41662c55-682f-4ce8-9314-2eb0653f5fe5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:34.920034 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:34.993723 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cdbc26-3dc9-4b49-a1c7-8da362152a9d None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:35.031138 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae26887-0d13-4df9-8032-cee9b3dba4aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:35.031748 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae26887-0d13-4df9-8032-cee9b3dba4aa None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:35.032023 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae26887-0d13-4df9-8032-cee9b3dba4aa None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:35.032293 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae26887-0d13-4df9-8032-cee9b3dba4aa None admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:35.032983 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae26887-0d13-4df9-8032-cee9b3dba4aa None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:39:35.033285 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae26887-0d13-4df9-8032-cee9b3dba4aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:35.036000 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae26887-0d13-4df9-8032-cee9b3dba4aa None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:35.038011 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41662c55-682f-4ce8-9314-2eb0653f5fe5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:35.039478 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41662c55-682f-4ce8-9314-2eb0653f5fe5 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:35.055630 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 86/168] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Oct 4 11:39:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:39:35.056284 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae26887-0d13-4df9-8032-cee9b3dba4aa None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:35.228278 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 83/169] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Oct 4 11:39:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 582 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 11:39:35.229215 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41662c55-682f-4ce8-9314-2eb0653f5fe5 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:35.257602 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:35.262150 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae26887-0d13-4df9-8032-cee9b3dba4aa None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:35.290982 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:35.326589 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbb6d95-7c8f-4534-b33e-f214b17786f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:35.327221 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb6d95-7c8f-4534-b33e-f214b17786f7 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:35.327497 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb6d95-7c8f-4534-b33e-f214b17786f7 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:35.327771 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb6d95-7c8f-4534-b33e-f214b17786f7 None admin] PATH_INFO: `/v3/users/47abe7c6472d45e6b9c35ceab8d4ffc5` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:35.329589 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbb6d95-7c8f-4534-b33e-f214b17786f7 None admin] RBAC: Authorizing `identity:get_user(user_id=47abe7c6472d45e6b9c35ceab8d4ffc5)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:35.331036 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbb6d95-7c8f-4534-b33e-f214b17786f7 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:35.333111 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 87/170] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Oct 4 11:39:35 2022] GET /identity/v3/users/47abe7c6472d45e6b9c35ceab8d4ffc5 => generated 275 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:39:35.333917 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbb6d95-7c8f-4534-b33e-f214b17786f7 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:35.341292 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41662c55-682f-4ce8-9314-2eb0653f5fe5 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:35.376753 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389b78d7-1509-4205-acbf-3965332e66b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:35.377417 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389b78d7-1509-4205-acbf-3965332e66b0 None admin] REQUEST_METHOD: `PUT` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:35.377696 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389b78d7-1509-4205-acbf-3965332e66b0 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:35.377974 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389b78d7-1509-4205-acbf-3965332e66b0 None admin] PATH_INFO: `/v3/projects/3cce5af9f73d46be89fb61b08e04e408/users/463ce5b316d942c6b709c01afe2fa163/roles/c5fcdf1a59b947a38d056240a270eb26` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:35.379933 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389b78d7-1509-4205-acbf-3965332e66b0 None admin] RBAC: Authorizing `identity:create_grant(project_id=3cce5af9f73d46be89fb61b08e04e408, user_id=463ce5b316d942c6b709c01afe2fa163, role_id=c5fcdf1a59b947a38d056240a270eb26)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:35.381612 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389b78d7-1509-4205-acbf-3965332e66b0 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:35.451292 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 84/171] 10.222.0.59 () {58 vars in 1439 bytes} [Tue Oct 4 11:39:35 2022] PUT /identity/v3/projects/3cce5af9f73d46be89fb61b08e04e408/users/463ce5b316d942c6b709c01afe2fa163/roles/c5fcdf1a59b947a38d056240a270eb26 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 11:39:35.452135 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389b78d7-1509-4205-acbf-3965332e66b0 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:35.483307 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbb6d95-7c8f-4534-b33e-f214b17786f7 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:35.528384 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9e0904-4551-49d8-a070-61c482dee037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:35.528384 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9e0904-4551-49d8-a070-61c482dee037 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:35.528384 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9e0904-4551-49d8-a070-61c482dee037 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:35.528384 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9e0904-4551-49d8-a070-61c482dee037 None admin] PATH_INFO: `/v3/users/47abe7c6472d45e6b9c35ceab8d4ffc5` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:35.528886 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9e0904-4551-49d8-a070-61c482dee037 None admin] RBAC: Authorizing `identity:get_user(user_id=47abe7c6472d45e6b9c35ceab8d4ffc5)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:35.529625 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9e0904-4551-49d8-a070-61c482dee037 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:35.536773 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 88/172] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Oct 4 11:39:35 2022] GET /identity/v3/users/47abe7c6472d45e6b9c35ceab8d4ffc5 => generated 275 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:39:35.538736 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9e0904-4551-49d8-a070-61c482dee037 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:35.636219 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:35.686172 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389b78d7-1509-4205-acbf-3965332e66b0 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:35.717583 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:35.753124 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba9c6ab-10a6-497e-b43c-f7c9abab4f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:35.753691 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba9c6ab-10a6-497e-b43c-f7c9abab4f75 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:35.753967 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba9c6ab-10a6-497e-b43c-f7c9abab4f75 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:35.754250 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba9c6ab-10a6-497e-b43c-f7c9abab4f75 None admin] PATH_INFO: `/v3/projects/3cce5af9f73d46be89fb61b08e04e408` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:35.757035 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba9c6ab-10a6-497e-b43c-f7c9abab4f75 None admin] RBAC: Authorizing `identity:get_project(project_id=3cce5af9f73d46be89fb61b08e04e408)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:35.758467 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba9c6ab-10a6-497e-b43c-f7c9abab4f75 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:35.766222 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 85/173] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Oct 4 11:39:35 2022] GET /identity/v3/projects/3cce5af9f73d46be89fb61b08e04e408 => generated 298 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:39:35.767114 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba9c6ab-10a6-497e-b43c-f7c9abab4f75 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:35.799170 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9e0904-4551-49d8-a070-61c482dee037 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:35.843611 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bea86f-c027-4431-ab57-de74b3a702a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:35.844500 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bea86f-c027-4431-ab57-de74b3a702a4 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:35.844827 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bea86f-c027-4431-ab57-de74b3a702a4 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:35.845107 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bea86f-c027-4431-ab57-de74b3a702a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:35.889650 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba9c6ab-10a6-497e-b43c-f7c9abab4f75 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:35.925927 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8814e1b0-2caa-4d30-952d-59fb7cc188fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:35.926557 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8814e1b0-2caa-4d30-952d-59fb7cc188fb None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:35.926838 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8814e1b0-2caa-4d30-952d-59fb7cc188fb None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:35.927110 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8814e1b0-2caa-4d30-952d-59fb7cc188fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:35.939604 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bea86f-c027-4431-ab57-de74b3a702a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:35.942061 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bea86f-c027-4431-ab57-de74b3a702a4 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:35.944925 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:36.004591 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:36.006392 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8814e1b0-2caa-4d30-952d-59fb7cc188fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:36.008213 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8814e1b0-2caa-4d30-952d-59fb7cc188fb None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:36.089546 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 89/174] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Oct 4 11:39:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 548 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 11:39:36.092264 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2045d81a-e8db-465b-9207-9d91ad80e1d2 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:36.093014 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2045d81a-e8db-465b-9207-9d91ad80e1d2 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:36.093727 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2045d81a-e8db-465b-9207-9d91ad80e1d2 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:36.099415 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 90/175] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:39:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:39:36.105427 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2045d81a-e8db-465b-9207-9d91ad80e1d2 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:36.132430 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 86/176] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Oct 4 11:39:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 11:39:36.133867 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8814e1b0-2caa-4d30-952d-59fb7cc188fb None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:36.189338 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:36.252182 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8814e1b0-2caa-4d30-952d-59fb7cc188fb None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:36.292254 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c76db3d-a70a-4617-b6bd-2f928d8f4356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:36.292926 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c76db3d-a70a-4617-b6bd-2f928d8f4356 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:36.293797 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c76db3d-a70a-4617-b6bd-2f928d8f4356 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:36.294144 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c76db3d-a70a-4617-b6bd-2f928d8f4356 None admin] PATH_INFO: `/v3/projects/a8ae92ad99594cf1b23c984f44ecbc47` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:36.295473 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c76db3d-a70a-4617-b6bd-2f928d8f4356 None admin] RBAC: Authorizing `identity:get_project(project_id=a8ae92ad99594cf1b23c984f44ecbc47)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:36.296944 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c76db3d-a70a-4617-b6bd-2f928d8f4356 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:36.298651 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 87/177] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Oct 4 11:39:36 2022] GET /identity/v3/projects/a8ae92ad99594cf1b23c984f44ecbc47 => generated 312 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:39:36.300804 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b82df66-e6a9-4232-b143-32ea812665da None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:36.301104 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b82df66-e6a9-4232-b143-32ea812665da None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:36.301383 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b82df66-e6a9-4232-b143-32ea812665da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:36.322018 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-3b82df66-e6a9-4232-b143-32ea812665da None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:39:36.323556 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-3b82df66-e6a9-4232-b143-32ea812665da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:39:36.366668 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2045d81a-e8db-465b-9207-9d91ad80e1d2 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:36.418432 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 88/178] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:39:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 11:39:36.419297 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b82df66-e6a9-4232-b143-32ea812665da None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:36.420517 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e4b038-f8e7-4342-b628-82f8564cc416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:36.421647 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e4b038-f8e7-4342-b628-82f8564cc416 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:36.422128 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e4b038-f8e7-4342-b628-82f8564cc416 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:36.422612 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e4b038-f8e7-4342-b628-82f8564cc416 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:36.423940 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e4b038-f8e7-4342-b628-82f8564cc416 None admin] RBAC: Adding query filter params (role.id=d6e7421d1ff9451c808004b818354550, scope.project.id=3cce5af9f73d46be89fb61b08e04e408, user.id=6d735c10f69940bfb89355f7b5643d4e) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:39:36.424483 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e4b038-f8e7-4342-b628-82f8564cc416 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:36.427295 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e4b038-f8e7-4342-b628-82f8564cc416 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:36.451782 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 91/179] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Oct 4 11:39:36 2022] GET /identity/v3/role_assignments?user.id=6d735c10f69940bfb89355f7b5643d4e&scope.project.id=3cce5af9f73d46be89fb61b08e04e408&role.id=d6e7421d1ff9451c808004b818354550 => generated 608 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:39:36.456767 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e4b038-f8e7-4342-b628-82f8564cc416 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:36.503830 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:36.508152 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:36.624123 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e4b038-f8e7-4342-b628-82f8564cc416 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:36.664949 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36300353-9f65-47d2-933e-9a9b85fd6663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:36.666231 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36300353-9f65-47d2-933e-9a9b85fd6663 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:36.666715 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36300353-9f65-47d2-933e-9a9b85fd6663 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:36.667233 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36300353-9f65-47d2-933e-9a9b85fd6663 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:36.668172 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36300353-9f65-47d2-933e-9a9b85fd6663 None admin] RBAC: Adding query filter params (role.id=ab4307f3b7994c1c80036fa7db93b6b9, scope.project.id=a8ae92ad99594cf1b23c984f44ecbc47, user.id=47abe7c6472d45e6b9c35ceab8d4ffc5) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:39:36.668710 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36300353-9f65-47d2-933e-9a9b85fd6663 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:36.670748 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36300353-9f65-47d2-933e-9a9b85fd6663 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:36.679330 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 92/180] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Oct 4 11:39:36 2022] GET /identity/v3/role_assignments?user.id=47abe7c6472d45e6b9c35ceab8d4ffc5&scope.project.id=a8ae92ad99594cf1b23c984f44ecbc47&role.id=ab4307f3b7994c1c80036fa7db93b6b9 => generated 608 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:39:36.681207 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94c5794-4317-43ee-8f88-9320ebabaf76 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:36.681694 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94c5794-4317-43ee-8f88-9320ebabaf76 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:36.682448 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94c5794-4317-43ee-8f88-9320ebabaf76 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:36.684637 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 93/181] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:39:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:39:36.686280 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc2a3b9-70ff-442f-a47c-44e6fb51e28a None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:36.686803 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc2a3b9-70ff-442f-a47c-44e6fb51e28a None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:36.687270 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc2a3b9-70ff-442f-a47c-44e6fb51e28a None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:36.688882 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 94/182] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:39:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:39:36.695422 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6b9282-c240-4ade-850a-d91362397590 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:36.695982 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6b9282-c240-4ade-850a-d91362397590 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:36.696491 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6b9282-c240-4ade-850a-d91362397590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:36.714703 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b82df66-e6a9-4232-b143-32ea812665da None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:36.720176 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-8c6b9282-c240-4ade-850a-d91362397590 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:39:36.721779 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-8c6b9282-c240-4ade-850a-d91362397590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:39:36.778410 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5288fb0-3459-47f8-ba67-9e2e8d6ac79d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:36.779058 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5288fb0-3459-47f8-ba67-9e2e8d6ac79d None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:36.779337 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5288fb0-3459-47f8-ba67-9e2e8d6ac79d None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:36.779610 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5288fb0-3459-47f8-ba67-9e2e8d6ac79d None admin] PATH_INFO: `/v3/projects/3cce5af9f73d46be89fb61b08e04e408` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:36.780770 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5288fb0-3459-47f8-ba67-9e2e8d6ac79d None admin] RBAC: Authorizing `identity:get_project(project_id=3cce5af9f73d46be89fb61b08e04e408)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:36.782225 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5288fb0-3459-47f8-ba67-9e2e8d6ac79d None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:36.783901 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 89/183] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Oct 4 11:39:36 2022] GET /identity/v3/projects/3cce5af9f73d46be89fb61b08e04e408 => generated 298 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:39:36.788623 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013227cd-9fee-4362-9e95-453af00c4cb3 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:36.788623 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013227cd-9fee-4362-9e95-453af00c4cb3 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:36.788623 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013227cd-9fee-4362-9e95-453af00c4cb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:36.809101 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-013227cd-9fee-4362-9e95-453af00c4cb3 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:39:36.810316 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-013227cd-9fee-4362-9e95-453af00c4cb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:39:36.824477 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 95/184] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:39:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 11:39:36.825412 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6b9282-c240-4ade-850a-d91362397590 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:36.852988 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:36.907342 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 90/185] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:39:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 11:39:36.908251 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013227cd-9fee-4362-9e95-453af00c4cb3 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:36.964359 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:37.030534 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6b9282-c240-4ade-850a-d91362397590 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:37.035890 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013227cd-9fee-4362-9e95-453af00c4cb3 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:37.079564 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b537671b-09bb-49d6-81a8-2fc0f017d620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:37.080207 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b537671b-09bb-49d6-81a8-2fc0f017d620 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:37.080483 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b537671b-09bb-49d6-81a8-2fc0f017d620 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:37.080784 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b537671b-09bb-49d6-81a8-2fc0f017d620 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:37.098680 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276d6280-a39c-4819-a05c-56e6aec43360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:37.099349 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276d6280-a39c-4819-a05c-56e6aec43360 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:37.099634 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276d6280-a39c-4819-a05c-56e6aec43360 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:37.100985 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276d6280-a39c-4819-a05c-56e6aec43360 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:37.102080 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276d6280-a39c-4819-a05c-56e6aec43360 None admin] RBAC: Adding query filter params (role.id=b6018afb40c74d19b8cadc402256f23d, scope.project.id=3cce5af9f73d46be89fb61b08e04e408, user.id=47abe7c6472d45e6b9c35ceab8d4ffc5) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:39:37.102590 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276d6280-a39c-4819-a05c-56e6aec43360 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:37.104226 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276d6280-a39c-4819-a05c-56e6aec43360 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:37.104660 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b537671b-09bb-49d6-81a8-2fc0f017d620 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 11:39:37.112683 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-b537671b-09bb-49d6-81a8-2fc0f017d620 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 11:39:37.112683 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:39:37.112683 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:39:37.112683 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:39:37.112683 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:39:37.112683 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:39:37.112683 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:39:37.112683 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:39:37.112683 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:39:37.112683 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:39:37.112683 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:39:37.112683 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:39:37.112683 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 11:39:37.112683 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 11:39:37.112683 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 11:39:37.112683 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 11:39:37.113564 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 11:39:37.113564 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 11:39:37.113564 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 11:39:37.113564 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 11:39:37.113564 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:39:37.113564 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:39:37.113564 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:39:37.113564 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:39:37.113564 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:39:37.113564 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:39:37.113564 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:39:37.113564 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:39:37.113564 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:39:37.113564 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:39:37.113564 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:39:37.113564 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:39:37.114382 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:39:37.114382 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:39:37.114382 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:39:37.114382 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:39:37.114382 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 11:39:37.114382 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 11:39:37.114382 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 11:39:37.114382 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 11:39:37.114382 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 11:39:37.114382 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 11:39:37.114382 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 11:39:37.114382 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:39:37.114382 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 91/186] 10.222.0.59 () {56 vars in 1096 bytes} [Tue Oct 4 11:39:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:39:37.117358 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b537671b-09bb-49d6-81a8-2fc0f017d620 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:37.118377 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 96/187] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Oct 4 11:39:36 2022] GET /identity/v3/role_assignments?user.id=47abe7c6472d45e6b9c35ceab8d4ffc5&scope.project.id=3cce5af9f73d46be89fb61b08e04e408&role.id=b6018afb40c74d19b8cadc402256f23d => generated 608 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:39:37.261169 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:37.263599 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276d6280-a39c-4819-a05c-56e6aec43360 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:37.264551 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b537671b-09bb-49d6-81a8-2fc0f017d620 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:37.335818 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d44a3f9-a195-49e1-b7d6-0f5477982ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:37.341433 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d44a3f9-a195-49e1-b7d6-0f5477982ae0 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:37.342053 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d44a3f9-a195-49e1-b7d6-0f5477982ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:37.342550 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d44a3f9-a195-49e1-b7d6-0f5477982ae0 None admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:37.343268 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d44a3f9-a195-49e1-b7d6-0f5477982ae0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:39:37.343575 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d44a3f9-a195-49e1-b7d6-0f5477982ae0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:37.345148 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d44a3f9-a195-49e1-b7d6-0f5477982ae0 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:37.355067 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 92/188] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Oct 4 11:39:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:39:37.359909 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d44a3f9-a195-49e1-b7d6-0f5477982ae0 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:37.390266 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:37.418836 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276d6280-a39c-4819-a05c-56e6aec43360 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:37.457971 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b6daf8-748c-4c7c-a5e6-265ae376019c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:37.459577 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b6daf8-748c-4c7c-a5e6-265ae376019c None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:37.460765 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b6daf8-748c-4c7c-a5e6-265ae376019c None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:37.461350 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b6daf8-748c-4c7c-a5e6-265ae376019c None admin] PATH_INFO: `/v3/domains/default` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:37.464852 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b6daf8-748c-4c7c-a5e6-265ae376019c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:37.466030 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b6daf8-748c-4c7c-a5e6-265ae376019c None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:37.467636 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 97/189] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Oct 4 11:39:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:39:37.468517 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b6daf8-748c-4c7c-a5e6-265ae376019c None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:37.478717 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d44a3f9-a195-49e1-b7d6-0f5477982ae0 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:37.530467 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47a39e0-e625-4109-9e6d-374f52b7ba4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:37.531109 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47a39e0-e625-4109-9e6d-374f52b7ba4b None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:37.531390 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47a39e0-e625-4109-9e6d-374f52b7ba4b None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:37.531658 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47a39e0-e625-4109-9e6d-374f52b7ba4b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:37.543020 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47a39e0-e625-4109-9e6d-374f52b7ba4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 11:39:37.548292 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-b47a39e0-e625-4109-9e6d-374f52b7ba4b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 11:39:37.548292 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:39:37.548292 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:39:37.548292 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:39:37.548292 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:39:37.548292 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:39:37.548292 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:39:37.548292 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:39:37.548292 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:39:37.548292 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:39:37.548292 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:39:37.548292 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:39:37.548292 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 11:39:37.548292 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 11:39:37.548292 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 11:39:37.548292 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 11:39:37.549409 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 11:39:37.549409 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 11:39:37.549409 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 11:39:37.549409 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 11:39:37.549409 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:39:37.549409 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:39:37.549409 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:39:37.549409 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:39:37.549409 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:39:37.549409 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:39:37.549409 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:39:37.549409 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:39:37.549409 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:39:37.549409 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:39:37.549409 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:39:37.549409 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:39:37.550234 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:39:37.550234 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:39:37.550234 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:39:37.550234 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:39:37.550234 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 11:39:37.550234 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 11:39:37.550234 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 11:39:37.550234 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 11:39:37.550234 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 11:39:37.550234 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 11:39:37.550234 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 11:39:37.550234 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:39:37.550234 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 93/190] 10.222.0.59 () {56 vars in 1114 bytes} [Tue Oct 4 11:39:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:39:37.550234 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47a39e0-e625-4109-9e6d-374f52b7ba4b None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:37.576888 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:37.601935 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b6daf8-748c-4c7c-a5e6-265ae376019c None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:37.637167 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb83cd2b-3841-4f1d-af1c-41ded7ea5bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:37.637786 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb83cd2b-3841-4f1d-af1c-41ded7ea5bc7 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:37.638062 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb83cd2b-3841-4f1d-af1c-41ded7ea5bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:37.638335 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb83cd2b-3841-4f1d-af1c-41ded7ea5bc7 None admin] PATH_INFO: `/v3/users/aa7220b65c3348289d244d64d4cf0797` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:37.650679 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:37.653146 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb83cd2b-3841-4f1d-af1c-41ded7ea5bc7 None admin] RBAC: Authorizing `identity:get_user(user_id=aa7220b65c3348289d244d64d4cf0797)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:37.654588 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb83cd2b-3841-4f1d-af1c-41ded7ea5bc7 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:37.655768 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47a39e0-e625-4109-9e6d-374f52b7ba4b None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:37.656242 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 98/191] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Oct 4 11:39:37 2022] GET /identity/v3/users/aa7220b65c3348289d244d64d4cf0797 => generated 283 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:39:37.657021 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb83cd2b-3841-4f1d-af1c-41ded7ea5bc7 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:37.697951 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90a5ccc-1c96-4b67-b948-3ab10b9fa24c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:37.698640 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90a5ccc-1c96-4b67-b948-3ab10b9fa24c None admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:37.698921 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90a5ccc-1c96-4b67-b948-3ab10b9fa24c None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:37.699191 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90a5ccc-1c96-4b67-b948-3ab10b9fa24c None admin] PATH_INFO: `/v3/users` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:37.699839 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90a5ccc-1c96-4b67-b948-3ab10b9fa24c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:37.701311 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90a5ccc-1c96-4b67-b948-3ab10b9fa24c None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:37.764164 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb83cd2b-3841-4f1d-af1c-41ded7ea5bc7 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:37.797974 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e6aa33-9520-4b80-ac6a-92933e010948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:37.798536 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e6aa33-9520-4b80-ac6a-92933e010948 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:37.798774 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e6aa33-9520-4b80-ac6a-92933e010948 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:37.799044 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e6aa33-9520-4b80-ac6a-92933e010948 None admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:37.799690 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e6aa33-9520-4b80-ac6a-92933e010948 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:39:37.799989 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e6aa33-9520-4b80-ac6a-92933e010948 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:37.801377 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e6aa33-9520-4b80-ac6a-92933e010948 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:37.810047 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 99/192] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Oct 4 11:39:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:39:37.810806 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e6aa33-9520-4b80-ac6a-92933e010948 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:37.815896 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 94/193] 10.222.0.59 () {60 vars in 1132 bytes} [Tue Oct 4 11:39:37 2022] POST /identity/v3/users => generated 297 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 11:39:37.816928 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90a5ccc-1c96-4b67-b948-3ab10b9fa24c None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:37.901764 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:37.929352 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:37.948835 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e6aa33-9520-4b80-ac6a-92933e010948 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:37.960907 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90a5ccc-1c96-4b67-b948-3ab10b9fa24c None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:37.992778 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b90afa-14b1-4115-acd8-7607ae0f9271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:37.993797 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b90afa-14b1-4115-acd8-7607ae0f9271 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:37.994280 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b90afa-14b1-4115-acd8-7607ae0f9271 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:37.994749 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b90afa-14b1-4115-acd8-7607ae0f9271 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:38.009541 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d307cd8-b9a2-42aa-97c0-97c69d822915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:38.010668 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d307cd8-b9a2-42aa-97c0-97c69d822915 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:38.011084 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d307cd8-b9a2-42aa-97c0-97c69d822915 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:38.011297 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d307cd8-b9a2-42aa-97c0-97c69d822915 None admin] PATH_INFO: `/v3/users/aa7220b65c3348289d244d64d4cf0797` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:38.013154 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d307cd8-b9a2-42aa-97c0-97c69d822915 None admin] RBAC: Authorizing `identity:get_user(user_id=aa7220b65c3348289d244d64d4cf0797)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:38.015353 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d307cd8-b9a2-42aa-97c0-97c69d822915 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:38.017474 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 95/194] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Oct 4 11:39:37 2022] GET /identity/v3/users/aa7220b65c3348289d244d64d4cf0797 => generated 283 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:39:38.025237 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d307cd8-b9a2-42aa-97c0-97c69d822915 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:38.091416 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b90afa-14b1-4115-acd8-7607ae0f9271 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:38.093792 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b90afa-14b1-4115-acd8-7607ae0f9271 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:38.165895 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d307cd8-b9a2-42aa-97c0-97c69d822915 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:38.175910 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:38.216358 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578857b3-1506-4e47-ab7d-21969c7ddc14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:38.217374 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578857b3-1506-4e47-ab7d-21969c7ddc14 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:38.217796 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578857b3-1506-4e47-ab7d-21969c7ddc14 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:38.218344 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578857b3-1506-4e47-ab7d-21969c7ddc14 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:38.225829 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 100/195] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Oct 4 11:39:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 11:39:38.231564 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b90afa-14b1-4115-acd8-7607ae0f9271 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:38.240017 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:38.318954 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578857b3-1506-4e47-ab7d-21969c7ddc14 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:38.320887 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578857b3-1506-4e47-ab7d-21969c7ddc14 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:38.366960 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b90afa-14b1-4115-acd8-7607ae0f9271 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:38.422361 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eeb612-d218-477e-ad14-3b47679180ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:38.423096 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eeb612-d218-477e-ad14-3b47679180ef None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:38.423447 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eeb612-d218-477e-ad14-3b47679180ef None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:38.423806 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eeb612-d218-477e-ad14-3b47679180ef None admin] PATH_INFO: `/v3/projects/c883e45022464667b26d995f7ba3657d` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:38.424966 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93eeb612-d218-477e-ad14-3b47679180ef None admin] RBAC: Authorizing `identity:get_project(project_id=c883e45022464667b26d995f7ba3657d)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:38.426487 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93eeb612-d218-477e-ad14-3b47679180ef None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:38.428781 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 101/196] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Oct 4 11:39:38 2022] GET /identity/v3/projects/c883e45022464667b26d995f7ba3657d => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 11:39:38.429997 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511c33d8-2ff8-4529-aea7-b91fff7877ae None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:38.430322 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511c33d8-2ff8-4529-aea7-b91fff7877ae None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:38.435324 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511c33d8-2ff8-4529-aea7-b91fff7877ae None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:38.437059 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 102/197] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:39:38 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:39:38.437797 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511c33d8-2ff8-4529-aea7-b91fff7877ae None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:38.443051 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 96/198] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Oct 4 11:39:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 11:39:38.444725 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9784ea0d-545e-4ad4-a3ab-ee01c5a02e4b None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:38.445188 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9784ea0d-545e-4ad4-a3ab-ee01c5a02e4b None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:38.445653 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9784ea0d-545e-4ad4-a3ab-ee01c5a02e4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:38.468135 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-9784ea0d-545e-4ad4-a3ab-ee01c5a02e4b None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:39:38.469795 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-9784ea0d-545e-4ad4-a3ab-ee01c5a02e4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:39:38.476943 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:38.530871 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:38.566768 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 97/199] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:39:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 11:39:38.567617 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9784ea0d-545e-4ad4-a3ab-ee01c5a02e4b None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:38.571632 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511c33d8-2ff8-4529-aea7-b91fff7877ae None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:38.608303 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be141bd1-e71f-4da1-89de-aafdefd293b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:38.609106 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be141bd1-e71f-4da1-89de-aafdefd293b0 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:38.609185 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be141bd1-e71f-4da1-89de-aafdefd293b0 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:38.609449 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be141bd1-e71f-4da1-89de-aafdefd293b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:38.610169 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be141bd1-e71f-4da1-89de-aafdefd293b0 None admin] RBAC: Adding query filter params (role.id=d6e7421d1ff9451c808004b818354550, scope.project.id=c883e45022464667b26d995f7ba3657d, user.id=aa7220b65c3348289d244d64d4cf0797) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:39:38.610478 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be141bd1-e71f-4da1-89de-aafdefd293b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:38.611911 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be141bd1-e71f-4da1-89de-aafdefd293b0 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:38.624726 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 103/200] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Oct 4 11:39:38 2022] GET /identity/v3/role_assignments?user.id=aa7220b65c3348289d244d64d4cf0797&scope.project.id=c883e45022464667b26d995f7ba3657d&role.id=d6e7421d1ff9451c808004b818354550 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:39:38.719990 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9784ea0d-545e-4ad4-a3ab-ee01c5a02e4b None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:38.769729 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb53e89e-5ff7-49d7-8dc8-afd27cbc5210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:38.770402 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb53e89e-5ff7-49d7-8dc8-afd27cbc5210 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:38.770684 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb53e89e-5ff7-49d7-8dc8-afd27cbc5210 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:38.770963 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb53e89e-5ff7-49d7-8dc8-afd27cbc5210 None admin] PATH_INFO: `/v3/projects/c883e45022464667b26d995f7ba3657d` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:38.777491 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb53e89e-5ff7-49d7-8dc8-afd27cbc5210 None admin] RBAC: Authorizing `identity:get_project(project_id=c883e45022464667b26d995f7ba3657d)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:38.778995 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb53e89e-5ff7-49d7-8dc8-afd27cbc5210 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:38.780792 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 98/201] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Oct 4 11:39:38 2022] GET /identity/v3/projects/c883e45022464667b26d995f7ba3657d => generated 302 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:39:38.786841 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be141bd1-e71f-4da1-89de-aafdefd293b0 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:38.868955 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb53e89e-5ff7-49d7-8dc8-afd27cbc5210 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:38.895686 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be141bd1-e71f-4da1-89de-aafdefd293b0 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:38.897909 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:38.938001 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4629ff3-c0e7-4502-b28c-4ce42ae791ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:38.938619 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4629ff3-c0e7-4502-b28c-4ce42ae791ab None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:38.938895 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4629ff3-c0e7-4502-b28c-4ce42ae791ab None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:38.939163 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4629ff3-c0e7-4502-b28c-4ce42ae791ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:38.939892 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4629ff3-c0e7-4502-b28c-4ce42ae791ab None admin] RBAC: Adding query filter params (role.id=b6018afb40c74d19b8cadc402256f23d, scope.project.id=c883e45022464667b26d995f7ba3657d, user.id=aa7220b65c3348289d244d64d4cf0797) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:39:38.940198 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4629ff3-c0e7-4502-b28c-4ce42ae791ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:38.941668 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4629ff3-c0e7-4502-b28c-4ce42ae791ab None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:38.948416 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:38.957694 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 104/202] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Oct 4 11:39:38 2022] GET /identity/v3/role_assignments?user.id=aa7220b65c3348289d244d64d4cf0797&scope.project.id=c883e45022464667b26d995f7ba3657d&role.id=b6018afb40c74d19b8cadc402256f23d => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:39:39.032752 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb53e89e-5ff7-49d7-8dc8-afd27cbc5210 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:39.087361 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c80d4f-ca1c-46f6-8410-7c69083e1f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:39.088344 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c80d4f-ca1c-46f6-8410-7c69083e1f77 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:39.088816 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c80d4f-ca1c-46f6-8410-7c69083e1f77 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:39.089256 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c80d4f-ca1c-46f6-8410-7c69083e1f77 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:39.105878 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c80d4f-ca1c-46f6-8410-7c69083e1f77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 11:39:39.111166 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-65c80d4f-ca1c-46f6-8410-7c69083e1f77 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 11:39:39.111166 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:39:39.111166 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:39:39.111166 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:39:39.111166 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:39:39.111166 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:39:39.111166 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:39:39.111166 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:39:39.111166 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:39:39.111166 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:39:39.111166 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:39:39.111166 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:39:39.111166 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 11:39:39.111166 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 11:39:39.111166 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 11:39:39.111166 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 11:39:39.112122 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 11:39:39.112122 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 11:39:39.112122 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 11:39:39.112122 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 11:39:39.112122 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:39:39.112122 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:39:39.112122 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:39:39.112122 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:39:39.112122 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:39:39.112122 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:39:39.112122 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:39:39.112122 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:39:39.112122 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:39:39.112122 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:39:39.112122 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:39:39.112122 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:39:39.112959 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:39:39.112959 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:39:39.112959 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:39:39.112959 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:39:39.112959 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 11:39:39.112959 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 11:39:39.112959 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 11:39:39.112959 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 11:39:39.112959 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 11:39:39.112959 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 11:39:39.112959 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 11:39:39.112959 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:39:39.114859 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 99/203] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Oct 4 11:39:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:39:39.121869 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4629ff3-c0e7-4502-b28c-4ce42ae791ab None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:39.264462 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4629ff3-c0e7-4502-b28c-4ce42ae791ab None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:39.301525 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fb5ec3-07ee-4a5a-be8b-fba32581f4cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:39.302909 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fb5ec3-07ee-4a5a-be8b-fba32581f4cb None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:39.303091 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fb5ec3-07ee-4a5a-be8b-fba32581f4cb None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:39.303339 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fb5ec3-07ee-4a5a-be8b-fba32581f4cb None admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:39.304005 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fb5ec3-07ee-4a5a-be8b-fba32581f4cb None admin] RBAC: Adding query filter params (name=reader) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:39:39.304309 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fb5ec3-07ee-4a5a-be8b-fba32581f4cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:39.305747 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fb5ec3-07ee-4a5a-be8b-fba32581f4cb None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:39.314519 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 105/204] 10.222.0.59 () {56 vars in 1101 bytes} [Tue Oct 4 11:39:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:39:39.320936 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c80d4f-ca1c-46f6-8410-7c69083e1f77 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:39.436218 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c80d4f-ca1c-46f6-8410-7c69083e1f77 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:39.438587 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:39.480806 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5779661-867e-4a07-9718-56c0fb01791e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:39.482089 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5779661-867e-4a07-9718-56c0fb01791e None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:39.482729 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5779661-867e-4a07-9718-56c0fb01791e None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:39.483004 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5779661-867e-4a07-9718-56c0fb01791e None admin] PATH_INFO: `/v3/users/463ce5b316d942c6b709c01afe2fa163` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:39.484389 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5779661-867e-4a07-9718-56c0fb01791e None admin] RBAC: Authorizing `identity:get_user(user_id=463ce5b316d942c6b709c01afe2fa163)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:39.485889 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5779661-867e-4a07-9718-56c0fb01791e None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:39.487824 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 100/205] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Oct 4 11:39:39 2022] GET /identity/v3/users/463ce5b316d942c6b709c01afe2fa163 => generated 289 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:39:39.493835 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fb5ec3-07ee-4a5a-be8b-fba32581f4cb None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:39.532710 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:39.642598 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fb5ec3-07ee-4a5a-be8b-fba32581f4cb None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:39.678898 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512ff643-b1fb-414d-9edd-604544390b39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:39.679512 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512ff643-b1fb-414d-9edd-604544390b39 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:39.679795 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512ff643-b1fb-414d-9edd-604544390b39 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:39.680066 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512ff643-b1fb-414d-9edd-604544390b39 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:39.771266 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512ff643-b1fb-414d-9edd-604544390b39 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:39.772934 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512ff643-b1fb-414d-9edd-604544390b39 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:39.800408 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:39.906123 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 106/206] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Oct 4 11:39:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 11:39:39.911710 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5779661-867e-4a07-9718-56c0fb01791e None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:40.031253 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5779661-867e-4a07-9718-56c0fb01791e None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:40.077845 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a834ae6-73ee-4943-999b-0cb3b33efc2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:40.078412 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a834ae6-73ee-4943-999b-0cb3b33efc2d None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:40.078692 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a834ae6-73ee-4943-999b-0cb3b33efc2d None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:40.078962 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a834ae6-73ee-4943-999b-0cb3b33efc2d None admin] PATH_INFO: `/v3/projects/3cce5af9f73d46be89fb61b08e04e408` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:40.080117 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a834ae6-73ee-4943-999b-0cb3b33efc2d None admin] RBAC: Authorizing `identity:get_project(project_id=3cce5af9f73d46be89fb61b08e04e408)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:40.081645 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a834ae6-73ee-4943-999b-0cb3b33efc2d None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:40.083202 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 101/207] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Oct 4 11:39:39 2022] GET /identity/v3/projects/3cce5af9f73d46be89fb61b08e04e408 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:39:40.089520 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512ff643-b1fb-414d-9edd-604544390b39 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:40.211985 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512ff643-b1fb-414d-9edd-604544390b39 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:40.233921 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:40.255668 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc060df-c399-4710-9047-3b646467d035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:40.256822 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc060df-c399-4710-9047-3b646467d035 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:40.257108 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc060df-c399-4710-9047-3b646467d035 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:40.257382 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc060df-c399-4710-9047-3b646467d035 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:40.258111 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc060df-c399-4710-9047-3b646467d035 None admin] RBAC: Adding query filter params (role.id=c5fcdf1a59b947a38d056240a270eb26, scope.project.id=3cce5af9f73d46be89fb61b08e04e408, user.id=463ce5b316d942c6b709c01afe2fa163) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:39:40.258421 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc060df-c399-4710-9047-3b646467d035 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:40.259872 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc060df-c399-4710-9047-3b646467d035 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:40.266006 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 107/208] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Oct 4 11:39:40 2022] GET /identity/v3/role_assignments?user.id=463ce5b316d942c6b709c01afe2fa163&scope.project.id=3cce5af9f73d46be89fb61b08e04e408&role.id=c5fcdf1a59b947a38d056240a270eb26 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:39:40.611223 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e26dd0-2170-487c-8fa2-6d5e5ee679b8 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:40.611542 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e26dd0-2170-487c-8fa2-6d5e5ee679b8 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:40.611787 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e26dd0-2170-487c-8fa2-6d5e5ee679b8 None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:40.613434 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 102/209] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:39:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:39:40.622463 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ebbfc7-0935-469f-ab67-d76fbd456c5b None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:40.622767 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ebbfc7-0935-469f-ab67-d76fbd456c5b None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:40.623044 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ebbfc7-0935-469f-ab67-d76fbd456c5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:40.642016 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-a7ebbfc7-0935-469f-ab67-d76fbd456c5b None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:39:40.643202 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-a7ebbfc7-0935-469f-ab67-d76fbd456c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:39:40.725376 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 108/210] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:39:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 11:39:40.863644 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85110d6f-8db0-4a2b-88d5-e00748f83a2c None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:40.863934 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85110d6f-8db0-4a2b-88d5-e00748f83a2c None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:40.864222 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85110d6f-8db0-4a2b-88d5-e00748f83a2c None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:40.865804 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 103/211] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:39:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:39:40.871263 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f4fb72-88dc-42d2-b6bc-2b6c34e58f99 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:40.871557 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f4fb72-88dc-42d2-b6bc-2b6c34e58f99 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:40.871834 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f4fb72-88dc-42d2-b6bc-2b6c34e58f99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:40.892976 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-44f4fb72-88dc-42d2-b6bc-2b6c34e58f99 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:39:40.897125 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-44f4fb72-88dc-42d2-b6bc-2b6c34e58f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:39:40.969348 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 109/212] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:39:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 11:39:41.028159 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85110d6f-8db0-4a2b-88d5-e00748f83a2c None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:41.072099 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:41.130778 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85110d6f-8db0-4a2b-88d5-e00748f83a2c None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:41.165805 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2502c94c-62e6-443d-8951-93890bd18cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:41.166439 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2502c94c-62e6-443d-8951-93890bd18cb9 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:41.166711 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2502c94c-62e6-443d-8951-93890bd18cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:41.166979 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2502c94c-62e6-443d-8951-93890bd18cb9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:41.179239 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2502c94c-62e6-443d-8951-93890bd18cb9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 11:39:41.184009 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-2502c94c-62e6-443d-8951-93890bd18cb9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 11:39:41.184009 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:39:41.184009 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:39:41.184009 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:39:41.184009 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:39:41.184009 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:39:41.184009 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:39:41.184009 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:39:41.184009 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:39:41.184009 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:39:41.184009 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:39:41.184009 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:39:41.184009 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 11:39:41.184009 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 11:39:41.184009 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 11:39:41.184009 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 11:39:41.184900 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 11:39:41.184900 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 11:39:41.184900 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 11:39:41.184900 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 11:39:41.184900 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:39:41.184900 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:39:41.184900 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:39:41.184900 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:39:41.184900 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:39:41.184900 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:39:41.184900 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:39:41.184900 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:39:41.184900 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:39:41.184900 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:39:41.184900 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:39:41.184900 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:39:41.185700 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:39:41.185700 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:39:41.185700 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:39:41.185700 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:39:41.185700 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 11:39:41.185700 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 11:39:41.185700 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 11:39:41.185700 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 11:39:41.185700 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 11:39:41.185700 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 11:39:41.185700 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 11:39:41.185700 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:39:41.185700 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 104/213] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Oct 4 11:39:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:39:41.192382 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f4fb72-88dc-42d2-b6bc-2b6c34e58f99 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:41.241697 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:41.285214 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2502c94c-62e6-443d-8951-93890bd18cb9 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:41.301218 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f4fb72-88dc-42d2-b6bc-2b6c34e58f99 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:41.345631 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bdf045-0fae-4a7c-b30a-2249f19328eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:41.346396 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bdf045-0fae-4a7c-b30a-2249f19328eb None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:41.346774 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bdf045-0fae-4a7c-b30a-2249f19328eb None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:41.347145 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bdf045-0fae-4a7c-b30a-2249f19328eb None admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:41.347914 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bdf045-0fae-4a7c-b30a-2249f19328eb None admin] RBAC: Adding query filter params (name=member) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:39:41.348318 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bdf045-0fae-4a7c-b30a-2249f19328eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:41.351440 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bdf045-0fae-4a7c-b30a-2249f19328eb None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:41.361127 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 110/214] 10.222.0.59 () {56 vars in 1101 bytes} [Tue Oct 4 11:39:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:39:41.367524 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bdf045-0fae-4a7c-b30a-2249f19328eb None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:41.407493 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:41.411751 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2502c94c-62e6-443d-8951-93890bd18cb9 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:41.453030 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b61ff3-d9ad-476a-a483-c9ae66d95af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:41.454168 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b61ff3-d9ad-476a-a483-c9ae66d95af2 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:41.454519 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b61ff3-d9ad-476a-a483-c9ae66d95af2 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:41.454865 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b61ff3-d9ad-476a-a483-c9ae66d95af2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:41.456410 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b61ff3-d9ad-476a-a483-c9ae66d95af2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:41.458249 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b61ff3-d9ad-476a-a483-c9ae66d95af2 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:41.464770 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 105/215] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Oct 4 11:39:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 11:39:41.464770 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e76989-a99e-47ac-9e13-9878d653268b None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:41.464770 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e76989-a99e-47ac-9e13-9878d653268b None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:41.464770 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e76989-a99e-47ac-9e13-9878d653268b None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:41.464770 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 106/216] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:39:41 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:39:41.466343 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e76989-a99e-47ac-9e13-9878d653268b None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:41.486614 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bdf045-0fae-4a7c-b30a-2249f19328eb None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:41.494016 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:41.526339 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabec58d-5c5a-4d5f-a231-4f4012bdec18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:41.526972 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabec58d-5c5a-4d5f-a231-4f4012bdec18 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:41.527251 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabec58d-5c5a-4d5f-a231-4f4012bdec18 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:41.527522 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabec58d-5c5a-4d5f-a231-4f4012bdec18 None admin] PATH_INFO: `/v3/users/96c9e856910c473ea742344fa854fc69` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:41.544423 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabec58d-5c5a-4d5f-a231-4f4012bdec18 None admin] RBAC: Authorizing `identity:get_user(user_id=96c9e856910c473ea742344fa854fc69)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:41.546190 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabec58d-5c5a-4d5f-a231-4f4012bdec18 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:41.548955 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 111/217] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Oct 4 11:39:41 2022] GET /identity/v3/users/96c9e856910c473ea742344fa854fc69 => generated 297 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:39:41.553404 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaad2e9-57f2-4944-ba0d-56d06ab3f575 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:41.553873 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaad2e9-57f2-4944-ba0d-56d06ab3f575 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:41.554217 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaad2e9-57f2-4944-ba0d-56d06ab3f575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:41.572905 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-ebaad2e9-57f2-4944-ba0d-56d06ab3f575 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:39:41.574097 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-ebaad2e9-57f2-4944-ba0d-56d06ab3f575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:39:41.584730 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e76989-a99e-47ac-9e13-9878d653268b None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:41.623765 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66269306-4cda-486d-a48e-aaac8379d40f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:41.624351 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66269306-4cda-486d-a48e-aaac8379d40f None admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:41.624660 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66269306-4cda-486d-a48e-aaac8379d40f None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:41.624944 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66269306-4cda-486d-a48e-aaac8379d40f None admin] PATH_INFO: `/v3/users` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:41.625556 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66269306-4cda-486d-a48e-aaac8379d40f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:41.626976 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66269306-4cda-486d-a48e-aaac8379d40f None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:41.648055 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 112/218] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:39:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 11:39:41.648977 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaad2e9-57f2-4944-ba0d-56d06ab3f575 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:41.718661 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 107/219] 10.222.0.59 () {60 vars in 1132 bytes} [Tue Oct 4 11:39:41 2022] POST /identity/v3/users => generated 297 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 11:39:41.781141 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:41.789340 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaad2e9-57f2-4944-ba0d-56d06ab3f575 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:41.794173 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65bdbc2-5d68-4cdb-8e2c-d0351820af6c None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:41.794572 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65bdbc2-5d68-4cdb-8e2c-d0351820af6c None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:41.794905 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65bdbc2-5d68-4cdb-8e2c-d0351820af6c None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:41.796858 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 108/220] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:39:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:39:41.804306 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9213a5-676f-41c9-b17f-f8af3011ceb3 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:41.804687 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9213a5-676f-41c9-b17f-f8af3011ceb3 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:41.804886 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9213a5-676f-41c9-b17f-f8af3011ceb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:41.827122 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-3b9213a5-676f-41c9-b17f-f8af3011ceb3 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:39:41.828340 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-3b9213a5-676f-41c9-b17f-f8af3011ceb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:39:41.841211 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32be1ba3-b8aa-4daa-a53d-4d49920c4843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:41.843044 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32be1ba3-b8aa-4daa-a53d-4d49920c4843 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:41.843529 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32be1ba3-b8aa-4daa-a53d-4d49920c4843 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:41.844001 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32be1ba3-b8aa-4daa-a53d-4d49920c4843 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:41.849654 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:41.913210 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 109/221] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:39:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 11:39:41.956680 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9213a5-676f-41c9-b17f-f8af3011ceb3 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:41.979660 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32be1ba3-b8aa-4daa-a53d-4d49920c4843 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:41.981957 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32be1ba3-b8aa-4daa-a53d-4d49920c4843 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:42.111414 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9213a5-676f-41c9-b17f-f8af3011ceb3 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:42.120782 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:42.129500 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 113/222] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Oct 4 11:39:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 11:39:42.136467 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32be1ba3-b8aa-4daa-a53d-4d49920c4843 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:42.155088 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158b1d2f-e692-45eb-aac1-a8b77a6f7eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:42.156039 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158b1d2f-e692-45eb-aac1-a8b77a6f7eed None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:42.156320 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158b1d2f-e692-45eb-aac1-a8b77a6f7eed None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:42.157050 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158b1d2f-e692-45eb-aac1-a8b77a6f7eed None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:42.170505 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158b1d2f-e692-45eb-aac1-a8b77a6f7eed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 11:39:42.176537 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-158b1d2f-e692-45eb-aac1-a8b77a6f7eed None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 11:39:42.176537 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:39:42.176537 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:39:42.176537 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:39:42.176537 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:39:42.176537 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:39:42.176537 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:39:42.176537 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:39:42.176537 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:39:42.176537 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:39:42.176537 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:39:42.176537 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:39:42.176537 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 11:39:42.176537 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 11:39:42.176537 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 11:39:42.176537 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 11:39:42.177440 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 11:39:42.177440 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 11:39:42.177440 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 11:39:42.177440 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 11:39:42.177440 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:39:42.177440 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:39:42.177440 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:39:42.177440 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:39:42.177440 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:39:42.177440 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:39:42.177440 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:39:42.177440 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:39:42.177440 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:39:42.177440 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:39:42.177440 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:39:42.177440 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:39:42.179529 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:39:42.179529 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:39:42.179529 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:39:42.179529 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:39:42.179529 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 11:39:42.179529 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 11:39:42.179529 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 11:39:42.179529 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 11:39:42.179529 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 11:39:42.179529 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 11:39:42.179529 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 11:39:42.179529 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:39:42.179529 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 110/223] 10.222.0.59 () {56 vars in 1096 bytes} [Tue Oct 4 11:39:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 11:39:42.185182 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158b1d2f-e692-45eb-aac1-a8b77a6f7eed None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:42.207637 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:42.267877 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32be1ba3-b8aa-4daa-a53d-4d49920c4843 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:42.307705 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24665efb-5b73-412a-a848-c82b9a123a91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:42.308721 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24665efb-5b73-412a-a848-c82b9a123a91 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:42.309342 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24665efb-5b73-412a-a848-c82b9a123a91 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:42.309838 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24665efb-5b73-412a-a848-c82b9a123a91 None admin] PATH_INFO: `/v3/projects/c883e45022464667b26d995f7ba3657d` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:42.311178 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24665efb-5b73-412a-a848-c82b9a123a91 None admin] RBAC: Authorizing `identity:get_project(project_id=c883e45022464667b26d995f7ba3657d)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:42.312853 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24665efb-5b73-412a-a848-c82b9a123a91 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:42.314673 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 114/224] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Oct 4 11:39:42 2022] GET /identity/v3/projects/c883e45022464667b26d995f7ba3657d => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 11:39:42.320623 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24665efb-5b73-412a-a848-c82b9a123a91 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:42.320793 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158b1d2f-e692-45eb-aac1-a8b77a6f7eed None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:42.370941 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b56b090-2da9-4d3e-ae52-12c2d9414efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:42.371566 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b56b090-2da9-4d3e-ae52-12c2d9414efc None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:42.371847 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b56b090-2da9-4d3e-ae52-12c2d9414efc None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:42.372118 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b56b090-2da9-4d3e-ae52-12c2d9414efc None admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:42.373271 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b56b090-2da9-4d3e-ae52-12c2d9414efc None admin] RBAC: Adding query filter params (name=admin) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:39:42.373586 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b56b090-2da9-4d3e-ae52-12c2d9414efc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:42.375260 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b56b090-2da9-4d3e-ae52-12c2d9414efc None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:42.387774 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 111/225] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Oct 4 11:39:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:39:42.388913 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b56b090-2da9-4d3e-ae52-12c2d9414efc None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:42.393680 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:42.445154 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24665efb-5b73-412a-a848-c82b9a123a91 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:42.481429 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8a25da-c3f3-42fc-92ad-f3241df35f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:42.482431 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8a25da-c3f3-42fc-92ad-f3241df35f30 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:42.482906 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8a25da-c3f3-42fc-92ad-f3241df35f30 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:42.483395 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8a25da-c3f3-42fc-92ad-f3241df35f30 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:42.488229 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:42.495430 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8a25da-c3f3-42fc-92ad-f3241df35f30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 11:39:42.501162 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-8f8a25da-c3f3-42fc-92ad-f3241df35f30 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 11:39:42.501162 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:39:42.501162 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:39:42.501162 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:39:42.501162 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:39:42.501162 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:39:42.501162 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:39:42.501162 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:39:42.501162 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:39:42.501162 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:39:42.501162 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:39:42.501162 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:39:42.501162 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 11:39:42.501162 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 11:39:42.501162 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 11:39:42.501162 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 11:39:42.502076 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 11:39:42.502076 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 11:39:42.502076 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 11:39:42.502076 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 11:39:42.502076 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:39:42.502076 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:39:42.502076 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:39:42.502076 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:39:42.502076 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:39:42.502076 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:39:42.502076 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:39:42.502076 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:39:42.502076 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:39:42.502076 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:39:42.502076 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:39:42.502076 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:39:42.503012 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:39:42.503012 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:39:42.503012 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:39:42.503012 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:39:42.503012 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 11:39:42.503012 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 11:39:42.503012 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 11:39:42.503012 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 11:39:42.503012 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 11:39:42.503012 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 11:39:42.503012 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 11:39:42.503012 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:39:42.506288 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 115/226] 10.222.0.59 () {56 vars in 1114 bytes} [Tue Oct 4 11:39:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:39:42.513111 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8a25da-c3f3-42fc-92ad-f3241df35f30 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:42.529362 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b56b090-2da9-4d3e-ae52-12c2d9414efc None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:42.570996 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba3448b-0191-4093-8ea0-14c0fb153496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:42.571960 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba3448b-0191-4093-8ea0-14c0fb153496 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:42.572456 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba3448b-0191-4093-8ea0-14c0fb153496 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:42.572954 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba3448b-0191-4093-8ea0-14c0fb153496 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:42.573864 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba3448b-0191-4093-8ea0-14c0fb153496 None admin] RBAC: Adding query filter params (role.id=ab4307f3b7994c1c80036fa7db93b6b9, scope.project.id=c883e45022464667b26d995f7ba3657d, user.id=96c9e856910c473ea742344fa854fc69) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:39:42.574364 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba3448b-0191-4093-8ea0-14c0fb153496 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:42.576053 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba3448b-0191-4093-8ea0-14c0fb153496 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:42.582460 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 112/227] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Oct 4 11:39:42 2022] GET /identity/v3/role_assignments?user.id=96c9e856910c473ea742344fa854fc69&scope.project.id=c883e45022464667b26d995f7ba3657d&role.id=ab4307f3b7994c1c80036fa7db93b6b9 => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:39:42.590041 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba3448b-0191-4093-8ea0-14c0fb153496 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:42.644730 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8a25da-c3f3-42fc-92ad-f3241df35f30 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:42.671553 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:42.686639 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4489e8-ca72-422e-a349-a3799cbb5c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:42.689978 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4489e8-ca72-422e-a349-a3799cbb5c0d None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:42.689978 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4489e8-ca72-422e-a349-a3799cbb5c0d None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:42.689978 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4489e8-ca72-422e-a349-a3799cbb5c0d None admin] PATH_INFO: `/v3/users/aa7220b65c3348289d244d64d4cf0797` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:42.689978 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4489e8-ca72-422e-a349-a3799cbb5c0d None admin] RBAC: Authorizing `identity:get_user(user_id=aa7220b65c3348289d244d64d4cf0797)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:42.691166 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4489e8-ca72-422e-a349-a3799cbb5c0d None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:42.692844 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 116/228] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Oct 4 11:39:42 2022] GET /identity/v3/users/aa7220b65c3348289d244d64d4cf0797 => generated 283 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:39:42.698717 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4489e8-ca72-422e-a349-a3799cbb5c0d None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:42.842103 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba3448b-0191-4093-8ea0-14c0fb153496 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:42.883393 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4489e8-ca72-422e-a349-a3799cbb5c0d None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:42.906065 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ce7fd6-2d89-4f83-9373-f704c2651de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:42.906680 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ce7fd6-2d89-4f83-9373-f704c2651de1 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:42.906954 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ce7fd6-2d89-4f83-9373-f704c2651de1 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:42.907302 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ce7fd6-2d89-4f83-9373-f704c2651de1 None admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:42.907963 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ce7fd6-2d89-4f83-9373-f704c2651de1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:39:42.908264 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ce7fd6-2d89-4f83-9373-f704c2651de1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:42.909721 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ce7fd6-2d89-4f83-9373-f704c2651de1 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:42.932581 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 113/229] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Oct 4 11:39:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:39:42.939096 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ce7fd6-2d89-4f83-9373-f704c2651de1 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:42.943320 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:42.962911 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027b230d-995f-4be5-a84f-1bc241babaa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:42.964636 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027b230d-995f-4be5-a84f-1bc241babaa6 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:42.964636 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027b230d-995f-4be5-a84f-1bc241babaa6 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:42.964636 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027b230d-995f-4be5-a84f-1bc241babaa6 None admin] PATH_INFO: `/v3/projects/c883e45022464667b26d995f7ba3657d` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:42.965630 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027b230d-995f-4be5-a84f-1bc241babaa6 None admin] RBAC: Authorizing `identity:get_project(project_id=c883e45022464667b26d995f7ba3657d)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:42.969101 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027b230d-995f-4be5-a84f-1bc241babaa6 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:42.972995 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 117/230] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Oct 4 11:39:42 2022] GET /identity/v3/projects/c883e45022464667b26d995f7ba3657d => generated 302 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:39:42.983081 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027b230d-995f-4be5-a84f-1bc241babaa6 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:43.083055 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:43.128707 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ce7fd6-2d89-4f83-9373-f704c2651de1 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:43.159785 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b591cb0e-4dfe-4c46-b014-eb7422533e10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:43.160639 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b591cb0e-4dfe-4c46-b014-eb7422533e10 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:43.160767 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b591cb0e-4dfe-4c46-b014-eb7422533e10 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:43.161000 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b591cb0e-4dfe-4c46-b014-eb7422533e10 None admin] PATH_INFO: `/v3/users/aa7220b65c3348289d244d64d4cf0797` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:43.163313 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b591cb0e-4dfe-4c46-b014-eb7422533e10 None admin] RBAC: Authorizing `identity:get_user(user_id=aa7220b65c3348289d244d64d4cf0797)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:43.168644 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b591cb0e-4dfe-4c46-b014-eb7422533e10 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:43.168644 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 114/231] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Oct 4 11:39:42 2022] GET /identity/v3/users/aa7220b65c3348289d244d64d4cf0797 => generated 283 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 11:39:43.171811 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b591cb0e-4dfe-4c46-b014-eb7422533e10 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:43.176249 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027b230d-995f-4be5-a84f-1bc241babaa6 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:43.218564 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599bdffe-2dbe-4c71-9cba-c4b59ca9c2f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:43.219557 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599bdffe-2dbe-4c71-9cba-c4b59ca9c2f7 None admin] REQUEST_METHOD: `PUT` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:43.220044 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599bdffe-2dbe-4c71-9cba-c4b59ca9c2f7 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:43.220542 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599bdffe-2dbe-4c71-9cba-c4b59ca9c2f7 None admin] PATH_INFO: `/v3/projects/c883e45022464667b26d995f7ba3657d/users/aa7220b65c3348289d244d64d4cf0797/roles/d6e7421d1ff9451c808004b818354550` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:43.222669 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599bdffe-2dbe-4c71-9cba-c4b59ca9c2f7 None admin] RBAC: Authorizing `identity:create_grant(project_id=c883e45022464667b26d995f7ba3657d, user_id=aa7220b65c3348289d244d64d4cf0797, role_id=d6e7421d1ff9451c808004b818354550)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:43.225284 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599bdffe-2dbe-4c71-9cba-c4b59ca9c2f7 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:43.248690 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:43.281046 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b591cb0e-4dfe-4c46-b014-eb7422533e10 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:43.316511 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 118/232] 10.222.0.59 () {58 vars in 1439 bytes} [Tue Oct 4 11:39:42 2022] PUT /identity/v3/projects/c883e45022464667b26d995f7ba3657d/users/aa7220b65c3348289d244d64d4cf0797/roles/d6e7421d1ff9451c808004b818354550 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 11:39:43.323387 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7efb5b-9b3e-4df4-a1eb-22767f1b3a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:43.324054 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7efb5b-9b3e-4df4-a1eb-22767f1b3a73 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:43.324332 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7efb5b-9b3e-4df4-a1eb-22767f1b3a73 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:43.324619 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7efb5b-9b3e-4df4-a1eb-22767f1b3a73 None admin] PATH_INFO: `/v3/projects/c883e45022464667b26d995f7ba3657d` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:43.329519 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7efb5b-9b3e-4df4-a1eb-22767f1b3a73 None admin] RBAC: Authorizing `identity:get_project(project_id=c883e45022464667b26d995f7ba3657d)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:43.331034 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7efb5b-9b3e-4df4-a1eb-22767f1b3a73 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:43.332845 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 115/233] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Oct 4 11:39:43 2022] GET /identity/v3/projects/c883e45022464667b26d995f7ba3657d => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 11:39:43.340102 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599bdffe-2dbe-4c71-9cba-c4b59ca9c2f7 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:43.485808 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599bdffe-2dbe-4c71-9cba-c4b59ca9c2f7 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:43.512976 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:43.528186 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431fb58e-a296-4baa-8e6b-4cf7b6e58948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:43.528895 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431fb58e-a296-4baa-8e6b-4cf7b6e58948 None admin] REQUEST_METHOD: `PUT` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:43.529172 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431fb58e-a296-4baa-8e6b-4cf7b6e58948 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:43.537055 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431fb58e-a296-4baa-8e6b-4cf7b6e58948 None admin] PATH_INFO: `/v3/projects/c883e45022464667b26d995f7ba3657d/users/aa7220b65c3348289d244d64d4cf0797/roles/b6018afb40c74d19b8cadc402256f23d` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:43.537055 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431fb58e-a296-4baa-8e6b-4cf7b6e58948 None admin] RBAC: Authorizing `identity:create_grant(project_id=c883e45022464667b26d995f7ba3657d, user_id=aa7220b65c3348289d244d64d4cf0797, role_id=b6018afb40c74d19b8cadc402256f23d)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:43.537055 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431fb58e-a296-4baa-8e6b-4cf7b6e58948 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:43.670822 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 119/234] 10.222.0.59 () {58 vars in 1439 bytes} [Tue Oct 4 11:39:43 2022] PUT /identity/v3/projects/c883e45022464667b26d995f7ba3657d/users/aa7220b65c3348289d244d64d4cf0797/roles/b6018afb40c74d19b8cadc402256f23d => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 11:39:44.396075 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea8265b-9a8e-4a96-97a9-ad381dc2c904 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:44.397343 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea8265b-9a8e-4a96-97a9-ad381dc2c904 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:44.397343 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea8265b-9a8e-4a96-97a9-ad381dc2c904 None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:44.399380 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 116/235] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:39:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:39:44.405270 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba58e95-e706-49c5-a4cb-8bad8c246e43 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:44.405714 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba58e95-e706-49c5-a4cb-8bad8c246e43 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:44.405815 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba58e95-e706-49c5-a4cb-8bad8c246e43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:44.429295 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-3ba58e95-e706-49c5-a4cb-8bad8c246e43 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:39:44.430492 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-3ba58e95-e706-49c5-a4cb-8bad8c246e43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:39:44.550852 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 120/236] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:39:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 11:39:44.596458 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fdd309-7ae3-4bda-9df0-c16759a7772c None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:44.596811 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fdd309-7ae3-4bda-9df0-c16759a7772c None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:44.597037 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fdd309-7ae3-4bda-9df0-c16759a7772c None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:44.598652 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 117/237] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:39:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:39:44.604387 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a7c6cc-ed35-4636-b907-3534d072d116 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:44.604692 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a7c6cc-ed35-4636-b907-3534d072d116 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:44.604966 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a7c6cc-ed35-4636-b907-3534d072d116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:44.641568 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-39a7c6cc-ed35-4636-b907-3534d072d116 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:39:44.642761 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-39a7c6cc-ed35-4636-b907-3534d072d116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:39:44.742367 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 121/238] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:39:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 11:39:44.898253 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fdd309-7ae3-4bda-9df0-c16759a7772c None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:45.033431 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fdd309-7ae3-4bda-9df0-c16759a7772c None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:45.076229 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fdb727-4216-4830-bab7-4ea0c7513de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:45.076886 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fdb727-4216-4830-bab7-4ea0c7513de2 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:45.077163 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fdb727-4216-4830-bab7-4ea0c7513de2 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:45.077434 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fdb727-4216-4830-bab7-4ea0c7513de2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:45.087885 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:45.093759 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fdb727-4216-4830-bab7-4ea0c7513de2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 11:39:45.098562 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-82fdb727-4216-4830-bab7-4ea0c7513de2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 11:39:45.098562 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:39:45.098562 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:39:45.098562 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:39:45.098562 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:39:45.098562 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:39:45.098562 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:39:45.098562 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:39:45.098562 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:39:45.098562 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:39:45.098562 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:39:45.098562 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:39:45.098562 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 11:39:45.098562 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 11:39:45.098562 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 11:39:45.098562 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 11:39:45.106334 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 11:39:45.106334 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 11:39:45.106334 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 11:39:45.106334 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 11:39:45.106334 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:39:45.106334 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:39:45.106334 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:39:45.106334 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:39:45.106334 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:39:45.106334 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:39:45.106334 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:39:45.106334 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:39:45.106334 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:39:45.106334 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:39:45.106334 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:39:45.106334 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:39:45.108490 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:39:45.108490 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:39:45.108490 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:39:45.108490 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:39:45.108490 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 11:39:45.108490 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 11:39:45.108490 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 11:39:45.108490 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 11:39:45.108490 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 11:39:45.108490 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 11:39:45.108490 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 11:39:45.108490 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:39:45.108490 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 118/239] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Oct 4 11:39:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:39:45.110611 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fdb727-4216-4830-bab7-4ea0c7513de2 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:45.111748 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a7c6cc-ed35-4636-b907-3534d072d116 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:45.221636 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:45.261673 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fdb727-4216-4830-bab7-4ea0c7513de2 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:45.302236 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79803c7-098d-45f4-8e89-9efa51ded5c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:45.303351 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79803c7-098d-45f4-8e89-9efa51ded5c6 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:45.303634 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79803c7-098d-45f4-8e89-9efa51ded5c6 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:45.303909 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79803c7-098d-45f4-8e89-9efa51ded5c6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:45.311578 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79803c7-098d-45f4-8e89-9efa51ded5c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:45.313079 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79803c7-098d-45f4-8e89-9efa51ded5c6 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:45.315640 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 119/240] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Oct 4 11:39:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:39:45.320423 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45efb859-9bde-40bf-bead-0309855cc6db None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:45.320852 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45efb859-9bde-40bf-bead-0309855cc6db None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:45.321135 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45efb859-9bde-40bf-bead-0309855cc6db None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:45.323842 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 120/241] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:39:45 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:39:45.325524 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45efb859-9bde-40bf-bead-0309855cc6db None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:45.348130 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a7c6cc-ed35-4636-b907-3534d072d116 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:45.396953 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62437ae4-7351-40b0-8c44-e12671cd2c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:45.396953 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62437ae4-7351-40b0-8c44-e12671cd2c0c None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:45.396953 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62437ae4-7351-40b0-8c44-e12671cd2c0c None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:45.396953 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62437ae4-7351-40b0-8c44-e12671cd2c0c None admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:45.397435 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62437ae4-7351-40b0-8c44-e12671cd2c0c None admin] RBAC: Adding query filter params (name=reader) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:39:45.397435 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62437ae4-7351-40b0-8c44-e12671cd2c0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:45.398049 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62437ae4-7351-40b0-8c44-e12671cd2c0c None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:45.406785 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 122/242] 10.222.0.59 () {56 vars in 1101 bytes} [Tue Oct 4 11:39:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:39:45.407990 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9971ed-d522-4005-9913-f8e52c1a8b63 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:45.408278 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9971ed-d522-4005-9913-f8e52c1a8b63 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:45.408554 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9971ed-d522-4005-9913-f8e52c1a8b63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:45.420512 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:45.428539 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-5e9971ed-d522-4005-9913-f8e52c1a8b63 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:39:45.429807 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-5e9971ed-d522-4005-9913-f8e52c1a8b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:39:45.459803 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45efb859-9bde-40bf-bead-0309855cc6db None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:45.516928 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 123/243] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:39:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 11:39:45.517150 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d3d9d2-db44-4de8-8c77-37067ae7a5e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:45.517281 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9971ed-d522-4005-9913-f8e52c1a8b63 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:45.517384 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d3d9d2-db44-4de8-8c77-37067ae7a5e7 None admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:45.517384 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d3d9d2-db44-4de8-8c77-37067ae7a5e7 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:45.517384 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d3d9d2-db44-4de8-8c77-37067ae7a5e7 None admin] PATH_INFO: `/v3/users` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:45.517384 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d3d9d2-db44-4de8-8c77-37067ae7a5e7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:45.525257 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d3d9d2-db44-4de8-8c77-37067ae7a5e7 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:45.561638 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:45.624448 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 121/244] 10.222.0.59 () {60 vars in 1132 bytes} [Tue Oct 4 11:39:45 2022] POST /identity/v3/users => generated 293 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 11:39:45.668648 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9971ed-d522-4005-9913-f8e52c1a8b63 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:45.722371 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6e65f3-bc51-41b3-899b-0216c4f15416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:45.723100 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6e65f3-bc51-41b3-899b-0216c4f15416 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:45.723409 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6e65f3-bc51-41b3-899b-0216c4f15416 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:45.723656 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6e65f3-bc51-41b3-899b-0216c4f15416 None admin] PATH_INFO: `/v3/users/b9fadaf3c07243c295ce5353fc74e0c5` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:45.743938 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6e65f3-bc51-41b3-899b-0216c4f15416 None admin] RBAC: Authorizing `identity:get_user(user_id=b9fadaf3c07243c295ce5353fc74e0c5)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:45.745981 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6e65f3-bc51-41b3-899b-0216c4f15416 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:45.748502 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 124/245] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Oct 4 11:39:45 2022] GET /identity/v3/users/b9fadaf3c07243c295ce5353fc74e0c5 => generated 297 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:39:45.754595 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d3d9d2-db44-4de8-8c77-37067ae7a5e7 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:45.921793 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d3d9d2-db44-4de8-8c77-37067ae7a5e7 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:45.947927 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6e65f3-bc51-41b3-899b-0216c4f15416 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:45.954890 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:45.976059 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d5fa7e-a14b-4b43-89bd-4c2a45de75ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:45.978812 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d5fa7e-a14b-4b43-89bd-4c2a45de75ec None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:45.978812 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d5fa7e-a14b-4b43-89bd-4c2a45de75ec None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:45.978812 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d5fa7e-a14b-4b43-89bd-4c2a45de75ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:46.094867 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:46.109865 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d5fa7e-a14b-4b43-89bd-4c2a45de75ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:46.112252 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d5fa7e-a14b-4b43-89bd-4c2a45de75ec None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:46.113964 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6e65f3-bc51-41b3-899b-0216c4f15416 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:46.159664 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e99b152-74b8-4bbd-9e4f-e60ff6a28fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:46.160380 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e99b152-74b8-4bbd-9e4f-e60ff6a28fb4 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:46.160728 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e99b152-74b8-4bbd-9e4f-e60ff6a28fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:46.161493 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e99b152-74b8-4bbd-9e4f-e60ff6a28fb4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:46.181345 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e99b152-74b8-4bbd-9e4f-e60ff6a28fb4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 11:39:46.186616 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-7e99b152-74b8-4bbd-9e4f-e60ff6a28fb4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 11:39:46.186616 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:39:46.186616 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:39:46.186616 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:39:46.186616 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:39:46.186616 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:39:46.186616 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:39:46.186616 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:39:46.186616 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:39:46.186616 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:39:46.186616 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:39:46.186616 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:39:46.186616 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 11:39:46.186616 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 11:39:46.186616 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 11:39:46.186616 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 11:39:46.187548 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 11:39:46.187548 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 11:39:46.187548 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 11:39:46.187548 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 11:39:46.187548 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:39:46.187548 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:39:46.187548 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:39:46.187548 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:39:46.187548 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:39:46.187548 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:39:46.187548 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:39:46.187548 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:39:46.187548 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:39:46.187548 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:39:46.187548 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:39:46.187548 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:39:46.188354 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:39:46.188354 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:39:46.188354 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:39:46.188354 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:39:46.188354 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 11:39:46.188354 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 11:39:46.188354 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 11:39:46.188354 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 11:39:46.188354 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 11:39:46.188354 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 11:39:46.188354 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 11:39:46.188354 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:39:46.188354 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 125/246] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Oct 4 11:39:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:39:46.190176 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414b6072-e73b-439a-adf6-e529f2ec79b1 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:46.190588 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414b6072-e73b-439a-adf6-e529f2ec79b1 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:46.191250 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414b6072-e73b-439a-adf6-e529f2ec79b1 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:46.192092 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 126/247] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:39:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:39:46.202389 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6379f0d-3169-4c47-bf33-44308f8eade7 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:46.202802 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6379f0d-3169-4c47-bf33-44308f8eade7 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:46.203036 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6379f0d-3169-4c47-bf33-44308f8eade7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:46.228857 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-d6379f0d-3169-4c47-bf33-44308f8eade7 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:39:46.231297 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-d6379f0d-3169-4c47-bf33-44308f8eade7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:39:46.278029 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 122/248] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Oct 4 11:39:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 524 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 04 11:39:46.279677 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d5fa7e-a14b-4b43-89bd-4c2a45de75ec None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:46.317412 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:46.342404 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 127/249] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:39:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 11:39:46.343371 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6379f0d-3169-4c47-bf33-44308f8eade7 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:46.419962 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d5fa7e-a14b-4b43-89bd-4c2a45de75ec None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:46.464161 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadc6394-c5a6-4842-8fb4-4d75350ef0bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:46.465036 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadc6394-c5a6-4842-8fb4-4d75350ef0bd None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:46.465317 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadc6394-c5a6-4842-8fb4-4d75350ef0bd None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:46.465588 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadc6394-c5a6-4842-8fb4-4d75350ef0bd None admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:46.466261 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadc6394-c5a6-4842-8fb4-4d75350ef0bd None admin] RBAC: Adding query filter params (name=member) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:39:46.466561 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadc6394-c5a6-4842-8fb4-4d75350ef0bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:46.468037 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadc6394-c5a6-4842-8fb4-4d75350ef0bd None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:46.479118 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 123/250] 10.222.0.59 () {56 vars in 1101 bytes} [Tue Oct 4 11:39:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:39:46.485257 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadc6394-c5a6-4842-8fb4-4d75350ef0bd None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:46.566160 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:46.624153 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6379f0d-3169-4c47-bf33-44308f8eade7 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:46.628945 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:46.670101 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadc6394-c5a6-4842-8fb4-4d75350ef0bd None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:46.702962 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6760dba-7f2d-4e35-bf58-9a54148383a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:46.704085 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6760dba-7f2d-4e35-bf58-9a54148383a8 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:46.704706 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6760dba-7f2d-4e35-bf58-9a54148383a8 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:46.706259 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6760dba-7f2d-4e35-bf58-9a54148383a8 None admin] PATH_INFO: `/v3/projects/c883e45022464667b26d995f7ba3657d` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:46.708266 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6760dba-7f2d-4e35-bf58-9a54148383a8 None admin] RBAC: Authorizing `identity:get_project(project_id=c883e45022464667b26d995f7ba3657d)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:46.710154 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6760dba-7f2d-4e35-bf58-9a54148383a8 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:46.712852 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 128/251] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Oct 4 11:39:46 2022] GET /identity/v3/projects/c883e45022464667b26d995f7ba3657d => generated 302 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:39:46.714432 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea51cf23-914f-474c-8836-80cdfcc0baeb None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:46.714961 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea51cf23-914f-474c-8836-80cdfcc0baeb None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:46.715487 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea51cf23-914f-474c-8836-80cdfcc0baeb None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:46.717941 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 129/252] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:39:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:39:46.719243 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8ee5df-5296-4a71-922b-0b29b15ac5c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:46.719917 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8ee5df-5296-4a71-922b-0b29b15ac5c5 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:46.720204 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8ee5df-5296-4a71-922b-0b29b15ac5c5 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:46.720478 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8ee5df-5296-4a71-922b-0b29b15ac5c5 None admin] PATH_INFO: `/v3/users/96c9e856910c473ea742344fa854fc69` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:46.722092 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8ee5df-5296-4a71-922b-0b29b15ac5c5 None admin] RBAC: Authorizing `identity:get_user(user_id=96c9e856910c473ea742344fa854fc69)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:46.728297 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08faa2c3-b363-471a-9c1a-ae69ba25019d None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:46.730476 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8ee5df-5296-4a71-922b-0b29b15ac5c5 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:46.731021 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08faa2c3-b363-471a-9c1a-ae69ba25019d None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:46.732984 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08faa2c3-b363-471a-9c1a-ae69ba25019d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:46.736250 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 124/253] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Oct 4 11:39:46 2022] GET /identity/v3/users/96c9e856910c473ea742344fa854fc69 => generated 297 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 11:39:46.737371 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8ee5df-5296-4a71-922b-0b29b15ac5c5 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:46.773647 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-08faa2c3-b363-471a-9c1a-ae69ba25019d None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:39:46.776456 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-08faa2c3-b363-471a-9c1a-ae69ba25019d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:39:46.883277 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 130/254] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:39:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 11:39:46.884648 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08faa2c3-b363-471a-9c1a-ae69ba25019d None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:46.946547 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8ee5df-5296-4a71-922b-0b29b15ac5c5 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:47.015548 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eaadcb-e15f-4061-94f2-6fbc3e241cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:47.016087 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eaadcb-e15f-4061-94f2-6fbc3e241cf7 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:47.016366 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eaadcb-e15f-4061-94f2-6fbc3e241cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:47.016653 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eaadcb-e15f-4061-94f2-6fbc3e241cf7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:47.017452 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7eaadcb-e15f-4061-94f2-6fbc3e241cf7 None admin] RBAC: Adding query filter params (role.id=c5fcdf1a59b947a38d056240a270eb26, scope.project.id=c883e45022464667b26d995f7ba3657d, user.id=b9fadaf3c07243c295ce5353fc74e0c5) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:39:47.017761 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7eaadcb-e15f-4061-94f2-6fbc3e241cf7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:47.019187 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7eaadcb-e15f-4061-94f2-6fbc3e241cf7 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:47.028964 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:47.029841 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 125/255] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Oct 4 11:39:46 2022] GET /identity/v3/role_assignments?user.id=b9fadaf3c07243c295ce5353fc74e0c5&scope.project.id=c883e45022464667b26d995f7ba3657d&role.id=c5fcdf1a59b947a38d056240a270eb26 => generated 259 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:39:47.032332 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eaadcb-e15f-4061-94f2-6fbc3e241cf7 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:47.057914 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08faa2c3-b363-471a-9c1a-ae69ba25019d None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:47.077078 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:47.124250 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5359d2a-9a4a-498f-a7b6-559f7dbe2398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:47.124936 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5359d2a-9a4a-498f-a7b6-559f7dbe2398 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:47.125215 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5359d2a-9a4a-498f-a7b6-559f7dbe2398 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:47.125490 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5359d2a-9a4a-498f-a7b6-559f7dbe2398 None admin] PATH_INFO: `/v3/projects/c883e45022464667b26d995f7ba3657d` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:47.126781 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5359d2a-9a4a-498f-a7b6-559f7dbe2398 None admin] RBAC: Authorizing `identity:get_project(project_id=c883e45022464667b26d995f7ba3657d)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:47.128357 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5359d2a-9a4a-498f-a7b6-559f7dbe2398 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:47.135569 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 131/256] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Oct 4 11:39:46 2022] GET /identity/v3/projects/c883e45022464667b26d995f7ba3657d => generated 302 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:39:47.137837 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5359d2a-9a4a-498f-a7b6-559f7dbe2398 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:47.261528 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eaadcb-e15f-4061-94f2-6fbc3e241cf7 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:47.263170 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5359d2a-9a4a-498f-a7b6-559f7dbe2398 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:47.309086 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346f9d9c-536c-4ebf-ac4b-a5bb61f9ef71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:47.309692 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346f9d9c-536c-4ebf-ac4b-a5bb61f9ef71 None admin] REQUEST_METHOD: `PUT` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:47.309968 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346f9d9c-536c-4ebf-ac4b-a5bb61f9ef71 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:47.310238 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346f9d9c-536c-4ebf-ac4b-a5bb61f9ef71 None admin] PATH_INFO: `/v3/projects/c883e45022464667b26d995f7ba3657d/users/96c9e856910c473ea742344fa854fc69/roles/ab4307f3b7994c1c80036fa7db93b6b9` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:47.314185 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346f9d9c-536c-4ebf-ac4b-a5bb61f9ef71 None admin] RBAC: Authorizing `identity:create_grant(project_id=c883e45022464667b26d995f7ba3657d, user_id=96c9e856910c473ea742344fa854fc69, role_id=ab4307f3b7994c1c80036fa7db93b6b9)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:47.315719 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346f9d9c-536c-4ebf-ac4b-a5bb61f9ef71 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:47.336954 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37d440b-6fff-4722-8f3d-a378bef6a08e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:47.337666 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37d440b-6fff-4722-8f3d-a378bef6a08e None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:47.337944 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37d440b-6fff-4722-8f3d-a378bef6a08e None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:47.338211 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37d440b-6fff-4722-8f3d-a378bef6a08e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:47.353984 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37d440b-6fff-4722-8f3d-a378bef6a08e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 11:39:47.359952 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-a37d440b-6fff-4722-8f3d-a378bef6a08e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 11:39:47.359952 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:39:47.359952 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:39:47.359952 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:39:47.359952 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:39:47.359952 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:39:47.359952 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:39:47.359952 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:39:47.359952 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:39:47.359952 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:39:47.359952 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:39:47.359952 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:39:47.359952 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 11:39:47.359952 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 11:39:47.359952 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 11:39:47.359952 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 11:39:47.360882 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 11:39:47.360882 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 11:39:47.360882 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 11:39:47.360882 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 11:39:47.360882 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:39:47.360882 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:39:47.360882 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:39:47.360882 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:39:47.360882 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:39:47.360882 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:39:47.360882 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:39:47.360882 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:39:47.360882 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:39:47.360882 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:39:47.360882 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:39:47.360882 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:39:47.361715 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:39:47.361715 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:39:47.361715 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:39:47.361715 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:39:47.361715 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 11:39:47.361715 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 11:39:47.361715 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 11:39:47.361715 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 11:39:47.361715 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 11:39:47.361715 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 11:39:47.361715 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 11:39:47.361715 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:39:47.361715 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 126/257] 10.222.0.59 () {56 vars in 1096 bytes} [Tue Oct 4 11:39:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:39:47.367750 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37d440b-6fff-4722-8f3d-a378bef6a08e None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:47.413430 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 132/258] 10.222.0.59 () {58 vars in 1439 bytes} [Tue Oct 4 11:39:47 2022] PUT /identity/v3/projects/c883e45022464667b26d995f7ba3657d/users/96c9e856910c473ea742344fa854fc69/roles/ab4307f3b7994c1c80036fa7db93b6b9 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 11:39:47.414102 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346f9d9c-536c-4ebf-ac4b-a5bb61f9ef71 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:47.420576 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:47.526951 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:47.569638 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37d440b-6fff-4722-8f3d-a378bef6a08e None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:47.630070 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346f9d9c-536c-4ebf-ac4b-a5bb61f9ef71 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:47.643325 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27793701-c052-4d97-a138-364085b0b0ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:47.643958 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27793701-c052-4d97-a138-364085b0b0ce None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:47.644234 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27793701-c052-4d97-a138-364085b0b0ce None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:47.644503 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27793701-c052-4d97-a138-364085b0b0ce None admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:47.645218 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27793701-c052-4d97-a138-364085b0b0ce None admin] RBAC: Adding query filter params (name=admin) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:39:47.645521 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27793701-c052-4d97-a138-364085b0b0ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:47.646996 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27793701-c052-4d97-a138-364085b0b0ce None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:47.666131 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 127/259] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Oct 4 11:39:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 11:39:47.673134 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27793701-c052-4d97-a138-364085b0b0ce None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:47.699093 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666ad919-9616-4124-89c2-1b60d1bf3729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:47.700165 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666ad919-9616-4124-89c2-1b60d1bf3729 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:47.700655 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666ad919-9616-4124-89c2-1b60d1bf3729 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:47.701152 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666ad919-9616-4124-89c2-1b60d1bf3729 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:47.712805 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666ad919-9616-4124-89c2-1b60d1bf3729 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 11:39:47.718797 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-666ad919-9616-4124-89c2-1b60d1bf3729 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 11:39:47.718797 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:39:47.718797 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:39:47.718797 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:39:47.718797 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:39:47.718797 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:39:47.718797 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:39:47.718797 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:39:47.718797 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:39:47.718797 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:39:47.718797 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:39:47.718797 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:39:47.718797 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 11:39:47.718797 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 11:39:47.718797 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 11:39:47.718797 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 11:39:47.719774 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 11:39:47.719774 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 11:39:47.719774 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 11:39:47.719774 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 11:39:47.719774 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:39:47.719774 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:39:47.719774 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:39:47.719774 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:39:47.719774 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:39:47.719774 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:39:47.719774 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:39:47.719774 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:39:47.719774 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:39:47.719774 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:39:47.719774 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:39:47.719774 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:39:47.720577 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:39:47.720577 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:39:47.720577 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:39:47.720577 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:39:47.720577 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 11:39:47.720577 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 11:39:47.720577 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 11:39:47.720577 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 11:39:47.720577 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 11:39:47.720577 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 11:39:47.720577 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 11:39:47.720577 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:39:47.725857 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 133/260] 10.222.0.59 () {56 vars in 1114 bytes} [Tue Oct 4 11:39:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:39:47.731719 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666ad919-9616-4124-89c2-1b60d1bf3729 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:47.807001 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:47.861423 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666ad919-9616-4124-89c2-1b60d1bf3729 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:47.906003 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27793701-c052-4d97-a138-364085b0b0ce None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:47.928123 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3803af4a-1ce7-49df-9f16-0ce330749abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:47.929107 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3803af4a-1ce7-49df-9f16-0ce330749abe None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:47.929579 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3803af4a-1ce7-49df-9f16-0ce330749abe None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:47.930039 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3803af4a-1ce7-49df-9f16-0ce330749abe None admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:47.930951 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3803af4a-1ce7-49df-9f16-0ce330749abe None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:39:47.932945 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3803af4a-1ce7-49df-9f16-0ce330749abe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:47.937806 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3803af4a-1ce7-49df-9f16-0ce330749abe None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:47.958320 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 134/261] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Oct 4 11:39:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 11:39:47.966886 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3803af4a-1ce7-49df-9f16-0ce330749abe None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:47.986731 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14a39c0-5c50-4a17-9cfa-24a00ec706be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:47.987383 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14a39c0-5c50-4a17-9cfa-24a00ec706be None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:47.987666 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14a39c0-5c50-4a17-9cfa-24a00ec706be None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:47.987942 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14a39c0-5c50-4a17-9cfa-24a00ec706be None admin] PATH_INFO: `/v3/users/aa7220b65c3348289d244d64d4cf0797` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:47.993167 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14a39c0-5c50-4a17-9cfa-24a00ec706be None admin] RBAC: Authorizing `identity:get_user(user_id=aa7220b65c3348289d244d64d4cf0797)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:47.994637 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14a39c0-5c50-4a17-9cfa-24a00ec706be None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:47.996866 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 128/262] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Oct 4 11:39:47 2022] GET /identity/v3/users/aa7220b65c3348289d244d64d4cf0797 => generated 283 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 11:39:48.001700 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14a39c0-5c50-4a17-9cfa-24a00ec706be None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:48.017753 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:48.118717 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3803af4a-1ce7-49df-9f16-0ce330749abe None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:48.184978 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:48.186184 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacd9487-8cf9-4cfb-810f-59d137f1c703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:48.187064 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacd9487-8cf9-4cfb-810f-59d137f1c703 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:48.187345 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacd9487-8cf9-4cfb-810f-59d137f1c703 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:48.187618 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacd9487-8cf9-4cfb-810f-59d137f1c703 None admin] PATH_INFO: `/v3/users/aa7220b65c3348289d244d64d4cf0797` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:48.191492 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacd9487-8cf9-4cfb-810f-59d137f1c703 None admin] RBAC: Authorizing `identity:get_user(user_id=aa7220b65c3348289d244d64d4cf0797)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:48.193218 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacd9487-8cf9-4cfb-810f-59d137f1c703 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:48.195158 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 135/263] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Oct 4 11:39:47 2022] GET /identity/v3/users/aa7220b65c3348289d244d64d4cf0797 => generated 283 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:39:48.202538 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacd9487-8cf9-4cfb-810f-59d137f1c703 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:48.223600 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14a39c0-5c50-4a17-9cfa-24a00ec706be None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:48.301325 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42feee74-8caf-4deb-9334-3c7fd6cf4b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:48.301955 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42feee74-8caf-4deb-9334-3c7fd6cf4b30 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:48.302935 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42feee74-8caf-4deb-9334-3c7fd6cf4b30 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:48.303215 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42feee74-8caf-4deb-9334-3c7fd6cf4b30 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:48.314840 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacd9487-8cf9-4cfb-810f-59d137f1c703 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:48.377696 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2d7e59-218d-483d-9e9d-f52d236567a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:48.378272 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2d7e59-218d-483d-9e9d-f52d236567a5 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:48.378554 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2d7e59-218d-483d-9e9d-f52d236567a5 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:48.378866 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2d7e59-218d-483d-9e9d-f52d236567a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:48.441393 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42feee74-8caf-4deb-9334-3c7fd6cf4b30 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:48.443900 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42feee74-8caf-4deb-9334-3c7fd6cf4b30 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:48.462010 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:48.500493 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:48.516828 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2d7e59-218d-483d-9e9d-f52d236567a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:48.518308 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2d7e59-218d-483d-9e9d-f52d236567a5 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:48.718402 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 136/264] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Oct 4 11:39:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 11:39:48.727363 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 129/265] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Oct 4 11:39:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 726 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 04 11:39:48.732231 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2d7e59-218d-483d-9e9d-f52d236567a5 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:48.733469 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42feee74-8caf-4deb-9334-3c7fd6cf4b30 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:48.903072 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:48.913864 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2d7e59-218d-483d-9e9d-f52d236567a5 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:48.929501 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42feee74-8caf-4deb-9334-3c7fd6cf4b30 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:48.945798 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:48.978555 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a51135-d884-44e8-95da-eaf0fc7fc0aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:48.979127 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a51135-d884-44e8-95da-eaf0fc7fc0aa None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:48.979415 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a51135-d884-44e8-95da-eaf0fc7fc0aa None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:48.979692 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a51135-d884-44e8-95da-eaf0fc7fc0aa None admin] PATH_INFO: `/v3/projects/c883e45022464667b26d995f7ba3657d` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:48.985569 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a51135-d884-44e8-95da-eaf0fc7fc0aa None admin] RBAC: Authorizing `identity:get_project(project_id=c883e45022464667b26d995f7ba3657d)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:48.987078 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a51135-d884-44e8-95da-eaf0fc7fc0aa None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:48.988995 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 137/266] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Oct 4 11:39:48 2022] GET /identity/v3/projects/c883e45022464667b26d995f7ba3657d => generated 302 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:39:48.996392 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a51135-d884-44e8-95da-eaf0fc7fc0aa None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:48.998386 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334de3bb-d5ca-49fc-9363-1405d42068cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:48.999069 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334de3bb-d5ca-49fc-9363-1405d42068cd None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:48.999354 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334de3bb-d5ca-49fc-9363-1405d42068cd None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:48.999635 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334de3bb-d5ca-49fc-9363-1405d42068cd None admin] PATH_INFO: `/v3/projects/c883e45022464667b26d995f7ba3657d` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:49.000870 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334de3bb-d5ca-49fc-9363-1405d42068cd None admin] RBAC: Authorizing `identity:get_project(project_id=c883e45022464667b26d995f7ba3657d)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:49.002360 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334de3bb-d5ca-49fc-9363-1405d42068cd None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:49.004442 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 130/267] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Oct 4 11:39:48 2022] GET /identity/v3/projects/c883e45022464667b26d995f7ba3657d => generated 302 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:39:49.011667 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334de3bb-d5ca-49fc-9363-1405d42068cd None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:49.230892 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a51135-d884-44e8-95da-eaf0fc7fc0aa None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:49.239808 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334de3bb-d5ca-49fc-9363-1405d42068cd None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:49.298475 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f07f45a-b394-4493-a994-75ea20fa7972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:49.299096 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f07f45a-b394-4493-a994-75ea20fa7972 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:49.299369 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f07f45a-b394-4493-a994-75ea20fa7972 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:49.299633 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f07f45a-b394-4493-a994-75ea20fa7972 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:49.300360 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f07f45a-b394-4493-a994-75ea20fa7972 None admin] RBAC: Adding query filter params (role.id=d6e7421d1ff9451c808004b818354550, scope.project.id=c883e45022464667b26d995f7ba3657d, user.id=aa7220b65c3348289d244d64d4cf0797) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:39:49.300681 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f07f45a-b394-4493-a994-75ea20fa7972 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:49.302790 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f07f45a-b394-4493-a994-75ea20fa7972 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:49.307243 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e17933-baf3-4a3a-9a79-7561b384ec4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:49.307857 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e17933-baf3-4a3a-9a79-7561b384ec4f None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:49.308138 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e17933-baf3-4a3a-9a79-7561b384ec4f None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:49.308407 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e17933-baf3-4a3a-9a79-7561b384ec4f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:49.309178 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e17933-baf3-4a3a-9a79-7561b384ec4f None admin] RBAC: Adding query filter params (role.id=b6018afb40c74d19b8cadc402256f23d, scope.project.id=c883e45022464667b26d995f7ba3657d, user.id=aa7220b65c3348289d244d64d4cf0797) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:39:49.309287 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 131/268] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Oct 4 11:39:49 2022] GET /identity/v3/role_assignments?user.id=aa7220b65c3348289d244d64d4cf0797&scope.project.id=c883e45022464667b26d995f7ba3657d&role.id=d6e7421d1ff9451c808004b818354550 => generated 608 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:39:49.310463 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67f6bdb-6b04-48ef-99bd-d49547b8cda7 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:49.310744 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67f6bdb-6b04-48ef-99bd-d49547b8cda7 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:49.311013 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67f6bdb-6b04-48ef-99bd-d49547b8cda7 None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:49.313669 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e17933-baf3-4a3a-9a79-7561b384ec4f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:49.315346 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e17933-baf3-4a3a-9a79-7561b384ec4f None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:49.316528 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 132/269] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:39:49 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:39:49.317939 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a211b0d-0cee-4ccf-9c2f-8cacd8e394f5 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:49.318272 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a211b0d-0cee-4ccf-9c2f-8cacd8e394f5 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:49.318821 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a211b0d-0cee-4ccf-9c2f-8cacd8e394f5 None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:49.319981 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 133/270] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:39:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:39:49.321090 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d148e3f-f468-4262-974c-83e0437a7959 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:49.321738 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d148e3f-f468-4262-974c-83e0437a7959 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:49.322010 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d148e3f-f468-4262-974c-83e0437a7959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:49.333027 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 138/271] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Oct 4 11:39:48 2022] GET /identity/v3/role_assignments?user.id=aa7220b65c3348289d244d64d4cf0797&scope.project.id=c883e45022464667b26d995f7ba3657d&role.id=b6018afb40c74d19b8cadc402256f23d => generated 608 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:39:49.345161 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-5d148e3f-f468-4262-974c-83e0437a7959 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:39:49.346699 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-5d148e3f-f468-4262-974c-83e0437a7959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:39:49.354554 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5568da-2839-493c-83d2-00f41d60b868 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:49.354885 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5568da-2839-493c-83d2-00f41d60b868 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:49.355100 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5568da-2839-493c-83d2-00f41d60b868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:49.382767 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:49.394962 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-9d5568da-2839-493c-83d2-00f41d60b868 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:39:49.400758 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-9d5568da-2839-493c-83d2-00f41d60b868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:39:49.455313 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:49.479529 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 134/272] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:39:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 11:39:49.538148 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 139/273] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:39:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 11:39:49.808315 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d148e3f-f468-4262-974c-83e0437a7959 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:49.862649 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5568da-2839-493c-83d2-00f41d60b868 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:49.933004 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d148e3f-f468-4262-974c-83e0437a7959 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:49.976376 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e8d9dd-ec5c-4768-a63d-4c769af7f0c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:49.977049 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e8d9dd-ec5c-4768-a63d-4c769af7f0c3 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:49.977375 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e8d9dd-ec5c-4768-a63d-4c769af7f0c3 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:49.977651 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e8d9dd-ec5c-4768-a63d-4c769af7f0c3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:49.994537 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e8d9dd-ec5c-4768-a63d-4c769af7f0c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 11:39:49.999620 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5568da-2839-493c-83d2-00f41d60b868 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:49.999945 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-91e8d9dd-ec5c-4768-a63d-4c769af7f0c3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 11:39:49.999945 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:39:49.999945 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:39:49.999945 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:39:49.999945 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:39:49.999945 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:39:49.999945 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:39:49.999945 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:39:49.999945 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:39:49.999945 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:39:49.999945 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:39:49.999945 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:39:49.999945 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 11:39:49.999945 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 11:39:49.999945 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 11:39:49.999945 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 11:39:50.002148 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 11:39:50.002148 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 11:39:50.002148 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 11:39:50.002148 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 11:39:50.002148 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:39:50.002148 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:39:50.002148 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:39:50.002148 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:39:50.002148 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:39:50.002148 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:39:50.002148 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:39:50.002148 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:39:50.002148 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:39:50.002148 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:39:50.002148 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:39:50.002148 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:39:50.003671 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:39:50.003671 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:39:50.003671 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:39:50.003671 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:39:50.003671 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 11:39:50.003671 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 11:39:50.003671 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 11:39:50.003671 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 11:39:50.003671 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 11:39:50.003671 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 11:39:50.003671 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 11:39:50.003671 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:39:50.003671 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 135/274] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Oct 4 11:39:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:39:50.009752 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e8d9dd-ec5c-4768-a63d-4c769af7f0c3 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:50.051218 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:50.064861 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b617e7b-fa34-43e8-b596-0e9a00defad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:50.064861 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b617e7b-fa34-43e8-b596-0e9a00defad7 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:50.064861 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b617e7b-fa34-43e8-b596-0e9a00defad7 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:50.064861 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b617e7b-fa34-43e8-b596-0e9a00defad7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:50.065448 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b617e7b-fa34-43e8-b596-0e9a00defad7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:50.065448 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b617e7b-fa34-43e8-b596-0e9a00defad7 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:50.066389 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 140/275] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Oct 4 11:39:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:39:50.073147 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b617e7b-fa34-43e8-b596-0e9a00defad7 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:50.101765 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:50.138703 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e8d9dd-ec5c-4768-a63d-4c769af7f0c3 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:50.179737 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a51287-440d-468b-9110-cb40c19bbb25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:50.180344 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a51287-440d-468b-9110-cb40c19bbb25 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:50.180669 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a51287-440d-468b-9110-cb40c19bbb25 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:50.181088 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a51287-440d-468b-9110-cb40c19bbb25 None admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:50.181812 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a51287-440d-468b-9110-cb40c19bbb25 None admin] RBAC: Adding query filter params (name=member) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:39:50.182110 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a51287-440d-468b-9110-cb40c19bbb25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:50.183598 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a51287-440d-468b-9110-cb40c19bbb25 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:50.194408 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 136/276] 10.222.0.59 () {56 vars in 1101 bytes} [Tue Oct 4 11:39:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 11:39:50.195529 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a98edf-9b4a-43f6-8337-a7214acffa32 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:50.195840 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a98edf-9b4a-43f6-8337-a7214acffa32 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:50.196015 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a98edf-9b4a-43f6-8337-a7214acffa32 None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:50.197487 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 137/277] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:39:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:39:50.199118 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b617e7b-fa34-43e8-b596-0e9a00defad7 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:50.201260 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a98edf-9b4a-43f6-8337-a7214acffa32 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:50.258312 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101bc26e-418d-4617-bffa-536ace11a55f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:50.259307 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101bc26e-418d-4617-bffa-536ace11a55f None admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:50.259775 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101bc26e-418d-4617-bffa-536ace11a55f None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:50.260250 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101bc26e-418d-4617-bffa-536ace11a55f None admin] PATH_INFO: `/v3/users` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:50.261450 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101bc26e-418d-4617-bffa-536ace11a55f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:50.264169 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101bc26e-418d-4617-bffa-536ace11a55f None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:50.297688 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:50.308576 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a98edf-9b4a-43f6-8337-a7214acffa32 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:50.341512 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7283c602-f745-4f0a-b899-7604b0293871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:50.342089 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7283c602-f745-4f0a-b899-7604b0293871 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:50.342461 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7283c602-f745-4f0a-b899-7604b0293871 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:50.342731 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7283c602-f745-4f0a-b899-7604b0293871 None admin] PATH_INFO: `/v3/users/6d99af0769e2448a90ea2b5147e11592` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:50.356297 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7283c602-f745-4f0a-b899-7604b0293871 None admin] RBAC: Authorizing `identity:get_user(user_id=6d99af0769e2448a90ea2b5147e11592)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:50.357788 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7283c602-f745-4f0a-b899-7604b0293871 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:50.359465 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 138/278] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Oct 4 11:39:50 2022] GET /identity/v3/users/6d99af0769e2448a90ea2b5147e11592 => generated 293 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:39:50.361250 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c1498d-6379-4992-a238-bba60d74689c None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:50.361250 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c1498d-6379-4992-a238-bba60d74689c None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:50.361402 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c1498d-6379-4992-a238-bba60d74689c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:50.378593 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 141/279] 10.222.0.59 () {60 vars in 1132 bytes} [Tue Oct 4 11:39:50 2022] POST /identity/v3/users => generated 293 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 11:39:50.379756 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-80c1498d-6379-4992-a238-bba60d74689c None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:39:50.382313 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-80c1498d-6379-4992-a238-bba60d74689c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:39:50.385745 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101bc26e-418d-4617-bffa-536ace11a55f None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:50.476886 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 139/280] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:39:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 11:39:50.514635 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:50.527259 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb018f4-b39e-490c-b662-04f99756c488 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:50.527541 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb018f4-b39e-490c-b662-04f99756c488 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:50.527920 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb018f4-b39e-490c-b662-04f99756c488 None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:50.535450 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 140/281] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:39:50 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 11:39:50.537509 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1ace05-9963-4a28-8355-b18d0ed8b819 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:50.538033 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1ace05-9963-4a28-8355-b18d0ed8b819 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:50.538033 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1ace05-9963-4a28-8355-b18d0ed8b819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:50.542177 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101bc26e-418d-4617-bffa-536ace11a55f None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:50.557142 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-2e1ace05-9963-4a28-8355-b18d0ed8b819 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:39:50.558367 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-2e1ace05-9963-4a28-8355-b18d0ed8b819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:39:50.585461 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b283812-7762-469c-aa30-f66c4f794f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:50.586516 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b283812-7762-469c-aa30-f66c4f794f92 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:50.586988 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b283812-7762-469c-aa30-f66c4f794f92 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:50.587450 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b283812-7762-469c-aa30-f66c4f794f92 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:50.588362 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b283812-7762-469c-aa30-f66c4f794f92 None admin] RBAC: Adding query filter params (role.id=ab4307f3b7994c1c80036fa7db93b6b9, user.id=6d99af0769e2448a90ea2b5147e11592, scope.system=all) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:39:50.588960 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b283812-7762-469c-aa30-f66c4f794f92 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:50.590755 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b283812-7762-469c-aa30-f66c4f794f92 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:50.601663 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 142/282] 10.222.0.59 () {56 vars in 1308 bytes} [Tue Oct 4 11:39:50 2022] GET /identity/v3/role_assignments?user.id=6d99af0769e2448a90ea2b5147e11592&scope.system=all&role.id=ab4307f3b7994c1c80036fa7db93b6b9 => generated 226 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:39:50.658865 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 141/283] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:39:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 11:39:50.786346 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b283812-7762-469c-aa30-f66c4f794f92 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:50.903860 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b283812-7762-469c-aa30-f66c4f794f92 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:50.942871 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331c256c-b0c2-4610-8137-d9e315e0883e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:50.944039 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1ace05-9963-4a28-8355-b18d0ed8b819 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:50.944879 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331c256c-b0c2-4610-8137-d9e315e0883e None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:50.945316 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331c256c-b0c2-4610-8137-d9e315e0883e None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:50.945735 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331c256c-b0c2-4610-8137-d9e315e0883e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:50.955119 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:50.963614 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331c256c-b0c2-4610-8137-d9e315e0883e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 11:39:50.969989 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-331c256c-b0c2-4610-8137-d9e315e0883e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 11:39:50.969989 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:39:50.969989 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:39:50.969989 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:39:50.969989 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:39:50.969989 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:39:50.969989 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:39:50.969989 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:39:50.969989 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:39:50.969989 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:39:50.969989 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:39:50.969989 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:39:50.969989 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 11:39:50.969989 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 11:39:50.969989 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 11:39:50.969989 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 11:39:50.971208 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 11:39:50.971208 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 11:39:50.971208 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 11:39:50.971208 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 11:39:50.971208 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:39:50.971208 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:39:50.971208 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:39:50.971208 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:39:50.971208 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:39:50.971208 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:39:50.971208 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:39:50.971208 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:39:50.971208 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:39:50.971208 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:39:50.971208 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:39:50.971208 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:39:50.972227 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:39:50.972227 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:39:50.972227 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:39:50.972227 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:39:50.972227 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 11:39:50.972227 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 11:39:50.972227 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 11:39:50.972227 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 11:39:50.972227 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 11:39:50.972227 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 11:39:50.972227 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 11:39:50.972227 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:39:50.972227 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 143/284] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Oct 4 11:39:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:39:50.981604 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331c256c-b0c2-4610-8137-d9e315e0883e None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:50.994138 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:51.128876 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1ace05-9963-4a28-8355-b18d0ed8b819 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:51.138184 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331c256c-b0c2-4610-8137-d9e315e0883e None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:51.186086 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6663e006-69e2-4414-8b15-07e8e047f04d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:51.186790 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6663e006-69e2-4414-8b15-07e8e047f04d None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:51.187164 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6663e006-69e2-4414-8b15-07e8e047f04d None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:51.187533 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6663e006-69e2-4414-8b15-07e8e047f04d None admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:51.191168 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6663e006-69e2-4414-8b15-07e8e047f04d None admin] RBAC: Adding query filter params (name=reader) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:39:51.191168 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6663e006-69e2-4414-8b15-07e8e047f04d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:51.191168 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6663e006-69e2-4414-8b15-07e8e047f04d None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:51.193633 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19de5810-dbce-4a24-a52c-c6464c39961f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:51.194447 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19de5810-dbce-4a24-a52c-c6464c39961f None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:51.194879 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19de5810-dbce-4a24-a52c-c6464c39961f None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:51.195297 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19de5810-dbce-4a24-a52c-c6464c39961f None admin] PATH_INFO: `/v3/roles/member` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:51.200821 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 144/285] 10.222.0.59 () {56 vars in 1101 bytes} [Tue Oct 4 11:39:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:39:51.205712 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6663e006-69e2-4414-8b15-07e8e047f04d None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:51.219743 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19de5810-dbce-4a24-a52c-c6464c39961f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 11:39:51.226042 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-19de5810-dbce-4a24-a52c-c6464c39961f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 11:39:51.226042 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:39:51.226042 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:39:51.226042 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:39:51.226042 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:39:51.226042 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:39:51.226042 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:39:51.226042 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:39:51.226042 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:39:51.226042 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:39:51.226042 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:39:51.226042 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:39:51.226042 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 11:39:51.226042 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 11:39:51.226042 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 11:39:51.226042 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 11:39:51.227130 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 11:39:51.227130 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 11:39:51.227130 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 11:39:51.227130 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 11:39:51.227130 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:39:51.227130 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:39:51.227130 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:39:51.227130 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:39:51.227130 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:39:51.227130 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:39:51.227130 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:39:51.227130 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:39:51.227130 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:39:51.227130 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:39:51.227130 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:39:51.227130 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:39:51.228115 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:39:51.228115 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:39:51.228115 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:39:51.228115 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:39:51.228115 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 11:39:51.228115 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 11:39:51.228115 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 11:39:51.228115 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 11:39:51.228115 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 11:39:51.228115 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 11:39:51.228115 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 11:39:51.228115 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:39:51.235625 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 142/286] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Oct 4 11:39:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 11:39:51.241781 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19de5810-dbce-4a24-a52c-c6464c39961f None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:51.285182 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:51.332625 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6663e006-69e2-4414-8b15-07e8e047f04d None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:51.387080 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:51.402122 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d747eb-4b14-440e-b338-f06af8bb70a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:51.402762 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d747eb-4b14-440e-b338-f06af8bb70a8 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:51.403036 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d747eb-4b14-440e-b338-f06af8bb70a8 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:51.403306 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d747eb-4b14-440e-b338-f06af8bb70a8 None admin] PATH_INFO: `/v3/users/b9fadaf3c07243c295ce5353fc74e0c5` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:51.406561 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d747eb-4b14-440e-b338-f06af8bb70a8 None admin] RBAC: Authorizing `identity:get_user(user_id=b9fadaf3c07243c295ce5353fc74e0c5)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:51.408124 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d747eb-4b14-440e-b338-f06af8bb70a8 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:51.409746 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 145/287] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Oct 4 11:39:51 2022] GET /identity/v3/users/b9fadaf3c07243c295ce5353fc74e0c5 => generated 297 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:39:51.417413 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d747eb-4b14-440e-b338-f06af8bb70a8 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:51.459180 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19de5810-dbce-4a24-a52c-c6464c39961f None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:51.532285 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9294b90-417e-4179-9ef9-3fa0f0176ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:51.532931 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9294b90-417e-4179-9ef9-3fa0f0176ad0 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:51.533209 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9294b90-417e-4179-9ef9-3fa0f0176ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:51.533478 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9294b90-417e-4179-9ef9-3fa0f0176ad0 None admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:51.534149 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9294b90-417e-4179-9ef9-3fa0f0176ad0 None admin] RBAC: Adding query filter params (name=member) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:39:51.534728 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9294b90-417e-4179-9ef9-3fa0f0176ad0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:51.536120 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9294b90-417e-4179-9ef9-3fa0f0176ad0 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:51.557201 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 143/288] 10.222.0.59 () {56 vars in 1101 bytes} [Tue Oct 4 11:39:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 11:39:51.565197 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9294b90-417e-4179-9ef9-3fa0f0176ad0 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:51.622147 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d747eb-4b14-440e-b338-f06af8bb70a8 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:51.697491 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c461ddc9-8edb-4e94-b0c9-0f23f0c982fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:51.698120 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c461ddc9-8edb-4e94-b0c9-0f23f0c982fc None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:51.698398 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c461ddc9-8edb-4e94-b0c9-0f23f0c982fc None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:51.698665 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c461ddc9-8edb-4e94-b0c9-0f23f0c982fc None admin] PATH_INFO: `/v3/projects/c883e45022464667b26d995f7ba3657d` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:51.701509 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c461ddc9-8edb-4e94-b0c9-0f23f0c982fc None admin] RBAC: Authorizing `identity:get_project(project_id=c883e45022464667b26d995f7ba3657d)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:51.702973 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c461ddc9-8edb-4e94-b0c9-0f23f0c982fc None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:51.708980 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 146/289] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Oct 4 11:39:51 2022] GET /identity/v3/projects/c883e45022464667b26d995f7ba3657d => generated 302 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:39:51.710796 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c461ddc9-8edb-4e94-b0c9-0f23f0c982fc None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:51.717785 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:51.753270 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9294b90-417e-4179-9ef9-3fa0f0176ad0 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:51.783656 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:51.789754 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fddbb3-6f6b-48a8-ac78-df2a4abd4acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:51.790389 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fddbb3-6f6b-48a8-ac78-df2a4abd4acc None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:51.790668 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fddbb3-6f6b-48a8-ac78-df2a4abd4acc None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:51.790941 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fddbb3-6f6b-48a8-ac78-df2a4abd4acc None admin] PATH_INFO: `/v3/users/96c9e856910c473ea742344fa854fc69` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:51.792074 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fddbb3-6f6b-48a8-ac78-df2a4abd4acc None admin] RBAC: Authorizing `identity:get_user(user_id=96c9e856910c473ea742344fa854fc69)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:51.793694 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fddbb3-6f6b-48a8-ac78-df2a4abd4acc None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:51.795705 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 144/290] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Oct 4 11:39:51 2022] GET /identity/v3/users/96c9e856910c473ea742344fa854fc69 => generated 297 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:39:51.801785 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fddbb3-6f6b-48a8-ac78-df2a4abd4acc None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:51.905968 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c461ddc9-8edb-4e94-b0c9-0f23f0c982fc None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:51.935634 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fddbb3-6f6b-48a8-ac78-df2a4abd4acc None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:51.970687 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2e3990-841a-4c9d-9412-3a24e79573a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:51.971026 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a78a43-598d-4edd-9db2-c49b59408653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:51.971467 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2e3990-841a-4c9d-9412-3a24e79573a5 None admin] REQUEST_METHOD: `PUT` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:51.971652 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a78a43-598d-4edd-9db2-c49b59408653 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:51.971753 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2e3990-841a-4c9d-9412-3a24e79573a5 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:51.971904 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a78a43-598d-4edd-9db2-c49b59408653 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:51.972005 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2e3990-841a-4c9d-9412-3a24e79573a5 None admin] PATH_INFO: `/v3/projects/c883e45022464667b26d995f7ba3657d/users/b9fadaf3c07243c295ce5353fc74e0c5/roles/c5fcdf1a59b947a38d056240a270eb26` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:51.972685 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a78a43-598d-4edd-9db2-c49b59408653 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:51.976321 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2e3990-841a-4c9d-9412-3a24e79573a5 None admin] RBAC: Authorizing `identity:create_grant(project_id=c883e45022464667b26d995f7ba3657d, user_id=b9fadaf3c07243c295ce5353fc74e0c5, role_id=c5fcdf1a59b947a38d056240a270eb26)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:51.977990 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2e3990-841a-4c9d-9412-3a24e79573a5 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:52.040260 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 147/291] 10.222.0.59 () {58 vars in 1439 bytes} [Tue Oct 4 11:39:51 2022] PUT /identity/v3/projects/c883e45022464667b26d995f7ba3657d/users/b9fadaf3c07243c295ce5353fc74e0c5/roles/c5fcdf1a59b947a38d056240a270eb26 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 11:39:52.061358 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:52.065379 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a78a43-598d-4edd-9db2-c49b59408653 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:52.066873 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a78a43-598d-4edd-9db2-c49b59408653 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:52.199701 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 145/292] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Oct 4 11:39:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 11:39:52.205792 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2e3990-841a-4c9d-9412-3a24e79573a5 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:52.296716 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:52.347199 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2e3990-841a-4c9d-9412-3a24e79573a5 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:52.389356 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eccdb38-6118-46a5-a500-305da3febbb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:52.390351 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eccdb38-6118-46a5-a500-305da3febbb1 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:52.390891 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eccdb38-6118-46a5-a500-305da3febbb1 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:52.391387 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eccdb38-6118-46a5-a500-305da3febbb1 None admin] PATH_INFO: `/v3/projects/c883e45022464667b26d995f7ba3657d` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:52.392754 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eccdb38-6118-46a5-a500-305da3febbb1 None admin] RBAC: Authorizing `identity:get_project(project_id=c883e45022464667b26d995f7ba3657d)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:52.394457 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eccdb38-6118-46a5-a500-305da3febbb1 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:52.396335 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 148/293] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Oct 4 11:39:52 2022] GET /identity/v3/projects/c883e45022464667b26d995f7ba3657d => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:39:52.403019 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a78a43-598d-4edd-9db2-c49b59408653 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:52.525276 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a78a43-598d-4edd-9db2-c49b59408653 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:52.528567 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:52.577651 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c69dd26-5ee1-4888-809a-14888f07e5a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:52.578183 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c69dd26-5ee1-4888-809a-14888f07e5a3 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:52.578460 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c69dd26-5ee1-4888-809a-14888f07e5a3 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:52.578732 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c69dd26-5ee1-4888-809a-14888f07e5a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:52.579449 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c69dd26-5ee1-4888-809a-14888f07e5a3 None admin] RBAC: Adding query filter params (role.id=ab4307f3b7994c1c80036fa7db93b6b9, scope.project.id=c883e45022464667b26d995f7ba3657d, user.id=96c9e856910c473ea742344fa854fc69) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:39:52.579760 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c69dd26-5ee1-4888-809a-14888f07e5a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:52.581227 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c69dd26-5ee1-4888-809a-14888f07e5a3 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:52.588636 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 146/294] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Oct 4 11:39:52 2022] GET /identity/v3/role_assignments?user.id=96c9e856910c473ea742344fa854fc69&scope.project.id=c883e45022464667b26d995f7ba3657d&role.id=ab4307f3b7994c1c80036fa7db93b6b9 => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:39:53.035311 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0152587-4522-4d9c-82b6-7779f40874b0 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:53.035822 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0152587-4522-4d9c-82b6-7779f40874b0 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:53.035921 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0152587-4522-4d9c-82b6-7779f40874b0 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:53.037755 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 149/295] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:39:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:39:53.043114 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39595d8e-ceaf-43d5-b350-72add75f6acd None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:53.043550 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39595d8e-ceaf-43d5-b350-72add75f6acd None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:53.043734 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39595d8e-ceaf-43d5-b350-72add75f6acd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:53.066072 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-39595d8e-ceaf-43d5-b350-72add75f6acd None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:39:53.067274 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-39595d8e-ceaf-43d5-b350-72add75f6acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:39:53.146955 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 147/296] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:39:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 11:39:53.282230 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1912f1-da2c-4730-a95a-b84457011595 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:53.282578 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1912f1-da2c-4730-a95a-b84457011595 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:53.282789 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1912f1-da2c-4730-a95a-b84457011595 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:53.284537 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 150/297] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:39:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:39:53.290114 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950495e1-6311-43a0-8079-053b1ac3f639 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:53.290373 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950495e1-6311-43a0-8079-053b1ac3f639 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:53.290598 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950495e1-6311-43a0-8079-053b1ac3f639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:53.313392 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-950495e1-6311-43a0-8079-053b1ac3f639 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:39:53.314635 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-950495e1-6311-43a0-8079-053b1ac3f639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:39:53.386750 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 148/298] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:39:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 11:39:53.391681 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c23b83-c036-4b16-bf95-36de2891c5c8 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:53.391974 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c23b83-c036-4b16-bf95-36de2891c5c8 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:53.392250 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c23b83-c036-4b16-bf95-36de2891c5c8 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:53.393740 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 151/299] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:39:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:39:53.399456 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de22227-b170-4794-9341-5c91c5332fbc None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:53.399751 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de22227-b170-4794-9341-5c91c5332fbc None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:53.400034 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de22227-b170-4794-9341-5c91c5332fbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:53.418375 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-0de22227-b170-4794-9341-5c91c5332fbc None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:39:53.419572 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-0de22227-b170-4794-9341-5c91c5332fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:39:53.437051 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:53.454150 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c23b83-c036-4b16-bf95-36de2891c5c8 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:53.489026 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 149/300] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:39:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 11:39:53.579407 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c23b83-c036-4b16-bf95-36de2891c5c8 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:53.609744 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:53.616168 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66b53d2-4c55-46d3-8aa3-873f9a45f2f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:53.616911 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66b53d2-4c55-46d3-8aa3-873f9a45f2f4 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:53.626734 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66b53d2-4c55-46d3-8aa3-873f9a45f2f4 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:53.626734 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66b53d2-4c55-46d3-8aa3-873f9a45f2f4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:53.628355 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66b53d2-4c55-46d3-8aa3-873f9a45f2f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 11:39:53.634185 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-f66b53d2-4c55-46d3-8aa3-873f9a45f2f4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 11:39:53.634185 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:39:53.634185 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:39:53.634185 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:39:53.634185 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:39:53.634185 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:39:53.634185 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:39:53.634185 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:39:53.634185 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:39:53.634185 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:39:53.634185 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:39:53.634185 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:39:53.634185 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 11:39:53.634185 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 11:39:53.634185 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 11:39:53.634185 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 11:39:53.635158 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 11:39:53.635158 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 11:39:53.635158 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 11:39:53.635158 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 11:39:53.635158 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:39:53.635158 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:39:53.635158 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:39:53.635158 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:39:53.635158 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:39:53.635158 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:39:53.635158 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:39:53.635158 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:39:53.635158 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:39:53.635158 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:39:53.635158 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:39:53.635158 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:39:53.635948 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:39:53.635948 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:39:53.635948 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:39:53.635948 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:39:53.635948 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 11:39:53.635948 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 11:39:53.635948 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 11:39:53.635948 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 11:39:53.635948 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 11:39:53.635948 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 11:39:53.635948 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 11:39:53.635948 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:39:53.635948 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 152/301] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Oct 4 11:39:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 11:39:53.645916 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de22227-b170-4794-9341-5c91c5332fbc None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:53.664308 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66b53d2-4c55-46d3-8aa3-873f9a45f2f4 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:53.757276 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de22227-b170-4794-9341-5c91c5332fbc None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:53.770387 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66b53d2-4c55-46d3-8aa3-873f9a45f2f4 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:53.792772 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548522d1-7349-4f63-938a-5aa73a04ac69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:53.793387 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548522d1-7349-4f63-938a-5aa73a04ac69 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:53.793670 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548522d1-7349-4f63-938a-5aa73a04ac69 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:53.793945 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548522d1-7349-4f63-938a-5aa73a04ac69 None admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:53.794612 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548522d1-7349-4f63-938a-5aa73a04ac69 None admin] RBAC: Adding query filter params (name=reader) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:39:53.794912 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548522d1-7349-4f63-938a-5aa73a04ac69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:53.796288 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548522d1-7349-4f63-938a-5aa73a04ac69 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:53.810902 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 150/302] 10.222.0.59 () {56 vars in 1101 bytes} [Tue Oct 4 11:39:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:39:53.810902 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548522d1-7349-4f63-938a-5aa73a04ac69 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:53.813285 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5f68a8-70a4-44a3-b6f3-7ce29ea400e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:53.813912 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5f68a8-70a4-44a3-b6f3-7ce29ea400e9 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:53.814186 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5f68a8-70a4-44a3-b6f3-7ce29ea400e9 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:53.814451 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5f68a8-70a4-44a3-b6f3-7ce29ea400e9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:53.824974 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5f68a8-70a4-44a3-b6f3-7ce29ea400e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 11:39:53.826109 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:53.829761 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-6a5f68a8-70a4-44a3-b6f3-7ce29ea400e9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 11:39:53.829761 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:39:53.829761 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:39:53.829761 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:39:53.829761 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:39:53.829761 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:39:53.829761 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:39:53.829761 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:39:53.829761 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:39:53.829761 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:39:53.829761 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:39:53.829761 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:39:53.829761 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 11:39:53.829761 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 11:39:53.829761 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 11:39:53.829761 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 11:39:53.830652 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 11:39:53.830652 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 11:39:53.830652 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 11:39:53.830652 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 11:39:53.830652 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:39:53.830652 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:39:53.830652 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:39:53.830652 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:39:53.830652 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:39:53.830652 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:39:53.830652 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:39:53.830652 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:39:53.830652 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:39:53.830652 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:39:53.830652 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:39:53.830652 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:39:53.831498 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:39:53.831498 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:39:53.831498 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:39:53.831498 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:39:53.831498 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 11:39:53.831498 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 11:39:53.831498 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 11:39:53.831498 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 11:39:53.831498 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 11:39:53.831498 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 11:39:53.831498 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 11:39:53.831498 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:39:53.831498 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 153/303] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Oct 4 11:39:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 11:39:53.831498 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5f68a8-70a4-44a3-b6f3-7ce29ea400e9 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:53.888201 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:53.914751 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548522d1-7349-4f63-938a-5aa73a04ac69 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:53.938668 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5f68a8-70a4-44a3-b6f3-7ce29ea400e9 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:53.951655 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77613082-475c-48df-8814-4eed893d56a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:53.952476 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77613082-475c-48df-8814-4eed893d56a0 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:53.952782 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77613082-475c-48df-8814-4eed893d56a0 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:53.953248 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77613082-475c-48df-8814-4eed893d56a0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:53.954708 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77613082-475c-48df-8814-4eed893d56a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:53.956296 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77613082-475c-48df-8814-4eed893d56a0 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:53.957878 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 151/304] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Oct 4 11:39:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:39:53.959317 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77613082-475c-48df-8814-4eed893d56a0 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:53.977369 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03945c45-874b-4abc-94c8-70b57ac38ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:53.978398 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03945c45-874b-4abc-94c8-70b57ac38ce2 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:53.978987 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03945c45-874b-4abc-94c8-70b57ac38ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:53.979333 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03945c45-874b-4abc-94c8-70b57ac38ce2 None admin] PATH_INFO: `/v3/users/4ab30b5df3a44298b3b12f0cbbd4ae11` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:53.994773 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03945c45-874b-4abc-94c8-70b57ac38ce2 None admin] RBAC: Authorizing `identity:get_user(user_id=4ab30b5df3a44298b3b12f0cbbd4ae11)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:53.996241 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03945c45-874b-4abc-94c8-70b57ac38ce2 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:54.002863 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 154/305] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Oct 4 11:39:53 2022] GET /identity/v3/users/4ab30b5df3a44298b3b12f0cbbd4ae11 => generated 293 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:39:54.002863 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03945c45-874b-4abc-94c8-70b57ac38ce2 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:54.045686 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:54.066730 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77613082-475c-48df-8814-4eed893d56a0 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:54.104866 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125d0a47-2203-4849-a118-30dd5426dfdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:54.105393 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125d0a47-2203-4849-a118-30dd5426dfdb None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:54.105675 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125d0a47-2203-4849-a118-30dd5426dfdb None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:54.105952 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125d0a47-2203-4849-a118-30dd5426dfdb None admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:54.106718 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125d0a47-2203-4849-a118-30dd5426dfdb None admin] RBAC: Adding query filter params (name=member) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:39:54.107136 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125d0a47-2203-4849-a118-30dd5426dfdb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:54.108503 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125d0a47-2203-4849-a118-30dd5426dfdb None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:54.109692 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03945c45-874b-4abc-94c8-70b57ac38ce2 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:54.122310 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 152/306] 10.222.0.59 () {56 vars in 1101 bytes} [Tue Oct 4 11:39:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:39:54.122489 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:54.122580 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125d0a47-2203-4849-a118-30dd5426dfdb None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:54.149898 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99342038-34c3-45dc-8429-49283596def6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:54.150515 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99342038-34c3-45dc-8429-49283596def6 None admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:54.151066 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99342038-34c3-45dc-8429-49283596def6 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:54.151336 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99342038-34c3-45dc-8429-49283596def6 None admin] PATH_INFO: `/v3/groups` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:54.151957 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99342038-34c3-45dc-8429-49283596def6 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:54.153411 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99342038-34c3-45dc-8429-49283596def6 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:54.222054 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125d0a47-2203-4849-a118-30dd5426dfdb None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:54.240628 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 155/307] 10.222.0.59 () {60 vars in 1134 bytes} [Tue Oct 4 11:39:53 2022] POST /identity/v3/groups => generated 229 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 11:39:54.240628 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99342038-34c3-45dc-8429-49283596def6 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:54.280403 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a064078-bfb8-4a5f-bee8-f6d9cb2b3289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:54.281053 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a064078-bfb8-4a5f-bee8-f6d9cb2b3289 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:54.281330 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a064078-bfb8-4a5f-bee8-f6d9cb2b3289 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:54.281602 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a064078-bfb8-4a5f-bee8-f6d9cb2b3289 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:54.283065 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a064078-bfb8-4a5f-bee8-f6d9cb2b3289 None admin] RBAC: Adding query filter params (role.id=c5fcdf1a59b947a38d056240a270eb26, user.id=4ab30b5df3a44298b3b12f0cbbd4ae11, scope.system=all) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:39:54.283424 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a064078-bfb8-4a5f-bee8-f6d9cb2b3289 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:54.285452 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a064078-bfb8-4a5f-bee8-f6d9cb2b3289 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:54.293207 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 153/308] 10.222.0.59 () {56 vars in 1308 bytes} [Tue Oct 4 11:39:54 2022] GET /identity/v3/role_assignments?user.id=4ab30b5df3a44298b3b12f0cbbd4ae11&scope.system=all&role.id=c5fcdf1a59b947a38d056240a270eb26 => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:39:54.367169 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99342038-34c3-45dc-8429-49283596def6 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:54.409808 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d559729d-6042-4df5-9560-5a5de2854bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:54.410474 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d559729d-6042-4df5-9560-5a5de2854bc8 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:54.410758 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d559729d-6042-4df5-9560-5a5de2854bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:54.411037 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d559729d-6042-4df5-9560-5a5de2854bc8 None admin] PATH_INFO: `/v3/users/6d99af0769e2448a90ea2b5147e11592` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:54.413032 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d559729d-6042-4df5-9560-5a5de2854bc8 None admin] RBAC: Authorizing `identity:get_user(user_id=6d99af0769e2448a90ea2b5147e11592)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:54.414525 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d559729d-6042-4df5-9560-5a5de2854bc8 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:54.416562 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 156/309] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Oct 4 11:39:54 2022] GET /identity/v3/users/6d99af0769e2448a90ea2b5147e11592 => generated 293 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:39:54.422264 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a064078-bfb8-4a5f-bee8-f6d9cb2b3289 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:54.444975 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:54.546432 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a064078-bfb8-4a5f-bee8-f6d9cb2b3289 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:54.583797 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f23c36-b7b9-4d6b-a460-a89103a8fed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:54.585050 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f23c36-b7b9-4d6b-a460-a89103a8fed0 None admin] REQUEST_METHOD: `PUT` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:54.585538 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f23c36-b7b9-4d6b-a460-a89103a8fed0 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:54.586024 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f23c36-b7b9-4d6b-a460-a89103a8fed0 None admin] PATH_INFO: `/v3/system/users/6d99af0769e2448a90ea2b5147e11592/roles/ab4307f3b7994c1c80036fa7db93b6b9` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:54.587675 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f23c36-b7b9-4d6b-a460-a89103a8fed0 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=6d99af0769e2448a90ea2b5147e11592, role_id=ab4307f3b7994c1c80036fa7db93b6b9)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:54.589447 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f23c36-b7b9-4d6b-a460-a89103a8fed0 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:54.642378 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d14a4c-c911-4c9e-b853-5520b814d913 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:54.642681 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d14a4c-c911-4c9e-b853-5520b814d913 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:54.642916 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d14a4c-c911-4c9e-b853-5520b814d913 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:54.644405 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 157/310] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:39:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:39:54.649729 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c874ce-6cc6-4dc6-92bd-eb72ccce0209 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:54.650018 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c874ce-6cc6-4dc6-92bd-eb72ccce0209 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:54.650295 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c874ce-6cc6-4dc6-92bd-eb72ccce0209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:54.668678 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-39c874ce-6cc6-4dc6-92bd-eb72ccce0209 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:39:54.669874 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-39c874ce-6cc6-4dc6-92bd-eb72ccce0209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:39:54.681768 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 154/311] 10.222.0.59 () {58 vars in 1334 bytes} [Tue Oct 4 11:39:54 2022] PUT /identity/v3/system/users/6d99af0769e2448a90ea2b5147e11592/roles/ab4307f3b7994c1c80036fa7db93b6b9 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 11:39:54.715512 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:54.764191 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 158/312] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:39:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 11:39:55.039244 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f23c36-b7b9-4d6b-a460-a89103a8fed0 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:55.115196 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:55.146500 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f23c36-b7b9-4d6b-a460-a89103a8fed0 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:55.182195 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56b7052-5921-477f-8da5-5d8d3dd4a71a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:55.182832 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56b7052-5921-477f-8da5-5d8d3dd4a71a None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:55.183112 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56b7052-5921-477f-8da5-5d8d3dd4a71a None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:55.183381 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56b7052-5921-477f-8da5-5d8d3dd4a71a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:55.193908 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56b7052-5921-477f-8da5-5d8d3dd4a71a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 11:39:55.199274 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-d56b7052-5921-477f-8da5-5d8d3dd4a71a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 11:39:55.199274 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:39:55.199274 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:39:55.199274 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:39:55.199274 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:39:55.199274 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:39:55.199274 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:39:55.199274 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:39:55.199274 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:39:55.199274 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:39:55.199274 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:39:55.199274 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:39:55.199274 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 11:39:55.199274 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 11:39:55.199274 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 11:39:55.199274 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 11:39:55.200169 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 11:39:55.200169 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 11:39:55.200169 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 11:39:55.200169 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 11:39:55.200169 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:39:55.200169 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:39:55.200169 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:39:55.200169 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:39:55.200169 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:39:55.200169 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:39:55.200169 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:39:55.200169 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:39:55.200169 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:39:55.200169 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:39:55.200169 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:39:55.200169 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:39:55.201877 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:39:55.201877 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:39:55.201877 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:39:55.201877 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:39:55.201877 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 11:39:55.201877 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 11:39:55.201877 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 11:39:55.201877 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 11:39:55.201877 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 11:39:55.201877 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 11:39:55.201877 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 11:39:55.201877 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:39:55.201877 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 155/313] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Oct 4 11:39:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:39:55.206584 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c874ce-6cc6-4dc6-92bd-eb72ccce0209 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:55.315786 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c874ce-6cc6-4dc6-92bd-eb72ccce0209 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:55.351916 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7440c5-8907-4532-8faf-538b365de683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:55.352832 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7440c5-8907-4532-8faf-538b365de683 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:55.353288 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7440c5-8907-4532-8faf-538b365de683 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:55.353734 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7440c5-8907-4532-8faf-538b365de683 None admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:55.354555 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7440c5-8907-4532-8faf-538b365de683 None admin] RBAC: Adding query filter params (name=reader) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:39:55.355024 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7440c5-8907-4532-8faf-538b365de683 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:55.356557 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7440c5-8907-4532-8faf-538b365de683 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:55.365511 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 159/314] 10.222.0.59 () {56 vars in 1101 bytes} [Tue Oct 4 11:39:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:39:55.371468 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56b7052-5921-477f-8da5-5d8d3dd4a71a None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:55.476370 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56b7052-5921-477f-8da5-5d8d3dd4a71a None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:55.510809 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:55.513123 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536419a8-d9a5-4fb3-85e1-7ca11589e77d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:55.513689 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536419a8-d9a5-4fb3-85e1-7ca11589e77d None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:55.513973 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536419a8-d9a5-4fb3-85e1-7ca11589e77d None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:55.514254 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536419a8-d9a5-4fb3-85e1-7ca11589e77d None admin] PATH_INFO: `/v3/users/b9fadaf3c07243c295ce5353fc74e0c5` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:55.515476 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536419a8-d9a5-4fb3-85e1-7ca11589e77d None admin] RBAC: Authorizing `identity:get_user(user_id=b9fadaf3c07243c295ce5353fc74e0c5)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:55.516945 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536419a8-d9a5-4fb3-85e1-7ca11589e77d None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:55.518834 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 156/315] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Oct 4 11:39:55 2022] GET /identity/v3/users/b9fadaf3c07243c295ce5353fc74e0c5 => generated 297 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:39:55.525699 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7440c5-8907-4532-8faf-538b365de683 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:55.556453 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:55.634610 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7440c5-8907-4532-8faf-538b365de683 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:55.671093 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5e54e5-b1b7-4e79-afdc-eed759c4136a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:55.672054 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5e54e5-b1b7-4e79-afdc-eed759c4136a None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:55.672500 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5e54e5-b1b7-4e79-afdc-eed759c4136a None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:55.672941 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5e54e5-b1b7-4e79-afdc-eed759c4136a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:55.746400 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5e54e5-b1b7-4e79-afdc-eed759c4136a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:55.747878 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5e54e5-b1b7-4e79-afdc-eed759c4136a None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:55.775740 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:55.850761 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 160/316] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Oct 4 11:39:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 11:39:55.857955 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536419a8-d9a5-4fb3-85e1-7ca11589e77d None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:55.961879 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536419a8-d9a5-4fb3-85e1-7ca11589e77d None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:56.001412 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777f9cf4-3279-43fe-9e30-b9e55a783449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:56.002046 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777f9cf4-3279-43fe-9e30-b9e55a783449 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:56.002321 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777f9cf4-3279-43fe-9e30-b9e55a783449 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:56.002591 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777f9cf4-3279-43fe-9e30-b9e55a783449 None admin] PATH_INFO: `/v3/projects/c883e45022464667b26d995f7ba3657d` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:56.003716 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777f9cf4-3279-43fe-9e30-b9e55a783449 None admin] RBAC: Authorizing `identity:get_project(project_id=c883e45022464667b26d995f7ba3657d)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:56.006005 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777f9cf4-3279-43fe-9e30-b9e55a783449 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:56.007953 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 157/317] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Oct 4 11:39:55 2022] GET /identity/v3/projects/c883e45022464667b26d995f7ba3657d => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:39:56.013555 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5e54e5-b1b7-4e79-afdc-eed759c4136a None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:56.123041 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5e54e5-b1b7-4e79-afdc-eed759c4136a None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:56.152911 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:56.160952 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ade3f8-cede-4715-a4a9-6db63dc419eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:56.162308 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ade3f8-cede-4715-a4a9-6db63dc419eb None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:56.162592 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ade3f8-cede-4715-a4a9-6db63dc419eb None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:56.162866 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ade3f8-cede-4715-a4a9-6db63dc419eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:56.163598 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ade3f8-cede-4715-a4a9-6db63dc419eb None admin] RBAC: Adding query filter params (role.id=c5fcdf1a59b947a38d056240a270eb26, scope.project.id=c883e45022464667b26d995f7ba3657d, user.id=b9fadaf3c07243c295ce5353fc74e0c5) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:39:56.163906 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ade3f8-cede-4715-a4a9-6db63dc419eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:56.165382 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ade3f8-cede-4715-a4a9-6db63dc419eb None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:56.171850 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 161/318] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Oct 4 11:39:56 2022] GET /identity/v3/role_assignments?user.id=b9fadaf3c07243c295ce5353fc74e0c5&scope.project.id=c883e45022464667b26d995f7ba3657d&role.id=c5fcdf1a59b947a38d056240a270eb26 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:39:56.541363 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa16b88f-71d9-4f00-972a-4067ad966b03 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:56.541829 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa16b88f-71d9-4f00-972a-4067ad966b03 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:56.541920 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa16b88f-71d9-4f00-972a-4067ad966b03 None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:56.543407 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 158/319] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:39:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:39:56.548330 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06685614-8abe-4b6b-98b8-a4980092c5be None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:56.548746 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06685614-8abe-4b6b-98b8-a4980092c5be None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:56.548915 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06685614-8abe-4b6b-98b8-a4980092c5be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:56.567147 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-06685614-8abe-4b6b-98b8-a4980092c5be None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:39:56.568911 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-06685614-8abe-4b6b-98b8-a4980092c5be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:39:56.618769 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9e04f8-1961-4b53-b2d4-e718ab14a63a None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:56.619053 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9e04f8-1961-4b53-b2d4-e718ab14a63a None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:56.619324 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9e04f8-1961-4b53-b2d4-e718ab14a63a None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:56.620806 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 159/320] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:39:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 11:39:56.625842 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa87273a-261a-44b4-8751-3bd9d21b87c1 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:56.626123 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa87273a-261a-44b4-8751-3bd9d21b87c1 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:56.626397 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa87273a-261a-44b4-8751-3bd9d21b87c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:56.641113 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 162/321] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:39:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 11:39:56.645407 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-aa87273a-261a-44b4-8751-3bd9d21b87c1 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:39:56.647308 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-aa87273a-261a-44b4-8751-3bd9d21b87c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:39:56.710033 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:56.716301 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 160/322] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:39:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 11:39:56.918891 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06685614-8abe-4b6b-98b8-a4980092c5be None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:56.987352 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa87273a-261a-44b4-8751-3bd9d21b87c1 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:57.020202 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06685614-8abe-4b6b-98b8-a4980092c5be None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:57.042725 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:57.053895 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c991cb-5188-4547-880e-0054f435964c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:57.054515 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c991cb-5188-4547-880e-0054f435964c None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:57.054788 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c991cb-5188-4547-880e-0054f435964c None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:57.055053 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c991cb-5188-4547-880e-0054f435964c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:57.065101 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c991cb-5188-4547-880e-0054f435964c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 11:39:57.070419 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-34c991cb-5188-4547-880e-0054f435964c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 11:39:57.070419 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:39:57.070419 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:39:57.070419 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:39:57.070419 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:39:57.070419 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:39:57.070419 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:39:57.070419 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:39:57.070419 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:39:57.070419 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:39:57.070419 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:39:57.070419 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:39:57.070419 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 11:39:57.070419 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 11:39:57.070419 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 11:39:57.070419 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 11:39:57.071382 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 11:39:57.071382 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 11:39:57.071382 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 11:39:57.071382 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 11:39:57.071382 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:39:57.071382 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:39:57.071382 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:39:57.071382 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:39:57.071382 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:39:57.071382 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:39:57.071382 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:39:57.071382 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:39:57.071382 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:39:57.071382 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:39:57.071382 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:39:57.071382 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:39:57.072204 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:39:57.072204 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:39:57.072204 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:39:57.072204 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:39:57.072204 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 11:39:57.072204 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 11:39:57.072204 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 11:39:57.072204 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 11:39:57.072204 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 11:39:57.072204 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 11:39:57.072204 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 11:39:57.072204 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:39:57.072204 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 163/323] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Oct 4 11:39:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:39:57.073322 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707b9a93-b4e9-46f3-a1dd-9925b53becd6 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:57.073538 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707b9a93-b4e9-46f3-a1dd-9925b53becd6 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:57.073848 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707b9a93-b4e9-46f3-a1dd-9925b53becd6 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:57.076633 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 164/324] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:39:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:39:57.077238 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707b9a93-b4e9-46f3-a1dd-9925b53becd6 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:57.088036 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa87273a-261a-44b4-8751-3bd9d21b87c1 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:57.122486 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36abcded-d9b4-40aa-96a1-02307e125a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:57.123142 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36abcded-d9b4-40aa-96a1-02307e125a4d None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:57.123419 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36abcded-d9b4-40aa-96a1-02307e125a4d None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:57.123688 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36abcded-d9b4-40aa-96a1-02307e125a4d None admin] PATH_INFO: `/v3/domains/default` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:57.124802 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36abcded-d9b4-40aa-96a1-02307e125a4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:57.126222 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36abcded-d9b4-40aa-96a1-02307e125a4d None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:57.127770 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 161/325] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Oct 4 11:39:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 11:39:57.128996 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbda884d-1a7d-475d-afeb-fbb6b4dc0e7d None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:57.129280 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbda884d-1a7d-475d-afeb-fbb6b4dc0e7d None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:57.129552 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbda884d-1a7d-475d-afeb-fbb6b4dc0e7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:57.147645 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-bbda884d-1a7d-475d-afeb-fbb6b4dc0e7d None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:39:57.148854 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-bbda884d-1a7d-475d-afeb-fbb6b4dc0e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:39:57.179201 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707b9a93-b4e9-46f3-a1dd-9925b53becd6 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:57.209852 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:57.212888 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01603cc3-4908-46ce-9114-434d68f679b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:57.213490 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01603cc3-4908-46ce-9114-434d68f679b9 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:57.213767 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01603cc3-4908-46ce-9114-434d68f679b9 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:57.214041 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01603cc3-4908-46ce-9114-434d68f679b9 None admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:57.214701 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01603cc3-4908-46ce-9114-434d68f679b9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:39:57.215006 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01603cc3-4908-46ce-9114-434d68f679b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:57.216429 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01603cc3-4908-46ce-9114-434d68f679b9 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:57.216828 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 162/326] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:39:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 11:39:57.217595 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbda884d-1a7d-475d-afeb-fbb6b4dc0e7d None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:57.236112 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 165/327] 10.222.0.59 () {56 vars in 1101 bytes} [Tue Oct 4 11:39:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 11:39:57.242264 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01603cc3-4908-46ce-9114-434d68f679b9 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:57.290977 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:57.322621 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbda884d-1a7d-475d-afeb-fbb6b4dc0e7d None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:57.351041 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01603cc3-4908-46ce-9114-434d68f679b9 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:57.363043 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ad7f32-ea4d-4137-8599-da6e80ffbf63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:57.363816 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ad7f32-ea4d-4137-8599-da6e80ffbf63 None admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:57.364093 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ad7f32-ea4d-4137-8599-da6e80ffbf63 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:57.365321 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ad7f32-ea4d-4137-8599-da6e80ffbf63 None admin] PATH_INFO: `/v3/groups` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:57.366078 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ad7f32-ea4d-4137-8599-da6e80ffbf63 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:57.367789 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ad7f32-ea4d-4137-8599-da6e80ffbf63 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:57.385206 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06899094-1bf1-4f07-8939-57b3d5cb8b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:57.385842 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06899094-1bf1-4f07-8939-57b3d5cb8b0c None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:57.391529 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06899094-1bf1-4f07-8939-57b3d5cb8b0c None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:57.391529 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06899094-1bf1-4f07-8939-57b3d5cb8b0c None admin] PATH_INFO: `/v3/users/4ab30b5df3a44298b3b12f0cbbd4ae11` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:57.391529 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06899094-1bf1-4f07-8939-57b3d5cb8b0c None admin] RBAC: Authorizing `identity:get_user(user_id=4ab30b5df3a44298b3b12f0cbbd4ae11)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:57.391529 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06899094-1bf1-4f07-8939-57b3d5cb8b0c None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:57.391529 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 166/328] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Oct 4 11:39:57 2022] GET /identity/v3/users/4ab30b5df3a44298b3b12f0cbbd4ae11 => generated 293 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 11:39:57.396365 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06899094-1bf1-4f07-8939-57b3d5cb8b0c None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:57.458773 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 163/329] 10.222.0.59 () {60 vars in 1134 bytes} [Tue Oct 4 11:39:57 2022] POST /identity/v3/groups => generated 226 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 11:39:57.489506 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ad7f32-ea4d-4137-8599-da6e80ffbf63 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:57.527784 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06899094-1bf1-4f07-8939-57b3d5cb8b0c None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:57.544632 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:57.561128 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:57.568067 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c50e367-c847-4c3f-83f3-34b6163ffbd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:57.568780 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c50e367-c847-4c3f-83f3-34b6163ffbd4 None admin] REQUEST_METHOD: `PUT` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:57.569061 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c50e367-c847-4c3f-83f3-34b6163ffbd4 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:57.569335 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c50e367-c847-4c3f-83f3-34b6163ffbd4 None admin] PATH_INFO: `/v3/system/users/4ab30b5df3a44298b3b12f0cbbd4ae11/roles/c5fcdf1a59b947a38d056240a270eb26` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:57.571260 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c50e367-c847-4c3f-83f3-34b6163ffbd4 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=4ab30b5df3a44298b3b12f0cbbd4ae11, role_id=c5fcdf1a59b947a38d056240a270eb26)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:57.572386 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c50e367-c847-4c3f-83f3-34b6163ffbd4 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:57.610037 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ad7f32-ea4d-4137-8599-da6e80ffbf63 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:57.643569 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f19ca3-e16c-4481-b815-edba5bcee9dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:57.644204 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f19ca3-e16c-4481-b815-edba5bcee9dd None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:57.644486 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f19ca3-e16c-4481-b815-edba5bcee9dd None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:57.644793 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f19ca3-e16c-4481-b815-edba5bcee9dd None admin] PATH_INFO: `/v3/roles/member` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:57.655805 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f19ca3-e16c-4481-b815-edba5bcee9dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 11:39:57.658633 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 167/330] 10.222.0.59 () {58 vars in 1334 bytes} [Tue Oct 4 11:39:57 2022] PUT /identity/v3/system/users/4ab30b5df3a44298b3b12f0cbbd4ae11/roles/c5fcdf1a59b947a38d056240a270eb26 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 11:39:57.662856 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-87f19ca3-e16c-4481-b815-edba5bcee9dd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 11:39:57.662856 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:39:57.662856 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:39:57.662856 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:39:57.662856 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:39:57.662856 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:39:57.662856 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:39:57.662856 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:39:57.662856 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:39:57.662856 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:39:57.662856 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:39:57.662856 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:39:57.662856 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 11:39:57.662856 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 11:39:57.662856 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 11:39:57.662856 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 11:39:57.663939 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 11:39:57.663939 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 11:39:57.663939 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 11:39:57.663939 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 11:39:57.663939 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:39:57.663939 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:39:57.663939 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:39:57.663939 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:39:57.663939 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:39:57.663939 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:39:57.663939 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:39:57.663939 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:39:57.663939 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:39:57.663939 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:39:57.663939 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:39:57.663939 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:39:57.664879 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:39:57.664879 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:39:57.664879 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:39:57.664879 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:39:57.664879 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 11:39:57.664879 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 11:39:57.664879 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 11:39:57.664879 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 11:39:57.664879 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 11:39:57.664879 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 11:39:57.664879 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 11:39:57.664879 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:39:57.670046 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 164/331] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Oct 4 11:39:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 11:39:57.670628 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c50e367-c847-4c3f-83f3-34b6163ffbd4 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:57.809701 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c50e367-c847-4c3f-83f3-34b6163ffbd4 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:57.851002 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c948738b-c69a-4a84-9710-fc08159fe9c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:57.851611 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c948738b-c69a-4a84-9710-fc08159fe9c8 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:57.851885 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c948738b-c69a-4a84-9710-fc08159fe9c8 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:57.852153 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c948738b-c69a-4a84-9710-fc08159fe9c8 None admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:57.852847 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c948738b-c69a-4a84-9710-fc08159fe9c8 None admin] RBAC: Adding query filter params (name=member) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:39:57.853145 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c948738b-c69a-4a84-9710-fc08159fe9c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:57.854539 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c948738b-c69a-4a84-9710-fc08159fe9c8 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:57.863883 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 168/332] 10.222.0.59 () {56 vars in 1101 bytes} [Tue Oct 4 11:39:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:39:57.870827 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f19ca3-e16c-4481-b815-edba5bcee9dd None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:57.981673 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f19ca3-e16c-4481-b815-edba5bcee9dd None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:58.000397 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:58.019831 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf0b8f0-3123-4952-be6a-c438acaad4f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:58.021158 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf0b8f0-3123-4952-be6a-c438acaad4f3 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:58.021488 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf0b8f0-3123-4952-be6a-c438acaad4f3 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:58.021782 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf0b8f0-3123-4952-be6a-c438acaad4f3 None admin] PATH_INFO: `/v3/users/6d99af0769e2448a90ea2b5147e11592` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:58.022959 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf0b8f0-3123-4952-be6a-c438acaad4f3 None admin] RBAC: Authorizing `identity:get_user(user_id=6d99af0769e2448a90ea2b5147e11592)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:58.025034 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf0b8f0-3123-4952-be6a-c438acaad4f3 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:58.026457 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 165/333] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Oct 4 11:39:57 2022] GET /identity/v3/users/6d99af0769e2448a90ea2b5147e11592 => generated 293 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:39:58.033219 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c948738b-c69a-4a84-9710-fc08159fe9c8 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:39:58.092496 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:58.170561 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c948738b-c69a-4a84-9710-fc08159fe9c8 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:39:58.208910 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfd5a78-e012-4f58-8cd4-12913d2d3782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:39:58.209525 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfd5a78-e012-4f58-8cd4-12913d2d3782 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:58.209805 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfd5a78-e012-4f58-8cd4-12913d2d3782 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:58.210077 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfd5a78-e012-4f58-8cd4-12913d2d3782 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:58.210801 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfd5a78-e012-4f58-8cd4-12913d2d3782 None admin] RBAC: Adding query filter params (role.id=ab4307f3b7994c1c80036fa7db93b6b9, user.id=6d99af0769e2448a90ea2b5147e11592, scope.system=all) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:39:58.211108 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfd5a78-e012-4f58-8cd4-12913d2d3782 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:39:58.212534 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfd5a78-e012-4f58-8cd4-12913d2d3782 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:39:58.226786 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 169/334] 10.222.0.59 () {56 vars in 1308 bytes} [Tue Oct 4 11:39:58 2022] GET /identity/v3/role_assignments?user.id=6d99af0769e2448a90ea2b5147e11592&scope.system=all&role.id=ab4307f3b7994c1c80036fa7db93b6b9 => generated 510 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 11:39:59.897535 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19d0f1a-cac3-46e4-8fe3-5b5184f0de84 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:59.897535 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19d0f1a-cac3-46e4-8fe3-5b5184f0de84 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:59.897535 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19d0f1a-cac3-46e4-8fe3-5b5184f0de84 None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:59.897535 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 166/335] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:39:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:39:59.906299 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189b9946-f783-429d-9f3c-6496d6dc3da4 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:39:59.906721 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189b9946-f783-429d-9f3c-6496d6dc3da4 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:39:59.906930 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189b9946-f783-429d-9f3c-6496d6dc3da4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:39:59.931810 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-189b9946-f783-429d-9f3c-6496d6dc3da4 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:39:59.933048 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-189b9946-f783-429d-9f3c-6496d6dc3da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:40:00.014148 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 170/336] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:39:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 11:40:00.315399 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9269868e-da47-4e9e-8d06-8fa7c2260f3a None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:00.315786 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9269868e-da47-4e9e-8d06-8fa7c2260f3a None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:00.315974 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9269868e-da47-4e9e-8d06-8fa7c2260f3a None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:00.317858 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 167/337] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:40:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:40:00.323563 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8b9fea-814d-41f6-a5ea-c47150a09a0c None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:00.323836 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8b9fea-814d-41f6-a5ea-c47150a09a0c None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:00.324116 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8b9fea-814d-41f6-a5ea-c47150a09a0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:00.357308 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-bf8b9fea-814d-41f6-a5ea-c47150a09a0c None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:40:00.358599 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-bf8b9fea-814d-41f6-a5ea-c47150a09a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:40:00.386103 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:00.451334 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 171/338] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:40:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 11:40:00.479794 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d473b8-fbeb-4136-8df0-ebccfc69cfcc None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:00.480128 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d473b8-fbeb-4136-8df0-ebccfc69cfcc None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:00.480347 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d473b8-fbeb-4136-8df0-ebccfc69cfcc None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:00.481848 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 168/339] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:40:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:40:00.488336 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e990731-a7aa-476a-8c1d-e77dac2fa0e6 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:00.488647 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e990731-a7aa-476a-8c1d-e77dac2fa0e6 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:00.488932 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e990731-a7aa-476a-8c1d-e77dac2fa0e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:00.512015 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-6e990731-a7aa-476a-8c1d-e77dac2fa0e6 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:40:00.513378 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-6e990731-a7aa-476a-8c1d-e77dac2fa0e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:40:00.530713 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d473b8-fbeb-4136-8df0-ebccfc69cfcc None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:00.628774 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 172/340] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:40:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 11:40:00.698314 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d473b8-fbeb-4136-8df0-ebccfc69cfcc None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:00.741261 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11ee33e-408b-4cf0-a203-9bf43f8a91cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:00.742627 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11ee33e-408b-4cf0-a203-9bf43f8a91cb None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:00.743377 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11ee33e-408b-4cf0-a203-9bf43f8a91cb None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:00.744010 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11ee33e-408b-4cf0-a203-9bf43f8a91cb None admin] PATH_INFO: `/v3/roles/member` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:00.766822 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11ee33e-408b-4cf0-a203-9bf43f8a91cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 11:40:00.773250 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-c11ee33e-408b-4cf0-a203-9bf43f8a91cb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 11:40:00.773250 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:00.773250 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:00.773250 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:00.773250 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:00.773250 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:00.773250 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:00.773250 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:00.773250 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:00.773250 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:00.773250 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:00.773250 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:00.773250 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 11:40:00.773250 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 11:40:00.773250 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 11:40:00.773250 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 11:40:00.774168 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 11:40:00.774168 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 11:40:00.774168 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 11:40:00.774168 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 11:40:00.774168 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:00.774168 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:00.774168 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:40:00.774168 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:40:00.774168 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:40:00.774168 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:40:00.774168 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:40:00.774168 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:40:00.774168 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:40:00.774168 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:40:00.774168 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:40:00.774168 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:40:00.774952 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:40:00.774952 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:40:00.774952 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:40:00.774952 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:40:00.774952 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 11:40:00.774952 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 11:40:00.774952 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 11:40:00.774952 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 11:40:00.774952 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 11:40:00.774952 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 11:40:00.774952 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 11:40:00.774952 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:40:00.777594 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 169/341] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Oct 4 11:40:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:40:00.784462 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e990731-a7aa-476a-8c1d-e77dac2fa0e6 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:00.895718 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11ee33e-408b-4cf0-a203-9bf43f8a91cb None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:00.903515 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:00.928536 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e990731-a7aa-476a-8c1d-e77dac2fa0e6 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:00.988573 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71814c9a-0b03-4351-8c3f-5ca5450a3902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:00.990047 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71814c9a-0b03-4351-8c3f-5ca5450a3902 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:00.990335 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71814c9a-0b03-4351-8c3f-5ca5450a3902 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:00.990606 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71814c9a-0b03-4351-8c3f-5ca5450a3902 None admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:00.991280 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71814c9a-0b03-4351-8c3f-5ca5450a3902 None admin] RBAC: Adding query filter params (name=member) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:00.991581 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71814c9a-0b03-4351-8c3f-5ca5450a3902 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:00.993179 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71814c9a-0b03-4351-8c3f-5ca5450a3902 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:00.994760 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:01.014348 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 173/342] 10.222.0.59 () {56 vars in 1101 bytes} [Tue Oct 4 11:40:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 11:40:01.021659 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71814c9a-0b03-4351-8c3f-5ca5450a3902 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:01.122769 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11ee33e-408b-4cf0-a203-9bf43f8a91cb None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:01.203765 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9b06c6-2584-4ea6-8b77-40f865514d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:01.204311 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9b06c6-2584-4ea6-8b77-40f865514d5f None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:01.204585 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9b06c6-2584-4ea6-8b77-40f865514d5f None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:01.204876 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9b06c6-2584-4ea6-8b77-40f865514d5f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:01.233179 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9b06c6-2584-4ea6-8b77-40f865514d5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 11:40:01.236283 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71814c9a-0b03-4351-8c3f-5ca5450a3902 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:01.238732 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-fa9b06c6-2584-4ea6-8b77-40f865514d5f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 11:40:01.238732 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:01.238732 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:01.238732 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:01.238732 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:01.238732 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:01.238732 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:01.238732 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:01.238732 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:01.238732 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:01.238732 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:01.238732 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:01.238732 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 11:40:01.238732 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 11:40:01.238732 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 11:40:01.238732 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 11:40:01.239674 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 11:40:01.239674 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 11:40:01.239674 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 11:40:01.239674 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 11:40:01.239674 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:01.239674 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:01.239674 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:40:01.239674 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:40:01.239674 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:40:01.239674 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:40:01.239674 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:40:01.239674 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:40:01.239674 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:40:01.239674 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:40:01.239674 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:40:01.239674 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:40:01.240485 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:40:01.240485 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:40:01.240485 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:40:01.240485 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:40:01.240485 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 11:40:01.240485 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 11:40:01.240485 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 11:40:01.240485 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 11:40:01.240485 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 11:40:01.240485 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 11:40:01.240485 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 11:40:01.240485 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:40:01.240485 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 170/343] 10.222.0.59 () {56 vars in 1114 bytes} [Tue Oct 4 11:40:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:40:01.251280 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9b06c6-2584-4ea6-8b77-40f865514d5f None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:01.291928 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9040fb-350e-4b40-a0a9-ece46716c362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:01.292539 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9040fb-350e-4b40-a0a9-ece46716c362 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:01.292847 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9040fb-350e-4b40-a0a9-ece46716c362 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:01.293118 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9040fb-350e-4b40-a0a9-ece46716c362 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:01.312957 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:01.369948 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9040fb-350e-4b40-a0a9-ece46716c362 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:01.371404 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9040fb-350e-4b40-a0a9-ece46716c362 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:01.385693 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9b06c6-2584-4ea6-8b77-40f865514d5f None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:01.401079 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:01.439041 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6322b520-828b-4950-ae61-9f7fd49fc7bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:01.439669 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6322b520-828b-4950-ae61-9f7fd49fc7bd None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:01.439950 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6322b520-828b-4950-ae61-9f7fd49fc7bd None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:01.440225 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6322b520-828b-4950-ae61-9f7fd49fc7bd None admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:01.440960 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6322b520-828b-4950-ae61-9f7fd49fc7bd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:01.441285 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6322b520-828b-4950-ae61-9f7fd49fc7bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:01.442827 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6322b520-828b-4950-ae61-9f7fd49fc7bd None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:01.458562 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 171/344] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Oct 4 11:40:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 11:40:01.460216 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63ee7dc-286d-412d-8afa-2df649185080 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:01.460216 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63ee7dc-286d-412d-8afa-2df649185080 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:01.460479 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63ee7dc-286d-412d-8afa-2df649185080 None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:01.466221 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 172/345] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:40:01 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:40:01.466978 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63ee7dc-286d-412d-8afa-2df649185080 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:01.496871 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 174/346] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Oct 4 11:40:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 04 11:40:01.498490 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988e1bed-c0f5-4cb2-9e9d-d5b70535a77b None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:01.498986 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988e1bed-c0f5-4cb2-9e9d-d5b70535a77b None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:01.499453 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988e1bed-c0f5-4cb2-9e9d-d5b70535a77b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:01.523927 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-988e1bed-c0f5-4cb2-9e9d-d5b70535a77b None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:40:01.525549 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-988e1bed-c0f5-4cb2-9e9d-d5b70535a77b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:40:01.579101 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:01.604088 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 175/347] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:40:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 11:40:01.605018 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988e1bed-c0f5-4cb2-9e9d-d5b70535a77b None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:01.653678 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63ee7dc-286d-412d-8afa-2df649185080 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:01.698480 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fa740c-3abe-4b7e-a128-19cf3859ff18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:01.699534 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fa740c-3abe-4b7e-a128-19cf3859ff18 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:01.699877 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fa740c-3abe-4b7e-a128-19cf3859ff18 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:01.700262 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fa740c-3abe-4b7e-a128-19cf3859ff18 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:01.715338 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fa740c-3abe-4b7e-a128-19cf3859ff18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 11:40:01.717641 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988e1bed-c0f5-4cb2-9e9d-d5b70535a77b None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:01.722897 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-51fa740c-3abe-4b7e-a128-19cf3859ff18 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 11:40:01.722897 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:01.722897 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:01.722897 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:01.722897 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:01.722897 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:01.722897 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:01.722897 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:01.722897 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:01.722897 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:01.722897 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:01.722897 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:01.722897 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 11:40:01.722897 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 11:40:01.722897 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 11:40:01.722897 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 11:40:01.724858 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 11:40:01.724858 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 11:40:01.724858 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 11:40:01.724858 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 11:40:01.724858 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:01.724858 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:01.724858 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:40:01.724858 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:40:01.724858 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:40:01.724858 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:40:01.724858 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:40:01.724858 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:40:01.724858 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:40:01.724858 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:40:01.724858 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:40:01.724858 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:40:01.725739 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:40:01.725739 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:40:01.725739 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:40:01.725739 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:40:01.725739 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 11:40:01.725739 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 11:40:01.725739 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 11:40:01.725739 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 11:40:01.725739 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 11:40:01.725739 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 11:40:01.725739 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 11:40:01.725739 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:40:01.725739 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 173/348] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Oct 4 11:40:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:40:01.725739 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fa740c-3abe-4b7e-a128-19cf3859ff18 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:01.761756 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:01.804382 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c0b2ef-6914-40d5-990f-a047ecc6e3cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:01.804382 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c0b2ef-6914-40d5-990f-a047ecc6e3cc None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:01.804382 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c0b2ef-6914-40d5-990f-a047ecc6e3cc None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:01.804382 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c0b2ef-6914-40d5-990f-a047ecc6e3cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:01.864913 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fa740c-3abe-4b7e-a128-19cf3859ff18 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:01.905840 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:01.930887 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c0b2ef-6914-40d5-990f-a047ecc6e3cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:01.933441 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c0b2ef-6914-40d5-990f-a047ecc6e3cc None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:01.962647 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cab86fb-0fc2-4a23-b0b3-af9c93c33c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:01.963298 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cab86fb-0fc2-4a23-b0b3-af9c93c33c67 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:01.963580 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cab86fb-0fc2-4a23-b0b3-af9c93c33c67 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:01.963855 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cab86fb-0fc2-4a23-b0b3-af9c93c33c67 None admin] PATH_INFO: `/v3/projects/3cce5af9f73d46be89fb61b08e04e408` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:01.969454 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cab86fb-0fc2-4a23-b0b3-af9c93c33c67 None admin] RBAC: Authorizing `identity:get_project(project_id=3cce5af9f73d46be89fb61b08e04e408)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:01.970816 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cab86fb-0fc2-4a23-b0b3-af9c93c33c67 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:01.972841 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 174/349] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Oct 4 11:40:01 2022] GET /identity/v3/projects/3cce5af9f73d46be89fb61b08e04e408 => generated 298 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:01.974209 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cab86fb-0fc2-4a23-b0b3-af9c93c33c67 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:02.062319 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 176/350] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Oct 4 11:40:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 11:40:02.063484 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c0b2ef-6914-40d5-990f-a047ecc6e3cc None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:02.084990 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:02.091471 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cab86fb-0fc2-4a23-b0b3-af9c93c33c67 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:02.133436 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09887d24-fdfc-4da3-9642-794d53839e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:02.135312 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09887d24-fdfc-4da3-9642-794d53839e3d None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:02.135813 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09887d24-fdfc-4da3-9642-794d53839e3d None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:02.136568 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09887d24-fdfc-4da3-9642-794d53839e3d None admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:02.137260 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09887d24-fdfc-4da3-9642-794d53839e3d None admin] RBAC: Adding query filter params (name=reader) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:02.137563 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09887d24-fdfc-4da3-9642-794d53839e3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:02.138923 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09887d24-fdfc-4da3-9642-794d53839e3d None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:02.152228 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 175/351] 10.222.0.59 () {56 vars in 1101 bytes} [Tue Oct 4 11:40:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:02.153176 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09887d24-fdfc-4da3-9642-794d53839e3d None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:02.163507 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:02.187017 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c0b2ef-6914-40d5-990f-a047ecc6e3cc None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:02.234768 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336c947e-8088-459f-a261-464a6ec64887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:02.236479 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336c947e-8088-459f-a261-464a6ec64887 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:02.237154 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336c947e-8088-459f-a261-464a6ec64887 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:02.237634 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336c947e-8088-459f-a261-464a6ec64887 None admin] PATH_INFO: `/v3/roles/member` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:02.252153 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336c947e-8088-459f-a261-464a6ec64887 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 11:40:02.258674 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-336c947e-8088-459f-a261-464a6ec64887 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 11:40:02.258674 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:02.258674 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:02.258674 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:02.258674 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:02.258674 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:02.258674 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:02.258674 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:02.258674 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:02.258674 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:02.258674 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:02.258674 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:02.258674 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 11:40:02.258674 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 11:40:02.258674 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 11:40:02.258674 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 11:40:02.259676 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 11:40:02.259676 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 11:40:02.259676 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 11:40:02.259676 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 11:40:02.259676 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:02.259676 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:02.259676 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:40:02.259676 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:40:02.259676 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:40:02.259676 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:40:02.259676 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:40:02.259676 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:40:02.259676 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:40:02.259676 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:40:02.259676 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:40:02.259676 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:40:02.260473 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:40:02.260473 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:40:02.260473 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:40:02.260473 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:40:02.260473 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 11:40:02.260473 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 11:40:02.260473 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 11:40:02.260473 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 11:40:02.260473 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 11:40:02.260473 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 11:40:02.260473 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 11:40:02.260473 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:40:02.268754 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 177/352] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Oct 4 11:40:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:40:02.270040 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336c947e-8088-459f-a261-464a6ec64887 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:02.294688 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09887d24-fdfc-4da3-9642-794d53839e3d None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:02.334888 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef7e927-3899-41d3-b692-95e9756ecafa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:02.335545 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef7e927-3899-41d3-b692-95e9756ecafa None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:02.335826 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef7e927-3899-41d3-b692-95e9756ecafa None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:02.336104 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef7e927-3899-41d3-b692-95e9756ecafa None admin] PATH_INFO: `/v3/groups/bf50c5df97c94d298b9a0c5de090dd62` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:02.342505 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef7e927-3899-41d3-b692-95e9756ecafa None admin] RBAC: Authorizing `identity:get_group(group_id=bf50c5df97c94d298b9a0c5de090dd62)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:02.344753 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef7e927-3899-41d3-b692-95e9756ecafa None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:02.347098 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 176/353] 10.222.0.59 () {56 vars in 1180 bytes} [Tue Oct 4 11:40:02 2022] GET /identity/v3/groups/bf50c5df97c94d298b9a0c5de090dd62 => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:02.348028 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef7e927-3899-41d3-b692-95e9756ecafa None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:02.377920 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:02.408581 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336c947e-8088-459f-a261-464a6ec64887 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:02.451571 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d633b73-f755-4741-8329-81573c5dde85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:02.452809 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d633b73-f755-4741-8329-81573c5dde85 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:02.453217 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d633b73-f755-4741-8329-81573c5dde85 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:02.453765 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d633b73-f755-4741-8329-81573c5dde85 None admin] PATH_INFO: `/v3/projects/3cce5af9f73d46be89fb61b08e04e408` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:02.454818 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d633b73-f755-4741-8329-81573c5dde85 None admin] RBAC: Authorizing `identity:get_project(project_id=3cce5af9f73d46be89fb61b08e04e408)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:02.456335 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d633b73-f755-4741-8329-81573c5dde85 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:02.458825 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 178/354] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Oct 4 11:40:02 2022] GET /identity/v3/projects/3cce5af9f73d46be89fb61b08e04e408 => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:02.459632 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d633b73-f755-4741-8329-81573c5dde85 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:02.469940 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:02.487621 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef7e927-3899-41d3-b692-95e9756ecafa None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:02.532572 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb94d94e-787e-4ad4-a229-8421f2963d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:02.533245 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb94d94e-787e-4ad4-a229-8421f2963d65 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:02.533527 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb94d94e-787e-4ad4-a229-8421f2963d65 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:02.533798 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb94d94e-787e-4ad4-a229-8421f2963d65 None admin] PATH_INFO: `/v3/users/4ab30b5df3a44298b3b12f0cbbd4ae11` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:02.534936 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb94d94e-787e-4ad4-a229-8421f2963d65 None admin] RBAC: Authorizing `identity:get_user(user_id=4ab30b5df3a44298b3b12f0cbbd4ae11)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:02.536985 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb94d94e-787e-4ad4-a229-8421f2963d65 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:02.539938 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 177/355] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Oct 4 11:40:02 2022] GET /identity/v3/users/4ab30b5df3a44298b3b12f0cbbd4ae11 => generated 293 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:02.539938 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb94d94e-787e-4ad4-a229-8421f2963d65 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:02.601127 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d633b73-f755-4741-8329-81573c5dde85 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:02.646610 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781d8b05-fb12-4895-b346-bafff9dc2de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:02.647608 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781d8b05-fb12-4895-b346-bafff9dc2de3 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:02.647893 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781d8b05-fb12-4895-b346-bafff9dc2de3 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:02.648166 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781d8b05-fb12-4895-b346-bafff9dc2de3 None admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:02.649410 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781d8b05-fb12-4895-b346-bafff9dc2de3 None admin] RBAC: Adding query filter params (name=member) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:02.649753 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781d8b05-fb12-4895-b346-bafff9dc2de3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:02.651138 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781d8b05-fb12-4895-b346-bafff9dc2de3 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:02.658926 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:02.663742 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 179/356] 10.222.0.59 () {56 vars in 1101 bytes} [Tue Oct 4 11:40:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:02.668728 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b897c60-b180-4b88-9e84-d646e7813b25 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:02.668728 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b897c60-b180-4b88-9e84-d646e7813b25 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:02.668728 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b897c60-b180-4b88-9e84-d646e7813b25 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:02.668728 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 180/357] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:40:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:40:02.668728 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b897c60-b180-4b88-9e84-d646e7813b25 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:02.683824 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb94d94e-787e-4ad4-a229-8421f2963d65 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:02.727615 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f083c356-7d20-4dad-8556-d8e26df27a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:02.728230 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f083c356-7d20-4dad-8556-d8e26df27a17 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:02.728514 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f083c356-7d20-4dad-8556-d8e26df27a17 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:02.728822 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f083c356-7d20-4dad-8556-d8e26df27a17 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:02.729551 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f083c356-7d20-4dad-8556-d8e26df27a17 None admin] RBAC: Adding query filter params (group.id=bf50c5df97c94d298b9a0c5de090dd62, role.id=ab4307f3b7994c1c80036fa7db93b6b9, scope.project.id=3cce5af9f73d46be89fb61b08e04e408) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:02.730145 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f083c356-7d20-4dad-8556-d8e26df27a17 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:02.731361 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f083c356-7d20-4dad-8556-d8e26df27a17 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:02.737870 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 178/358] 10.222.0.59 () {56 vars in 1376 bytes} [Tue Oct 4 11:40:02 2022] GET /identity/v3/role_assignments?group.id=bf50c5df97c94d298b9a0c5de090dd62&scope.project.id=3cce5af9f73d46be89fb61b08e04e408&role.id=ab4307f3b7994c1c80036fa7db93b6b9 => generated 260 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:02.738412 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f083c356-7d20-4dad-8556-d8e26df27a17 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:02.748120 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:02.800381 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b897c60-b180-4b88-9e84-d646e7813b25 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:02.842415 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c141b41-7440-4264-8713-f821509fa9f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:02.843063 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c141b41-7440-4264-8713-f821509fa9f8 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:02.843343 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c141b41-7440-4264-8713-f821509fa9f8 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:02.843620 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c141b41-7440-4264-8713-f821509fa9f8 None admin] PATH_INFO: `/v3/groups/bf50c5df97c94d298b9a0c5de090dd62` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:02.844960 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c141b41-7440-4264-8713-f821509fa9f8 None admin] RBAC: Authorizing `identity:get_group(group_id=bf50c5df97c94d298b9a0c5de090dd62)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:02.846542 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c141b41-7440-4264-8713-f821509fa9f8 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:02.848848 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 181/359] 10.222.0.59 () {56 vars in 1180 bytes} [Tue Oct 4 11:40:02 2022] GET /identity/v3/groups/bf50c5df97c94d298b9a0c5de090dd62 => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:02.850232 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c141b41-7440-4264-8713-f821509fa9f8 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:02.892945 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f083c356-7d20-4dad-8556-d8e26df27a17 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:02.946928 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e3e53d-194c-43bf-9d0b-b60668aca7ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:02.947558 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e3e53d-194c-43bf-9d0b-b60668aca7ad None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:02.947835 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e3e53d-194c-43bf-9d0b-b60668aca7ad None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:02.948106 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e3e53d-194c-43bf-9d0b-b60668aca7ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:02.948909 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e3e53d-194c-43bf-9d0b-b60668aca7ad None admin] RBAC: Adding query filter params (role.id=c5fcdf1a59b947a38d056240a270eb26, user.id=4ab30b5df3a44298b3b12f0cbbd4ae11, scope.system=all) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:02.949334 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e3e53d-194c-43bf-9d0b-b60668aca7ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:02.950793 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e3e53d-194c-43bf-9d0b-b60668aca7ad None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:02.967479 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 179/360] 10.222.0.59 () {56 vars in 1308 bytes} [Tue Oct 4 11:40:02 2022] GET /identity/v3/role_assignments?user.id=4ab30b5df3a44298b3b12f0cbbd4ae11&scope.system=all&role.id=c5fcdf1a59b947a38d056240a270eb26 => generated 510 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:02.968737 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6396c8f1-76f1-4e87-b476-c74e47212f54 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:02.969022 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6396c8f1-76f1-4e87-b476-c74e47212f54 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:02.969349 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6396c8f1-76f1-4e87-b476-c74e47212f54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:02.995467 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-6396c8f1-76f1-4e87-b476-c74e47212f54 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:40:02.996633 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-6396c8f1-76f1-4e87-b476-c74e47212f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:40:02.998737 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c141b41-7440-4264-8713-f821509fa9f8 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:03.000514 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:03.043051 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bf7e98-5ec3-4bc6-8757-b238bd0d9291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:03.043672 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bf7e98-5ec3-4bc6-8757-b238bd0d9291 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:03.043946 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bf7e98-5ec3-4bc6-8757-b238bd0d9291 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:03.044217 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bf7e98-5ec3-4bc6-8757-b238bd0d9291 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:03.049179 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:03.097040 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 180/361] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:40:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 11:40:03.098062 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6396c8f1-76f1-4e87-b476-c74e47212f54 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:03.164109 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bf7e98-5ec3-4bc6-8757-b238bd0d9291 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:03.165732 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bf7e98-5ec3-4bc6-8757-b238bd0d9291 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:03.263584 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6396c8f1-76f1-4e87-b476-c74e47212f54 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:03.301385 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ffe7d2-027c-4ab2-b8d9-65ca9d071950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:03.301993 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ffe7d2-027c-4ab2-b8d9-65ca9d071950 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:03.302270 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ffe7d2-027c-4ab2-b8d9-65ca9d071950 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:03.302532 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ffe7d2-027c-4ab2-b8d9-65ca9d071950 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:03.303260 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ffe7d2-027c-4ab2-b8d9-65ca9d071950 None admin] RBAC: Adding query filter params (group.id=bf50c5df97c94d298b9a0c5de090dd62, role.id=b6018afb40c74d19b8cadc402256f23d, scope.project.id=3cce5af9f73d46be89fb61b08e04e408) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:03.303560 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ffe7d2-027c-4ab2-b8d9-65ca9d071950 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:03.305028 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ffe7d2-027c-4ab2-b8d9-65ca9d071950 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:03.313102 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 181/362] 10.222.0.59 () {56 vars in 1376 bytes} [Tue Oct 4 11:40:03 2022] GET /identity/v3/role_assignments?group.id=bf50c5df97c94d298b9a0c5de090dd62&scope.project.id=3cce5af9f73d46be89fb61b08e04e408&role.id=b6018afb40c74d19b8cadc402256f23d => generated 260 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:03.314365 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597529ec-ea70-4e2a-a301-0f04b6738f55 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:03.314653 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597529ec-ea70-4e2a-a301-0f04b6738f55 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:03.314976 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597529ec-ea70-4e2a-a301-0f04b6738f55 None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:03.316455 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 182/363] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:40:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:40:03.322922 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89d1370-e1dc-4c7d-ba23-883d7c93b1f4 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:03.323311 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89d1370-e1dc-4c7d-ba23-883d7c93b1f4 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:03.323590 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89d1370-e1dc-4c7d-ba23-883d7c93b1f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:03.324744 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 182/364] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Oct 4 11:40:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 11:40:03.330053 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bf7e98-5ec3-4bc6-8757-b238bd0d9291 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:03.333311 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:03.348049 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-f89d1370-e1dc-4c7d-ba23-883d7c93b1f4 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:40:03.350133 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-f89d1370-e1dc-4c7d-ba23-883d7c93b1f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:40:03.394423 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:03.454480 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 183/365] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:40:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 11:40:03.457838 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89d1370-e1dc-4c7d-ba23-883d7c93b1f4 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:03.473998 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bf7e98-5ec3-4bc6-8757-b238bd0d9291 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:03.525131 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19006185-0f16-48c7-b75e-b2e0f8430a52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:03.525955 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19006185-0f16-48c7-b75e-b2e0f8430a52 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:03.527017 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19006185-0f16-48c7-b75e-b2e0f8430a52 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:03.527299 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19006185-0f16-48c7-b75e-b2e0f8430a52 None admin] PATH_INFO: `/v3/projects/c883e45022464667b26d995f7ba3657d` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:03.528693 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19006185-0f16-48c7-b75e-b2e0f8430a52 None admin] RBAC: Authorizing `identity:get_project(project_id=c883e45022464667b26d995f7ba3657d)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:03.532478 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19006185-0f16-48c7-b75e-b2e0f8430a52 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:03.539531 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 183/366] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Oct 4 11:40:03 2022] GET /identity/v3/projects/c883e45022464667b26d995f7ba3657d => generated 302 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 11:40:03.545816 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19006185-0f16-48c7-b75e-b2e0f8430a52 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:03.716502 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19006185-0f16-48c7-b75e-b2e0f8430a52 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:03.720539 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:03.732263 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89d1370-e1dc-4c7d-ba23-883d7c93b1f4 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:03.779052 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56f4da7-e17a-482f-bc4e-c7eda63d769c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:03.779610 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56f4da7-e17a-482f-bc4e-c7eda63d769c None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:03.779890 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56f4da7-e17a-482f-bc4e-c7eda63d769c None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:03.780162 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56f4da7-e17a-482f-bc4e-c7eda63d769c None admin] PATH_INFO: `/v3/groups/bf50c5df97c94d298b9a0c5de090dd62` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:03.781535 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56f4da7-e17a-482f-bc4e-c7eda63d769c None admin] RBAC: Authorizing `identity:get_group(group_id=bf50c5df97c94d298b9a0c5de090dd62)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:03.782987 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56f4da7-e17a-482f-bc4e-c7eda63d769c None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:03.786394 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 184/367] 10.222.0.59 () {56 vars in 1180 bytes} [Tue Oct 4 11:40:03 2022] GET /identity/v3/groups/bf50c5df97c94d298b9a0c5de090dd62 => generated 226 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:03.791738 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56f4da7-e17a-482f-bc4e-c7eda63d769c None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:03.807002 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e07e683-85f8-4744-8263-81ac298308fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:03.807696 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e07e683-85f8-4744-8263-81ac298308fa None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:03.807980 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e07e683-85f8-4744-8263-81ac298308fa None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:03.808248 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e07e683-85f8-4744-8263-81ac298308fa None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:03.812141 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:03.831342 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e07e683-85f8-4744-8263-81ac298308fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 11:40:03.837216 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-7e07e683-85f8-4744-8263-81ac298308fa None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 11:40:03.837216 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:03.837216 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:03.837216 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:03.837216 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:03.837216 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:03.837216 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:03.837216 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:03.837216 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:03.837216 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:03.837216 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:03.837216 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:03.837216 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 11:40:03.837216 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 11:40:03.837216 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 11:40:03.837216 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 11:40:03.838153 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 11:40:03.838153 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 11:40:03.838153 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 11:40:03.838153 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 11:40:03.838153 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:03.838153 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:03.838153 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:40:03.838153 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:40:03.838153 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:40:03.838153 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:40:03.838153 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:40:03.838153 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:40:03.838153 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:40:03.838153 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:40:03.838153 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:40:03.838153 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:40:03.838958 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:40:03.838958 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:40:03.838958 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:40:03.838958 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:40:03.838958 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 11:40:03.838958 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 11:40:03.838958 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 11:40:03.838958 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 11:40:03.838958 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 11:40:03.838958 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 11:40:03.838958 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 11:40:03.838958 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:40:03.838958 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 184/368] 10.222.0.59 () {56 vars in 1114 bytes} [Tue Oct 4 11:40:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 381 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 11:40:03.839633 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e07e683-85f8-4744-8263-81ac298308fa None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:03.945023 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56f4da7-e17a-482f-bc4e-c7eda63d769c None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:03.964241 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e07e683-85f8-4744-8263-81ac298308fa None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:03.997533 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b51c50-7980-4731-986a-3d70ed21b5d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:03.998757 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b51c50-7980-4731-986a-3d70ed21b5d0 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:03.999920 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b51c50-7980-4731-986a-3d70ed21b5d0 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:04.000806 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b51c50-7980-4731-986a-3d70ed21b5d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:04.002048 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b51c50-7980-4731-986a-3d70ed21b5d0 None admin] RBAC: Adding query filter params (group.id=bf50c5df97c94d298b9a0c5de090dd62, role.id=ab4307f3b7994c1c80036fa7db93b6b9, scope.project.id=c883e45022464667b26d995f7ba3657d) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:04.002802 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b51c50-7980-4731-986a-3d70ed21b5d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:04.005199 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b51c50-7980-4731-986a-3d70ed21b5d0 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:04.008855 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08a3327-2a8b-4983-a542-56f7c5bafeac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:04.009189 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a3327-2a8b-4983-a542-56f7c5bafeac None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:04.009472 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a3327-2a8b-4983-a542-56f7c5bafeac None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:04.009748 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a3327-2a8b-4983-a542-56f7c5bafeac None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:04.013304 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 185/369] 10.222.0.59 () {56 vars in 1376 bytes} [Tue Oct 4 11:40:03 2022] GET /identity/v3/role_assignments?group.id=bf50c5df97c94d298b9a0c5de090dd62&scope.project.id=c883e45022464667b26d995f7ba3657d&role.id=ab4307f3b7994c1c80036fa7db93b6b9 => generated 260 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:04.014313 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b51c50-7980-4731-986a-3d70ed21b5d0 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:04.037484 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08a3327-2a8b-4983-a542-56f7c5bafeac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 11:40:04.042908 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-c08a3327-2a8b-4983-a542-56f7c5bafeac None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 11:40:04.042908 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:04.042908 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:04.042908 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:04.042908 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:04.042908 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:04.042908 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:04.042908 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:04.042908 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:04.042908 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:04.042908 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:04.042908 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:04.042908 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 11:40:04.042908 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 11:40:04.042908 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 11:40:04.042908 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 11:40:04.043884 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 11:40:04.043884 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 11:40:04.043884 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 11:40:04.043884 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 11:40:04.043884 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:04.043884 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:04.043884 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:40:04.043884 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:40:04.043884 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:40:04.043884 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:40:04.043884 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:40:04.043884 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:40:04.043884 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:40:04.043884 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:40:04.043884 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:40:04.043884 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:40:04.044735 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:40:04.044735 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:40:04.044735 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:40:04.044735 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:40:04.044735 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 11:40:04.044735 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 11:40:04.044735 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 11:40:04.044735 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 11:40:04.044735 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 11:40:04.044735 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 11:40:04.044735 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 11:40:04.044735 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:40:04.047785 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 185/370] 10.222.0.59 () {56 vars in 1096 bytes} [Tue Oct 4 11:40:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:40:04.054757 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08a3327-2a8b-4983-a542-56f7c5bafeac None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:04.123245 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:04.175181 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:04.178170 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08a3327-2a8b-4983-a542-56f7c5bafeac None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:04.218277 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bc6f5a-1381-4175-83cc-3c12d251dff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:04.218956 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bc6f5a-1381-4175-83cc-3c12d251dff0 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:04.219230 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bc6f5a-1381-4175-83cc-3c12d251dff0 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:04.219497 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bc6f5a-1381-4175-83cc-3c12d251dff0 None admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:04.220362 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bc6f5a-1381-4175-83cc-3c12d251dff0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:04.220698 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bc6f5a-1381-4175-83cc-3c12d251dff0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:04.224473 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bc6f5a-1381-4175-83cc-3c12d251dff0 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:04.235144 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 186/371] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Oct 4 11:40:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:04.240977 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bc6f5a-1381-4175-83cc-3c12d251dff0 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:04.299424 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b51c50-7980-4731-986a-3d70ed21b5d0 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:04.358149 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bc6f5a-1381-4175-83cc-3c12d251dff0 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:04.377146 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:04.382230 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16704aa4-1472-47c6-af1c-42f3fc19892c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:04.383247 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16704aa4-1472-47c6-af1c-42f3fc19892c None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:04.383247 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16704aa4-1472-47c6-af1c-42f3fc19892c None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:04.383473 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16704aa4-1472-47c6-af1c-42f3fc19892c None admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:04.384176 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16704aa4-1472-47c6-af1c-42f3fc19892c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:04.384480 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16704aa4-1472-47c6-af1c-42f3fc19892c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:04.385966 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16704aa4-1472-47c6-af1c-42f3fc19892c None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:04.399341 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4325675-5589-4f3f-8663-4d3f5a6ad8c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:04.400197 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4325675-5589-4f3f-8663-4d3f5a6ad8c1 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:04.400645 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4325675-5589-4f3f-8663-4d3f5a6ad8c1 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:04.401062 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4325675-5589-4f3f-8663-4d3f5a6ad8c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:04.408709 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 186/372] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Oct 4 11:40:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 390 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:04.427132 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16704aa4-1472-47c6-af1c-42f3fc19892c None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:04.488399 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4325675-5589-4f3f-8663-4d3f5a6ad8c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:04.491301 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4325675-5589-4f3f-8663-4d3f5a6ad8c1 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:04.610842 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 187/373] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Oct 4 11:40:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 04 11:40:04.616112 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4325675-5589-4f3f-8663-4d3f5a6ad8c1 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:04.636201 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:04.694457 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:04.710571 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16704aa4-1472-47c6-af1c-42f3fc19892c None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:04.728014 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4325675-5589-4f3f-8663-4d3f5a6ad8c1 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:04.766391 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89eb92d-5715-4c5e-ace9-5d69b1783614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:04.767082 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89eb92d-5715-4c5e-ace9-5d69b1783614 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:04.767367 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89eb92d-5715-4c5e-ace9-5d69b1783614 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:04.767640 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89eb92d-5715-4c5e-ace9-5d69b1783614 None admin] PATH_INFO: `/v3/projects/f4d88030405047648869d4fa21dc117c` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:04.768808 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89eb92d-5715-4c5e-ace9-5d69b1783614 None admin] RBAC: Authorizing `identity:get_project(project_id=f4d88030405047648869d4fa21dc117c)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:04.771093 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89eb92d-5715-4c5e-ace9-5d69b1783614 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:04.773125 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 188/374] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Oct 4 11:40:04 2022] GET /identity/v3/projects/f4d88030405047648869d4fa21dc117c => generated 344 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:04.780091 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89eb92d-5715-4c5e-ace9-5d69b1783614 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:04.834006 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655c1eff-0995-4940-807b-d287ca52e701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:04.834632 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655c1eff-0995-4940-807b-d287ca52e701 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:04.834912 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655c1eff-0995-4940-807b-d287ca52e701 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:04.835186 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655c1eff-0995-4940-807b-d287ca52e701 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:04.893149 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:04.899741 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89eb92d-5715-4c5e-ace9-5d69b1783614 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:04.948844 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87dd643-2f57-4fef-98cb-e30cd977c9d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:04.949547 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87dd643-2f57-4fef-98cb-e30cd977c9d5 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:04.949832 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87dd643-2f57-4fef-98cb-e30cd977c9d5 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:04.950156 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87dd643-2f57-4fef-98cb-e30cd977c9d5 None admin] PATH_INFO: `/v3/groups/08ce265b567a454bbdeebb8379b6f218` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:04.956364 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87dd643-2f57-4fef-98cb-e30cd977c9d5 None admin] RBAC: Authorizing `identity:get_group(group_id=08ce265b567a454bbdeebb8379b6f218)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:04.958317 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87dd643-2f57-4fef-98cb-e30cd977c9d5 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:04.960732 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 189/375] 10.222.0.59 () {56 vars in 1180 bytes} [Tue Oct 4 11:40:04 2022] GET /identity/v3/groups/08ce265b567a454bbdeebb8379b6f218 => generated 229 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 11:40:04.967164 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87dd643-2f57-4fef-98cb-e30cd977c9d5 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:05.027280 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655c1eff-0995-4940-807b-d287ca52e701 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:05.027280 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655c1eff-0995-4940-807b-d287ca52e701 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:05.085220 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87dd643-2f57-4fef-98cb-e30cd977c9d5 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:05.133167 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4648fd-0c59-49b8-9432-ea4603bea3f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:05.133821 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4648fd-0c59-49b8-9432-ea4603bea3f9 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:05.134046 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4648fd-0c59-49b8-9432-ea4603bea3f9 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:05.134327 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4648fd-0c59-49b8-9432-ea4603bea3f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:05.135055 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4648fd-0c59-49b8-9432-ea4603bea3f9 None admin] RBAC: Adding query filter params (group.id=08ce265b567a454bbdeebb8379b6f218, role.id=d6e7421d1ff9451c808004b818354550, scope.project.id=f4d88030405047648869d4fa21dc117c) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:05.135362 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4648fd-0c59-49b8-9432-ea4603bea3f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:05.136828 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4648fd-0c59-49b8-9432-ea4603bea3f9 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:05.151751 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 190/376] 10.222.0.59 () {56 vars in 1376 bytes} [Tue Oct 4 11:40:04 2022] GET /identity/v3/role_assignments?group.id=08ce265b567a454bbdeebb8379b6f218&scope.project.id=f4d88030405047648869d4fa21dc117c&role.id=d6e7421d1ff9451c808004b818354550 => generated 260 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 11:40:05.215063 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:05.227099 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 187/377] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Oct 4 11:40:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 801 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 04 11:40:05.232760 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4648fd-0c59-49b8-9432-ea4603bea3f9 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:05.257581 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:05.373680 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4648fd-0c59-49b8-9432-ea4603bea3f9 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:05.392555 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2396632-a58a-4969-b77d-81941a685392 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:05.392905 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2396632-a58a-4969-b77d-81941a685392 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:05.393135 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2396632-a58a-4969-b77d-81941a685392 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:05.394643 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 188/378] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:40:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 11:40:05.403926 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46ec3b5-0614-47c1-883b-7d74e70dc121 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:05.404281 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46ec3b5-0614-47c1-883b-7d74e70dc121 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:05.404680 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46ec3b5-0614-47c1-883b-7d74e70dc121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:05.431743 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-b46ec3b5-0614-47c1-883b-7d74e70dc121 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:40:05.433138 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-b46ec3b5-0614-47c1-883b-7d74e70dc121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:40:05.435725 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da571716-5cd9-46d1-9206-b699ca6a42bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:05.436562 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da571716-5cd9-46d1-9206-b699ca6a42bc None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:05.436997 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da571716-5cd9-46d1-9206-b699ca6a42bc None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:05.437422 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da571716-5cd9-46d1-9206-b699ca6a42bc None admin] PATH_INFO: `/v3/projects/c883e45022464667b26d995f7ba3657d` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:05.438610 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da571716-5cd9-46d1-9206-b699ca6a42bc None admin] RBAC: Authorizing `identity:get_project(project_id=c883e45022464667b26d995f7ba3657d)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:05.440036 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da571716-5cd9-46d1-9206-b699ca6a42bc None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:05.442509 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 191/379] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Oct 4 11:40:05 2022] GET /identity/v3/projects/c883e45022464667b26d995f7ba3657d => generated 302 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:05.449855 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da571716-5cd9-46d1-9206-b699ca6a42bc None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:05.570786 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 189/380] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:40:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 11:40:05.579125 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:05.600581 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da571716-5cd9-46d1-9206-b699ca6a42bc None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:05.642727 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a700b432-bd3e-476a-8513-7b6e4205eb1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:05.643721 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a700b432-bd3e-476a-8513-7b6e4205eb1f None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:05.644003 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a700b432-bd3e-476a-8513-7b6e4205eb1f None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:05.644278 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a700b432-bd3e-476a-8513-7b6e4205eb1f None admin] PATH_INFO: `/v3/groups/bf50c5df97c94d298b9a0c5de090dd62` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:05.645615 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a700b432-bd3e-476a-8513-7b6e4205eb1f None admin] RBAC: Authorizing `identity:get_group(group_id=bf50c5df97c94d298b9a0c5de090dd62)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:05.647042 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a700b432-bd3e-476a-8513-7b6e4205eb1f None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:05.648633 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 192/381] 10.222.0.59 () {56 vars in 1180 bytes} [Tue Oct 4 11:40:05 2022] GET /identity/v3/groups/bf50c5df97c94d298b9a0c5de090dd62 => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:05.654710 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46ec3b5-0614-47c1-883b-7d74e70dc121 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:05.792098 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46ec3b5-0614-47c1-883b-7d74e70dc121 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:05.824719 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:05.835664 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4210cc76-c9aa-4d65-967a-878a1751870d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:05.836273 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4210cc76-c9aa-4d65-967a-878a1751870d None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:05.836552 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4210cc76-c9aa-4d65-967a-878a1751870d None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:05.836856 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4210cc76-c9aa-4d65-967a-878a1751870d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:05.843445 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4210cc76-c9aa-4d65-967a-878a1751870d None admin] RBAC: Adding query filter params (group.id=bf50c5df97c94d298b9a0c5de090dd62, role.id=b6018afb40c74d19b8cadc402256f23d, scope.project.id=c883e45022464667b26d995f7ba3657d) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:05.843445 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4210cc76-c9aa-4d65-967a-878a1751870d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:05.843445 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4210cc76-c9aa-4d65-967a-878a1751870d None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:05.845434 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 190/382] 10.222.0.59 () {56 vars in 1376 bytes} [Tue Oct 4 11:40:05 2022] GET /identity/v3/role_assignments?group.id=bf50c5df97c94d298b9a0c5de090dd62&scope.project.id=c883e45022464667b26d995f7ba3657d&role.id=b6018afb40c74d19b8cadc402256f23d => generated 260 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:05.867573 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a700b432-bd3e-476a-8513-7b6e4205eb1f None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:06.043020 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a700b432-bd3e-476a-8513-7b6e4205eb1f None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:06.096229 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5960e57e-e5d1-4efc-98f2-e5cc8597f89e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:06.096918 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5960e57e-e5d1-4efc-98f2-e5cc8597f89e None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:06.097204 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5960e57e-e5d1-4efc-98f2-e5cc8597f89e None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:06.097475 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5960e57e-e5d1-4efc-98f2-e5cc8597f89e None admin] PATH_INFO: `/v3/roles/member` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:06.115391 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5960e57e-e5d1-4efc-98f2-e5cc8597f89e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 11:40:06.120780 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-5960e57e-e5d1-4efc-98f2-e5cc8597f89e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 11:40:06.120780 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:06.120780 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:06.120780 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:06.120780 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:06.120780 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:06.120780 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:06.120780 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:06.120780 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:06.120780 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:06.120780 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:06.120780 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:06.120780 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 11:40:06.120780 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 11:40:06.120780 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 11:40:06.120780 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 11:40:06.121690 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 11:40:06.121690 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 11:40:06.121690 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 11:40:06.121690 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 11:40:06.121690 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:06.121690 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:06.121690 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:40:06.121690 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:40:06.121690 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:40:06.121690 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:40:06.121690 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:40:06.121690 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:40:06.121690 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:40:06.121690 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:40:06.121690 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:40:06.121690 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:40:06.122483 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:40:06.122483 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:40:06.122483 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:40:06.122483 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:40:06.122483 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 11:40:06.122483 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 11:40:06.122483 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 11:40:06.122483 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 11:40:06.122483 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 11:40:06.122483 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 11:40:06.122483 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 11:40:06.122483 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:40:06.124703 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 193/383] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Oct 4 11:40:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:40:06.129831 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4210cc76-c9aa-4d65-967a-878a1751870d None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:06.252147 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4210cc76-c9aa-4d65-967a-878a1751870d None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:06.298407 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df628bf-369a-4483-886f-6758ff794a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:06.299350 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df628bf-369a-4483-886f-6758ff794a13 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:06.299840 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df628bf-369a-4483-886f-6758ff794a13 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:06.300317 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df628bf-369a-4483-886f-6758ff794a13 None admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:06.301255 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df628bf-369a-4483-886f-6758ff794a13 None admin] RBAC: Adding query filter params (name=member) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:06.301841 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df628bf-369a-4483-886f-6758ff794a13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:06.303396 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df628bf-369a-4483-886f-6758ff794a13 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:06.316054 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 191/384] 10.222.0.59 () {56 vars in 1101 bytes} [Tue Oct 4 11:40:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:06.322548 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5960e57e-e5d1-4efc-98f2-e5cc8597f89e None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:06.334891 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:06.354732 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e06545-4d0c-4237-80b3-5c1d8aa72a29 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:06.355067 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e06545-4d0c-4237-80b3-5c1d8aa72a29 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:06.355273 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e06545-4d0c-4237-80b3-5c1d8aa72a29 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:06.356616 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 192/385] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:40:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:40:06.361950 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96315d64-38d4-46d5-8721-ff41d52eb800 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:06.362229 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96315d64-38d4-46d5-8721-ff41d52eb800 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:06.362497 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96315d64-38d4-46d5-8721-ff41d52eb800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:06.389586 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-96315d64-38d4-46d5-8721-ff41d52eb800 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:40:06.390834 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-96315d64-38d4-46d5-8721-ff41d52eb800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:40:06.490486 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:06.520130 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 193/386] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:40:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 11:40:06.528623 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5960e57e-e5d1-4efc-98f2-e5cc8597f89e None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:06.564338 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffc5fa1-5e8d-4f53-bf68-39b0cc62cab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:06.564930 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffc5fa1-5e8d-4f53-bf68-39b0cc62cab6 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:06.565205 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffc5fa1-5e8d-4f53-bf68-39b0cc62cab6 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:06.565471 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffc5fa1-5e8d-4f53-bf68-39b0cc62cab6 None admin] PATH_INFO: `/v3/groups/bf50c5df97c94d298b9a0c5de090dd62` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:06.569266 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffc5fa1-5e8d-4f53-bf68-39b0cc62cab6 None admin] RBAC: Authorizing `identity:get_group(group_id=bf50c5df97c94d298b9a0c5de090dd62)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:06.570722 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffc5fa1-5e8d-4f53-bf68-39b0cc62cab6 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:06.572310 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 194/387] 10.222.0.59 () {56 vars in 1180 bytes} [Tue Oct 4 11:40:06 2022] GET /identity/v3/groups/bf50c5df97c94d298b9a0c5de090dd62 => generated 226 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:06.577791 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96315d64-38d4-46d5-8721-ff41d52eb800 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:06.718247 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96315d64-38d4-46d5-8721-ff41d52eb800 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:06.764960 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea11d5af-8770-4014-9066-ad34bafa11b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:06.765593 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea11d5af-8770-4014-9066-ad34bafa11b7 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:06.765868 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea11d5af-8770-4014-9066-ad34bafa11b7 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:06.766136 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea11d5af-8770-4014-9066-ad34bafa11b7 None admin] PATH_INFO: `/v3/projects/3cce5af9f73d46be89fb61b08e04e408` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:06.773298 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea11d5af-8770-4014-9066-ad34bafa11b7 None admin] RBAC: Authorizing `identity:get_project(project_id=3cce5af9f73d46be89fb61b08e04e408)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:06.774755 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea11d5af-8770-4014-9066-ad34bafa11b7 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:06.776385 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 194/388] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Oct 4 11:40:06 2022] GET /identity/v3/projects/3cce5af9f73d46be89fb61b08e04e408 => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:06.782011 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffc5fa1-5e8d-4f53-bf68-39b0cc62cab6 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:06.840137 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea11d5af-8770-4014-9066-ad34bafa11b7 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:06.909028 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:06.921850 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffc5fa1-5e8d-4f53-bf68-39b0cc62cab6 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:06.948992 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:06.996565 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181f4843-3c1f-4859-bdb1-7b2823eefd29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:06.997277 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181f4843-3c1f-4859-bdb1-7b2823eefd29 None admin] REQUEST_METHOD: `PUT` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:06.997554 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181f4843-3c1f-4859-bdb1-7b2823eefd29 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:06.997822 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181f4843-3c1f-4859-bdb1-7b2823eefd29 None admin] PATH_INFO: `/v3/projects/3cce5af9f73d46be89fb61b08e04e408/groups/bf50c5df97c94d298b9a0c5de090dd62/roles/ab4307f3b7994c1c80036fa7db93b6b9` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:07.002113 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181f4843-3c1f-4859-bdb1-7b2823eefd29 None admin] RBAC: Authorizing `identity:create_grant(project_id=3cce5af9f73d46be89fb61b08e04e408, group_id=bf50c5df97c94d298b9a0c5de090dd62, role_id=ab4307f3b7994c1c80036fa7db93b6b9)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:07.003599 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181f4843-3c1f-4859-bdb1-7b2823eefd29 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:07.035281 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea11d5af-8770-4014-9066-ad34bafa11b7 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:07.074367 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852986e1-4b70-489f-82f8-16e0d0cc212d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:07.074991 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852986e1-4b70-489f-82f8-16e0d0cc212d None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:07.075266 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852986e1-4b70-489f-82f8-16e0d0cc212d None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:07.075598 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852986e1-4b70-489f-82f8-16e0d0cc212d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:07.086087 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 195/389] 10.222.0.59 () {58 vars in 1442 bytes} [Tue Oct 4 11:40:06 2022] PUT /identity/v3/projects/3cce5af9f73d46be89fb61b08e04e408/groups/bf50c5df97c94d298b9a0c5de090dd62/roles/ab4307f3b7994c1c80036fa7db93b6b9 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 11:40:07.093714 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852986e1-4b70-489f-82f8-16e0d0cc212d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 11:40:07.100575 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-852986e1-4b70-489f-82f8-16e0d0cc212d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 11:40:07.100575 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:07.100575 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:07.100575 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:07.100575 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:07.100575 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:07.100575 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:07.100575 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:07.100575 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:07.100575 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:07.100575 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:07.100575 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:07.100575 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 11:40:07.100575 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 11:40:07.100575 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 11:40:07.100575 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 11:40:07.101606 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 11:40:07.101606 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 11:40:07.101606 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 11:40:07.101606 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 11:40:07.101606 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:07.101606 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:07.101606 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:40:07.101606 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:40:07.101606 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:40:07.101606 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:40:07.101606 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:40:07.101606 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:40:07.101606 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:40:07.101606 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:40:07.101606 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:40:07.101606 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:40:07.103105 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:40:07.103105 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:40:07.103105 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:40:07.103105 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:40:07.103105 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 11:40:07.103105 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 11:40:07.103105 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 11:40:07.103105 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 11:40:07.103105 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 11:40:07.103105 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 11:40:07.103105 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 11:40:07.103105 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:40:07.103105 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 195/390] 10.222.0.59 () {56 vars in 1114 bytes} [Tue Oct 4 11:40:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:40:07.107975 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181f4843-3c1f-4859-bdb1-7b2823eefd29 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:07.148734 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f6fe61-f757-4280-bcba-0a2d5fff0524 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:07.149295 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f6fe61-f757-4280-bcba-0a2d5fff0524 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:07.149295 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f6fe61-f757-4280-bcba-0a2d5fff0524 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:07.150620 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 196/391] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:40:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 11:40:07.158023 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2806b116-0650-4d42-93d2-eb066b47b4d7 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:07.158327 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2806b116-0650-4d42-93d2-eb066b47b4d7 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:07.158552 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2806b116-0650-4d42-93d2-eb066b47b4d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:07.188626 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-2806b116-0650-4d42-93d2-eb066b47b4d7 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:40:07.190002 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-2806b116-0650-4d42-93d2-eb066b47b4d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:40:07.291366 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 197/392] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:40:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 11:40:07.308692 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181f4843-3c1f-4859-bdb1-7b2823eefd29 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:07.350192 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2750d41-217e-4da9-85c2-0875668136a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:07.350789 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2750d41-217e-4da9-85c2-0875668136a9 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:07.351002 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2750d41-217e-4da9-85c2-0875668136a9 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:07.351238 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2750d41-217e-4da9-85c2-0875668136a9 None admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:07.351906 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2750d41-217e-4da9-85c2-0875668136a9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:07.352204 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2750d41-217e-4da9-85c2-0875668136a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:07.354999 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2750d41-217e-4da9-85c2-0875668136a9 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:07.357527 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:07.365776 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 196/393] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Oct 4 11:40:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:07.371383 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2806b116-0650-4d42-93d2-eb066b47b4d7 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:07.424289 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:07.485674 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2806b116-0650-4d42-93d2-eb066b47b4d7 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:07.530111 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13864a3d-baa7-499b-9dee-6bebbb32a102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:07.530753 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13864a3d-baa7-499b-9dee-6bebbb32a102 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:07.531032 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13864a3d-baa7-499b-9dee-6bebbb32a102 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:07.531366 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13864a3d-baa7-499b-9dee-6bebbb32a102 None admin] PATH_INFO: `/v3/groups/bf50c5df97c94d298b9a0c5de090dd62` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:07.532489 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13864a3d-baa7-499b-9dee-6bebbb32a102 None admin] RBAC: Authorizing `identity:get_group(group_id=bf50c5df97c94d298b9a0c5de090dd62)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:07.534005 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13864a3d-baa7-499b-9dee-6bebbb32a102 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:07.536946 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 198/394] 10.222.0.59 () {56 vars in 1180 bytes} [Tue Oct 4 11:40:07 2022] GET /identity/v3/groups/bf50c5df97c94d298b9a0c5de090dd62 => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:07.542788 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2750d41-217e-4da9-85c2-0875668136a9 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:07.637428 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13864a3d-baa7-499b-9dee-6bebbb32a102 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:07.655234 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2750d41-217e-4da9-85c2-0875668136a9 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:07.695025 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db18640f-ef7e-4225-b164-335fe22b77d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:07.695855 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db18640f-ef7e-4225-b164-335fe22b77d8 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:07.696137 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db18640f-ef7e-4225-b164-335fe22b77d8 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:07.696464 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db18640f-ef7e-4225-b164-335fe22b77d8 None admin] PATH_INFO: `/v3/projects/3cce5af9f73d46be89fb61b08e04e408` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:07.697643 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db18640f-ef7e-4225-b164-335fe22b77d8 None admin] RBAC: Authorizing `identity:get_project(project_id=3cce5af9f73d46be89fb61b08e04e408)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:07.699432 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db18640f-ef7e-4225-b164-335fe22b77d8 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:07.702375 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 197/395] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Oct 4 11:40:07 2022] GET /identity/v3/projects/3cce5af9f73d46be89fb61b08e04e408 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:07.708535 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db18640f-ef7e-4225-b164-335fe22b77d8 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:07.789028 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:07.824944 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db18640f-ef7e-4225-b164-335fe22b77d8 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:07.859792 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13864a3d-baa7-499b-9dee-6bebbb32a102 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:07.865078 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fbd62a-c063-4b5c-965c-0dca5c520c55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:07.865755 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fbd62a-c063-4b5c-965c-0dca5c520c55 None admin] REQUEST_METHOD: `PUT` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:07.866035 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fbd62a-c063-4b5c-965c-0dca5c520c55 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:07.866313 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fbd62a-c063-4b5c-965c-0dca5c520c55 None admin] PATH_INFO: `/v3/projects/3cce5af9f73d46be89fb61b08e04e408/groups/bf50c5df97c94d298b9a0c5de090dd62/roles/b6018afb40c74d19b8cadc402256f23d` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:07.868887 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fbd62a-c063-4b5c-965c-0dca5c520c55 None admin] RBAC: Authorizing `identity:create_grant(project_id=3cce5af9f73d46be89fb61b08e04e408, group_id=bf50c5df97c94d298b9a0c5de090dd62, role_id=b6018afb40c74d19b8cadc402256f23d)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:07.872652 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fbd62a-c063-4b5c-965c-0dca5c520c55 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:07.879882 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:07.922307 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555618a9-256f-40b1-b632-b516f97907fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:07.923166 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555618a9-256f-40b1-b632-b516f97907fd None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:07.923589 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555618a9-256f-40b1-b632-b516f97907fd None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:07.924045 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555618a9-256f-40b1-b632-b516f97907fd None admin] PATH_INFO: `/v3/roles/member` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:07.939780 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555618a9-256f-40b1-b632-b516f97907fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 11:40:07.946138 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-555618a9-256f-40b1-b632-b516f97907fd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 11:40:07.946138 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:07.946138 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:07.946138 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:07.946138 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:07.946138 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:07.946138 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:07.946138 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:07.946138 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:07.946138 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:07.946138 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:07.946138 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:07.946138 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 11:40:07.946138 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 11:40:07.946138 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 11:40:07.946138 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 11:40:07.947209 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 11:40:07.947209 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 11:40:07.947209 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 11:40:07.947209 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 11:40:07.947209 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:07.947209 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:07.947209 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:40:07.947209 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:40:07.947209 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:40:07.947209 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:40:07.947209 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:40:07.947209 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:40:07.947209 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:40:07.947209 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:40:07.947209 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:40:07.947209 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:40:07.948218 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:40:07.948218 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:40:07.948218 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:40:07.948218 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:40:07.948218 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 11:40:07.948218 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 11:40:07.948218 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 11:40:07.948218 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 11:40:07.948218 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 11:40:07.948218 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 11:40:07.948218 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 11:40:07.948218 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:40:07.951946 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 199/396] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Oct 4 11:40:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:40:07.960627 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555618a9-256f-40b1-b632-b516f97907fd None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:07.974920 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 198/397] 10.222.0.59 () {58 vars in 1442 bytes} [Tue Oct 4 11:40:07 2022] PUT /identity/v3/projects/3cce5af9f73d46be89fb61b08e04e408/groups/bf50c5df97c94d298b9a0c5de090dd62/roles/b6018afb40c74d19b8cadc402256f23d => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 11:40:08.115710 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555618a9-256f-40b1-b632-b516f97907fd None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:08.166317 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154454b9-2093-4f31-a0f9-d6d5f6870ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:08.167007 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154454b9-2093-4f31-a0f9-d6d5f6870ba2 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:08.167263 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154454b9-2093-4f31-a0f9-d6d5f6870ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:08.167540 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154454b9-2093-4f31-a0f9-d6d5f6870ba2 None admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:08.168264 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154454b9-2093-4f31-a0f9-d6d5f6870ba2 None admin] RBAC: Adding query filter params (name=member) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:08.168572 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154454b9-2093-4f31-a0f9-d6d5f6870ba2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:08.170005 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154454b9-2093-4f31-a0f9-d6d5f6870ba2 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:08.185284 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 200/398] 10.222.0.59 () {56 vars in 1101 bytes} [Tue Oct 4 11:40:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:08.191291 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fbd62a-c063-4b5c-965c-0dca5c520c55 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:08.323270 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fbd62a-c063-4b5c-965c-0dca5c520c55 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:08.365944 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:08.383066 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc70344-5ef3-4ca3-bd14-f56123c4bb48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:08.388391 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc70344-5ef3-4ca3-bd14-f56123c4bb48 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:08.388391 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc70344-5ef3-4ca3-bd14-f56123c4bb48 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:08.388391 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc70344-5ef3-4ca3-bd14-f56123c4bb48 None admin] PATH_INFO: `/v3/groups/bf50c5df97c94d298b9a0c5de090dd62` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:08.388391 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc70344-5ef3-4ca3-bd14-f56123c4bb48 None admin] RBAC: Authorizing `identity:get_group(group_id=bf50c5df97c94d298b9a0c5de090dd62)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:08.388391 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc70344-5ef3-4ca3-bd14-f56123c4bb48 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:08.389735 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 199/399] 10.222.0.59 () {56 vars in 1180 bytes} [Tue Oct 4 11:40:08 2022] GET /identity/v3/groups/bf50c5df97c94d298b9a0c5de090dd62 => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:08.395208 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154454b9-2093-4f31-a0f9-d6d5f6870ba2 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:08.453107 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:08.545638 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba3780c-0908-4bd4-8738-5a060f0d475d None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:08.546235 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba3780c-0908-4bd4-8738-5a060f0d475d None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:08.546510 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba3780c-0908-4bd4-8738-5a060f0d475d None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:08.548111 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 200/400] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:40:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 11:40:08.549218 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bb3ba4-4a35-40c4-84d7-1c397689aa91 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:08.549499 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bb3ba4-4a35-40c4-84d7-1c397689aa91 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:08.549768 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bb3ba4-4a35-40c4-84d7-1c397689aa91 None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:08.549871 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154454b9-2093-4f31-a0f9-d6d5f6870ba2 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:08.551226 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 201/401] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:40:08 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:40:08.557978 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1693819a-38bc-4dc2-a77e-e5bc4ace305d None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:08.558561 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1693819a-38bc-4dc2-a77e-e5bc4ace305d None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:08.559142 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1693819a-38bc-4dc2-a77e-e5bc4ace305d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:08.580804 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-1693819a-38bc-4dc2-a77e-e5bc4ace305d None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:40:08.582493 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-1693819a-38bc-4dc2-a77e-e5bc4ace305d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:40:08.591146 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500e4a91-06b4-4823-9de1-3cff1a9c4733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:08.591782 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500e4a91-06b4-4823-9de1-3cff1a9c4733 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:08.592058 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500e4a91-06b4-4823-9de1-3cff1a9c4733 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:08.592330 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500e4a91-06b4-4823-9de1-3cff1a9c4733 None admin] PATH_INFO: `/v3/projects/c883e45022464667b26d995f7ba3657d` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:08.593754 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500e4a91-06b4-4823-9de1-3cff1a9c4733 None admin] RBAC: Authorizing `identity:get_project(project_id=c883e45022464667b26d995f7ba3657d)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:08.594934 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500e4a91-06b4-4823-9de1-3cff1a9c4733 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:08.601638 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 201/402] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Oct 4 11:40:08 2022] GET /identity/v3/projects/c883e45022464667b26d995f7ba3657d => generated 302 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:08.601638 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c6358f-22ec-4bf6-b096-6ddbaad7f026 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:08.601638 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c6358f-22ec-4bf6-b096-6ddbaad7f026 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:08.601638 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c6358f-22ec-4bf6-b096-6ddbaad7f026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:08.619544 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-41c6358f-22ec-4bf6-b096-6ddbaad7f026 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:40:08.620760 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-41c6358f-22ec-4bf6-b096-6ddbaad7f026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:40:08.678062 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 202/403] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:40:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 11:40:08.678062 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1693819a-38bc-4dc2-a77e-e5bc4ace305d None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:08.705974 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 202/404] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:40:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 11:40:08.828577 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1693819a-38bc-4dc2-a77e-e5bc4ace305d None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:08.861238 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:08.876087 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5426ae-b39d-4d64-bd65-1f23480c5bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:08.876777 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5426ae-b39d-4d64-bd65-1f23480c5bd5 None admin] REQUEST_METHOD: `PUT` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:08.877170 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5426ae-b39d-4d64-bd65-1f23480c5bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:08.877445 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5426ae-b39d-4d64-bd65-1f23480c5bd5 None admin] PATH_INFO: `/v3/projects/c883e45022464667b26d995f7ba3657d/groups/bf50c5df97c94d298b9a0c5de090dd62/roles/ab4307f3b7994c1c80036fa7db93b6b9` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:08.879940 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5426ae-b39d-4d64-bd65-1f23480c5bd5 None admin] RBAC: Authorizing `identity:create_grant(project_id=c883e45022464667b26d995f7ba3657d, group_id=bf50c5df97c94d298b9a0c5de090dd62, role_id=ab4307f3b7994c1c80036fa7db93b6b9)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:08.881413 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5426ae-b39d-4d64-bd65-1f23480c5bd5 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:08.968420 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 203/405] 10.222.0.59 () {58 vars in 1442 bytes} [Tue Oct 4 11:40:08 2022] PUT /identity/v3/projects/c883e45022464667b26d995f7ba3657d/groups/bf50c5df97c94d298b9a0c5de090dd62/roles/ab4307f3b7994c1c80036fa7db93b6b9 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 11:40:08.993798 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c6358f-22ec-4bf6-b096-6ddbaad7f026 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:09.021611 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5426ae-b39d-4d64-bd65-1f23480c5bd5 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:09.037262 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:09.151957 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c6358f-22ec-4bf6-b096-6ddbaad7f026 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:09.196563 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217bda22-0bde-481c-8d99-ae868e947cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:09.198021 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217bda22-0bde-481c-8d99-ae868e947cd4 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:09.198504 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217bda22-0bde-481c-8d99-ae868e947cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:09.198997 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217bda22-0bde-481c-8d99-ae868e947cd4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:09.203483 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5426ae-b39d-4d64-bd65-1f23480c5bd5 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:09.211141 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217bda22-0bde-481c-8d99-ae868e947cd4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 11:40:09.216245 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-217bda22-0bde-481c-8d99-ae868e947cd4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 11:40:09.216245 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:09.216245 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:09.216245 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:09.216245 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:09.216245 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:09.216245 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:09.216245 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:09.216245 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:09.216245 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:09.216245 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:09.216245 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:09.216245 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 11:40:09.216245 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 11:40:09.216245 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 11:40:09.216245 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 11:40:09.217255 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 11:40:09.217255 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 11:40:09.217255 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 11:40:09.217255 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 11:40:09.217255 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:09.217255 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:09.217255 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:40:09.217255 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:40:09.217255 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:40:09.217255 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:40:09.217255 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:40:09.217255 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:40:09.217255 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:40:09.217255 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:40:09.217255 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:40:09.217255 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:40:09.218058 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:40:09.218058 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:40:09.218058 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:40:09.218058 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:40:09.218058 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 11:40:09.218058 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 11:40:09.218058 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 11:40:09.218058 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 11:40:09.218058 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 11:40:09.218058 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 11:40:09.218058 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 11:40:09.218058 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:40:09.220660 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 203/406] 10.222.0.59 () {56 vars in 1096 bytes} [Tue Oct 4 11:40:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:40:09.227485 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217bda22-0bde-481c-8d99-ae868e947cd4 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:09.241463 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7d6fe1-f2c4-4f73-b31b-f56e5dd39801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:09.242221 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d6fe1-f2c4-4f73-b31b-f56e5dd39801 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:09.242403 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d6fe1-f2c4-4f73-b31b-f56e5dd39801 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:09.242637 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d6fe1-f2c4-4f73-b31b-f56e5dd39801 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:09.253910 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7d6fe1-f2c4-4f73-b31b-f56e5dd39801 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 11:40:09.261118 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-fd7d6fe1-f2c4-4f73-b31b-f56e5dd39801 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 11:40:09.261118 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:09.261118 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:09.261118 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:09.261118 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:09.261118 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:09.261118 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:09.261118 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:09.261118 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:09.261118 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:09.261118 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:09.261118 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:09.261118 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 11:40:09.261118 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 11:40:09.261118 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 11:40:09.261118 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 11:40:09.262018 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 11:40:09.262018 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 11:40:09.262018 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 11:40:09.262018 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 11:40:09.262018 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:09.262018 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:09.262018 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:40:09.262018 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:40:09.262018 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:40:09.262018 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:40:09.262018 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:40:09.262018 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:40:09.262018 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:40:09.262018 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:40:09.262018 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:40:09.262018 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:40:09.262834 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:40:09.262834 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:40:09.262834 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:40:09.262834 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:40:09.262834 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 11:40:09.262834 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 11:40:09.262834 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 11:40:09.262834 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 11:40:09.262834 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 11:40:09.262834 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 11:40:09.262834 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 11:40:09.262834 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:40:09.264791 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 204/407] 10.222.0.59 () {56 vars in 1114 bytes} [Tue Oct 4 11:40:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:40:09.267061 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7d6fe1-f2c4-4f73-b31b-f56e5dd39801 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:09.315391 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:09.377337 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7d6fe1-f2c4-4f73-b31b-f56e5dd39801 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:09.395351 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:09.415499 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070eece5-3c28-40d6-a14b-1332b84f23a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:09.416425 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070eece5-3c28-40d6-a14b-1332b84f23a5 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:09.416908 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070eece5-3c28-40d6-a14b-1332b84f23a5 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:09.417376 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070eece5-3c28-40d6-a14b-1332b84f23a5 None admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:09.417920 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217bda22-0bde-481c-8d99-ae868e947cd4 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:09.418457 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070eece5-3c28-40d6-a14b-1332b84f23a5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:09.418933 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070eece5-3c28-40d6-a14b-1332b84f23a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:09.420493 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070eece5-3c28-40d6-a14b-1332b84f23a5 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:09.433888 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 205/408] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Oct 4 11:40:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 11:40:09.435426 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070eece5-3c28-40d6-a14b-1332b84f23a5 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:09.457012 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c99b307-fb8c-4c6e-9ee9-756dd3427b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:09.457779 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c99b307-fb8c-4c6e-9ee9-756dd3427b66 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:09.458149 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c99b307-fb8c-4c6e-9ee9-756dd3427b66 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:09.458494 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c99b307-fb8c-4c6e-9ee9-756dd3427b66 None admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:09.459393 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c99b307-fb8c-4c6e-9ee9-756dd3427b66 None admin] RBAC: Adding query filter params (name=admin) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:09.459796 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c99b307-fb8c-4c6e-9ee9-756dd3427b66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:09.461432 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c99b307-fb8c-4c6e-9ee9-756dd3427b66 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:09.478966 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 204/409] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Oct 4 11:40:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:09.484709 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c99b307-fb8c-4c6e-9ee9-756dd3427b66 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:09.545137 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070eece5-3c28-40d6-a14b-1332b84f23a5 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:09.553711 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:09.581012 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65625278-c79b-4fe6-ab7c-96dc58cc1403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:09.581978 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65625278-c79b-4fe6-ab7c-96dc58cc1403 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:09.583014 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65625278-c79b-4fe6-ab7c-96dc58cc1403 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:09.583760 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65625278-c79b-4fe6-ab7c-96dc58cc1403 None admin] PATH_INFO: `/v3/groups/bf50c5df97c94d298b9a0c5de090dd62` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:09.585180 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65625278-c79b-4fe6-ab7c-96dc58cc1403 None admin] RBAC: Authorizing `identity:get_group(group_id=bf50c5df97c94d298b9a0c5de090dd62)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:09.586786 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65625278-c79b-4fe6-ab7c-96dc58cc1403 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:09.592724 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 206/410] 10.222.0.59 () {56 vars in 1180 bytes} [Tue Oct 4 11:40:09 2022] GET /identity/v3/groups/bf50c5df97c94d298b9a0c5de090dd62 => generated 226 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 11:40:09.594548 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65625278-c79b-4fe6-ab7c-96dc58cc1403 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:09.690924 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c99b307-fb8c-4c6e-9ee9-756dd3427b66 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:09.730894 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e99df9-ccd2-4892-bed9-ee1e53da4f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:09.731860 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e99df9-ccd2-4892-bed9-ee1e53da4f6b None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:09.732372 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e99df9-ccd2-4892-bed9-ee1e53da4f6b None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:09.732984 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e99df9-ccd2-4892-bed9-ee1e53da4f6b None admin] PATH_INFO: `/v3/groups/08ce265b567a454bbdeebb8379b6f218` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:09.735325 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e99df9-ccd2-4892-bed9-ee1e53da4f6b None admin] RBAC: Authorizing `identity:get_group(group_id=08ce265b567a454bbdeebb8379b6f218)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:09.739206 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e99df9-ccd2-4892-bed9-ee1e53da4f6b None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:09.741924 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 205/411] 10.222.0.59 () {56 vars in 1180 bytes} [Tue Oct 4 11:40:09 2022] GET /identity/v3/groups/08ce265b567a454bbdeebb8379b6f218 => generated 229 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 11:40:09.747866 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e99df9-ccd2-4892-bed9-ee1e53da4f6b None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:09.789984 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65625278-c79b-4fe6-ab7c-96dc58cc1403 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:09.791976 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:09.860233 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bcfcaa-d5a3-4edc-ba45-501ac4c6ecc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:09.860920 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bcfcaa-d5a3-4edc-ba45-501ac4c6ecc8 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:09.862012 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bcfcaa-d5a3-4edc-ba45-501ac4c6ecc8 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:09.862293 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bcfcaa-d5a3-4edc-ba45-501ac4c6ecc8 None admin] PATH_INFO: `/v3/projects/c883e45022464667b26d995f7ba3657d` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:09.864883 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bcfcaa-d5a3-4edc-ba45-501ac4c6ecc8 None admin] RBAC: Authorizing `identity:get_project(project_id=c883e45022464667b26d995f7ba3657d)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:09.872033 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bcfcaa-d5a3-4edc-ba45-501ac4c6ecc8 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:09.874951 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 207/412] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Oct 4 11:40:09 2022] GET /identity/v3/projects/c883e45022464667b26d995f7ba3657d => generated 302 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:09.879969 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bcfcaa-d5a3-4edc-ba45-501ac4c6ecc8 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:09.930168 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e99df9-ccd2-4892-bed9-ee1e53da4f6b None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:09.941427 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:09.970055 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89c1a3c-8721-40ba-96fc-488695840130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:09.970731 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89c1a3c-8721-40ba-96fc-488695840130 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:09.971012 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89c1a3c-8721-40ba-96fc-488695840130 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:09.971291 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89c1a3c-8721-40ba-96fc-488695840130 None admin] PATH_INFO: `/v3/projects/f4d88030405047648869d4fa21dc117c` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:09.972474 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89c1a3c-8721-40ba-96fc-488695840130 None admin] RBAC: Authorizing `identity:get_project(project_id=f4d88030405047648869d4fa21dc117c)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:09.974842 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89c1a3c-8721-40ba-96fc-488695840130 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:09.976792 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 206/413] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Oct 4 11:40:09 2022] GET /identity/v3/projects/f4d88030405047648869d4fa21dc117c => generated 344 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 11:40:09.982592 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6be528d-24ab-4148-a825-64886f8433f4 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:09.982843 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6be528d-24ab-4148-a825-64886f8433f4 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:09.983130 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6be528d-24ab-4148-a825-64886f8433f4 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:09.984427 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 207/414] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:40:09 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:40:09.985146 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6be528d-24ab-4148-a825-64886f8433f4 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:10.013036 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bcfcaa-d5a3-4edc-ba45-501ac4c6ecc8 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:10.049860 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19290c7e-8798-4e22-994d-b74f91beaa4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:10.050526 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19290c7e-8798-4e22-994d-b74f91beaa4b None admin] REQUEST_METHOD: `PUT` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:10.051025 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19290c7e-8798-4e22-994d-b74f91beaa4b None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:10.051312 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19290c7e-8798-4e22-994d-b74f91beaa4b None admin] PATH_INFO: `/v3/projects/c883e45022464667b26d995f7ba3657d/groups/bf50c5df97c94d298b9a0c5de090dd62/roles/b6018afb40c74d19b8cadc402256f23d` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:10.054519 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19290c7e-8798-4e22-994d-b74f91beaa4b None admin] RBAC: Authorizing `identity:create_grant(project_id=c883e45022464667b26d995f7ba3657d, group_id=bf50c5df97c94d298b9a0c5de090dd62, role_id=b6018afb40c74d19b8cadc402256f23d)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:10.055970 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19290c7e-8798-4e22-994d-b74f91beaa4b None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:10.081677 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:10.095495 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6be528d-24ab-4148-a825-64886f8433f4 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:10.131925 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8809b9e0-dc87-4b45-b5c2-761b91754bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:10.132830 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8809b9e0-dc87-4b45-b5c2-761b91754bf0 None admin] REQUEST_METHOD: `PUT` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:10.133286 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8809b9e0-dc87-4b45-b5c2-761b91754bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:10.133707 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8809b9e0-dc87-4b45-b5c2-761b91754bf0 None admin] PATH_INFO: `/v3/projects/f4d88030405047648869d4fa21dc117c/groups/08ce265b567a454bbdeebb8379b6f218/roles/d6e7421d1ff9451c808004b818354550` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:10.135843 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8809b9e0-dc87-4b45-b5c2-761b91754bf0 None admin] RBAC: Authorizing `identity:create_grant(project_id=f4d88030405047648869d4fa21dc117c, group_id=08ce265b567a454bbdeebb8379b6f218, role_id=d6e7421d1ff9451c808004b818354550)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:10.137711 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8809b9e0-dc87-4b45-b5c2-761b91754bf0 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:10.144872 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 208/415] 10.222.0.59 () {58 vars in 1442 bytes} [Tue Oct 4 11:40:09 2022] PUT /identity/v3/projects/c883e45022464667b26d995f7ba3657d/groups/bf50c5df97c94d298b9a0c5de090dd62/roles/b6018afb40c74d19b8cadc402256f23d => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 11:40:10.152777 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123de7f6-54e8-4624-8dcf-e220060b6710 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:10.152777 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123de7f6-54e8-4624-8dcf-e220060b6710 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:10.152777 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123de7f6-54e8-4624-8dcf-e220060b6710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:10.177275 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-123de7f6-54e8-4624-8dcf-e220060b6710 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:40:10.179027 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-123de7f6-54e8-4624-8dcf-e220060b6710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:40:10.208935 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 208/416] 10.222.0.59 () {58 vars in 1442 bytes} [Tue Oct 4 11:40:09 2022] PUT /identity/v3/projects/f4d88030405047648869d4fa21dc117c/groups/08ce265b567a454bbdeebb8379b6f218/roles/d6e7421d1ff9451c808004b818354550 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 11:40:10.291398 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 209/417] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:40:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 11:40:10.617448 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8809b9e0-dc87-4b45-b5c2-761b91754bf0 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:10.759531 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8809b9e0-dc87-4b45-b5c2-761b91754bf0 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:10.791267 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22083f82-76c0-412f-8764-646fbac50367 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:10.791776 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22083f82-76c0-412f-8764-646fbac50367 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:10.791851 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22083f82-76c0-412f-8764-646fbac50367 None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:10.793426 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 210/418] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:40:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:40:10.805872 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd8f821-b731-4538-a175-06a2af5883bf None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:10.806172 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd8f821-b731-4538-a175-06a2af5883bf None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:10.806436 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd8f821-b731-4538-a175-06a2af5883bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:10.808590 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fef9e4-abda-413d-be12-c5eb803c6498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:10.809467 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fef9e4-abda-413d-be12-c5eb803c6498 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:10.810032 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fef9e4-abda-413d-be12-c5eb803c6498 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:10.810515 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fef9e4-abda-413d-be12-c5eb803c6498 None admin] PATH_INFO: `/v3/roles/member` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:10.830393 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fef9e4-abda-413d-be12-c5eb803c6498 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 11:40:10.836376 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-81fef9e4-abda-413d-be12-c5eb803c6498 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 11:40:10.836376 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:10.836376 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:10.836376 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:10.836376 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:10.836376 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:10.836376 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:10.836376 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:10.836376 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:10.836376 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:10.836376 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:10.836376 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:10.836376 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 11:40:10.836376 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 11:40:10.836376 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 11:40:10.836376 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 11:40:10.837416 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 11:40:10.837416 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 11:40:10.837416 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 11:40:10.837416 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 11:40:10.837416 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:10.837416 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:10.837416 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:40:10.837416 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:40:10.837416 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:40:10.837416 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:40:10.837416 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:40:10.837416 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:40:10.837416 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:40:10.837416 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:40:10.837416 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:40:10.837416 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:40:10.838230 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:40:10.838230 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:40:10.838230 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:40:10.838230 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:40:10.838230 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 11:40:10.838230 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 11:40:10.838230 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 11:40:10.838230 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 11:40:10.838230 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 11:40:10.838230 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 11:40:10.838230 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 11:40:10.838230 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:40:10.841319 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 209/419] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Oct 4 11:40:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:40:10.846048 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-cbd8f821-b731-4538-a175-06a2af5883bf None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:40:10.846048 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-cbd8f821-b731-4538-a175-06a2af5883bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:40:10.848256 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fef9e4-abda-413d-be12-c5eb803c6498 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:10.872960 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:10.901511 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:10.978624 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 211/420] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:40:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 11:40:11.051565 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fef9e4-abda-413d-be12-c5eb803c6498 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:11.102406 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2991ef96-a4f2-4609-8c2c-3e9dfac6f149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:11.103023 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2991ef96-a4f2-4609-8c2c-3e9dfac6f149 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:11.103302 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2991ef96-a4f2-4609-8c2c-3e9dfac6f149 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:11.103572 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2991ef96-a4f2-4609-8c2c-3e9dfac6f149 None admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:11.104239 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2991ef96-a4f2-4609-8c2c-3e9dfac6f149 None admin] RBAC: Adding query filter params (name=member) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:11.104556 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2991ef96-a4f2-4609-8c2c-3e9dfac6f149 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:11.105945 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2991ef96-a4f2-4609-8c2c-3e9dfac6f149 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:11.121264 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 210/421] 10.222.0.59 () {56 vars in 1101 bytes} [Tue Oct 4 11:40:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 11:40:11.126966 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd8f821-b731-4538-a175-06a2af5883bf None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:11.288452 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd8f821-b731-4538-a175-06a2af5883bf None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:11.291026 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2991ef96-a4f2-4609-8c2c-3e9dfac6f149 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:11.342926 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848b894b-4d80-43d6-b5aa-87db36059997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:11.343908 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848b894b-4d80-43d6-b5aa-87db36059997 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:11.343908 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848b894b-4d80-43d6-b5aa-87db36059997 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:11.344186 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848b894b-4d80-43d6-b5aa-87db36059997 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:11.371014 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:11.402293 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:11.411241 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2991ef96-a4f2-4609-8c2c-3e9dfac6f149 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:11.447494 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2866cb05-dda9-4eab-a8c7-5541f78d7d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:11.448468 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2866cb05-dda9-4eab-a8c7-5541f78d7d3a None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:11.449003 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2866cb05-dda9-4eab-a8c7-5541f78d7d3a None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:11.449532 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2866cb05-dda9-4eab-a8c7-5541f78d7d3a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:11.460586 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2866cb05-dda9-4eab-a8c7-5541f78d7d3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 11:40:11.466168 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-2866cb05-dda9-4eab-a8c7-5541f78d7d3a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 11:40:11.466168 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:11.466168 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:11.466168 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:11.466168 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:11.466168 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:11.466168 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:11.466168 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:11.466168 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:11.466168 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:11.466168 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:11.466168 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:11.466168 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 11:40:11.466168 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 11:40:11.466168 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 11:40:11.466168 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 11:40:11.467077 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 11:40:11.467077 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 11:40:11.467077 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 11:40:11.467077 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 11:40:11.467077 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:11.467077 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:11.467077 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:40:11.467077 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:40:11.467077 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:40:11.467077 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:40:11.467077 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:40:11.467077 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:40:11.467077 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:40:11.467077 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:40:11.467077 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:40:11.467077 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:40:11.467895 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:40:11.467895 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:40:11.467895 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:40:11.467895 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:40:11.467895 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 11:40:11.467895 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 11:40:11.467895 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 11:40:11.467895 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 11:40:11.467895 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 11:40:11.467895 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 11:40:11.467895 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 11:40:11.467895 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:40:11.470638 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 211/422] 10.222.0.59 () {56 vars in 1114 bytes} [Tue Oct 4 11:40:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 11:40:11.477205 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2866cb05-dda9-4eab-a8c7-5541f78d7d3a None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:11.486882 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848b894b-4d80-43d6-b5aa-87db36059997 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:11.488433 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848b894b-4d80-43d6-b5aa-87db36059997 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:11.600654 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2866cb05-dda9-4eab-a8c7-5541f78d7d3a None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:11.639790 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:11.654844 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dad1f36-5bd6-402b-be95-4fe569ee6004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:11.656460 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dad1f36-5bd6-402b-be95-4fe569ee6004 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:11.657115 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dad1f36-5bd6-402b-be95-4fe569ee6004 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:11.658612 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dad1f36-5bd6-402b-be95-4fe569ee6004 None admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:11.659477 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dad1f36-5bd6-402b-be95-4fe569ee6004 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:11.660163 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dad1f36-5bd6-402b-be95-4fe569ee6004 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:11.663128 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dad1f36-5bd6-402b-be95-4fe569ee6004 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:11.680897 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 212/423] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Oct 4 11:40:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:11.688543 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dad1f36-5bd6-402b-be95-4fe569ee6004 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:11.701858 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 212/424] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Oct 4 11:40:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 575 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 11:40:11.711307 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848b894b-4d80-43d6-b5aa-87db36059997 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:11.860960 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:11.882090 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dad1f36-5bd6-402b-be95-4fe569ee6004 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:11.909786 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848b894b-4d80-43d6-b5aa-87db36059997 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:11.931526 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc9407d-98dd-4f76-b448-eaa2f411f69a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:11.932568 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc9407d-98dd-4f76-b448-eaa2f411f69a None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:11.933085 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc9407d-98dd-4f76-b448-eaa2f411f69a None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:11.933691 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc9407d-98dd-4f76-b448-eaa2f411f69a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:11.950137 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacab1a3-e39a-4d8f-bb14-f94a56c3e4b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:11.950784 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacab1a3-e39a-4d8f-bb14-f94a56c3e4b3 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:11.951055 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacab1a3-e39a-4d8f-bb14-f94a56c3e4b3 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:11.951326 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacab1a3-e39a-4d8f-bb14-f94a56c3e4b3 None admin] PATH_INFO: `/v3/projects/3cce5af9f73d46be89fb61b08e04e408` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:11.952472 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacab1a3-e39a-4d8f-bb14-f94a56c3e4b3 None admin] RBAC: Authorizing `identity:get_project(project_id=3cce5af9f73d46be89fb61b08e04e408)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:11.954097 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacab1a3-e39a-4d8f-bb14-f94a56c3e4b3 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:11.955723 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 213/425] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Oct 4 11:40:11 2022] GET /identity/v3/projects/3cce5af9f73d46be89fb61b08e04e408 => generated 298 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:11.960627 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2489f435-00df-4197-ba53-32e5a0fff875 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:11.960627 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2489f435-00df-4197-ba53-32e5a0fff875 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:11.960627 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2489f435-00df-4197-ba53-32e5a0fff875 None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:11.960899 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 214/426] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:40:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:40:11.963056 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2489f435-00df-4197-ba53-32e5a0fff875 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:12.007950 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:12.020927 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc9407d-98dd-4f76-b448-eaa2f411f69a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:12.022594 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc9407d-98dd-4f76-b448-eaa2f411f69a None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:12.081382 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2489f435-00df-4197-ba53-32e5a0fff875 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:12.118109 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:12.125188 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64977dd7-7d25-4217-9d33-cfe1e73444b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:12.126186 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64977dd7-7d25-4217-9d33-cfe1e73444b8 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:12.126589 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64977dd7-7d25-4217-9d33-cfe1e73444b8 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:12.126935 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64977dd7-7d25-4217-9d33-cfe1e73444b8 None admin] PATH_INFO: `/v3/groups/bf50c5df97c94d298b9a0c5de090dd62` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:12.128250 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64977dd7-7d25-4217-9d33-cfe1e73444b8 None admin] RBAC: Authorizing `identity:get_group(group_id=bf50c5df97c94d298b9a0c5de090dd62)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:12.134182 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64977dd7-7d25-4217-9d33-cfe1e73444b8 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:12.134182 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 215/427] 10.222.0.59 () {56 vars in 1180 bytes} [Tue Oct 4 11:40:11 2022] GET /identity/v3/groups/bf50c5df97c94d298b9a0c5de090dd62 => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:12.134182 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8165513-bde4-4734-be82-3289264de560 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:12.134614 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8165513-bde4-4734-be82-3289264de560 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:12.135024 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8165513-bde4-4734-be82-3289264de560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:12.149194 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 213/428] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Oct 4 11:40:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 11:40:12.150412 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc9407d-98dd-4f76-b448-eaa2f411f69a None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:12.162303 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-f8165513-bde4-4734-be82-3289264de560 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:40:12.164142 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-f8165513-bde4-4734-be82-3289264de560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:40:12.257089 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 216/429] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:40:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 11:40:12.258386 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8165513-bde4-4734-be82-3289264de560 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:12.269538 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:12.278743 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc9407d-98dd-4f76-b448-eaa2f411f69a None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:12.315129 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bb3670-48e4-4549-a020-ced6ac57589b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:12.315963 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb3670-48e4-4549-a020-ced6ac57589b None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:12.316361 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb3670-48e4-4549-a020-ced6ac57589b None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:12.317285 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb3670-48e4-4549-a020-ced6ac57589b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:12.318114 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bb3670-48e4-4549-a020-ced6ac57589b None admin] RBAC: Adding query filter params (group.id=bf50c5df97c94d298b9a0c5de090dd62, role.id=ab4307f3b7994c1c80036fa7db93b6b9, scope.project.id=3cce5af9f73d46be89fb61b08e04e408) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:12.318530 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bb3670-48e4-4549-a020-ced6ac57589b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:12.320065 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bb3670-48e4-4549-a020-ced6ac57589b None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:12.326614 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 214/430] 10.222.0.59 () {56 vars in 1376 bytes} [Tue Oct 4 11:40:12 2022] GET /identity/v3/role_assignments?group.id=bf50c5df97c94d298b9a0c5de090dd62&scope.project.id=3cce5af9f73d46be89fb61b08e04e408&role.id=ab4307f3b7994c1c80036fa7db93b6b9 => generated 611 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:12.378270 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8165513-bde4-4734-be82-3289264de560 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:12.409645 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:12.424881 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b03870-a9dc-4d76-b4ed-e8a09349ae8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:12.424881 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b03870-a9dc-4d76-b4ed-e8a09349ae8f None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:12.424881 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b03870-a9dc-4d76-b4ed-e8a09349ae8f None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:12.424881 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b03870-a9dc-4d76-b4ed-e8a09349ae8f None admin] PATH_INFO: `/v3/projects/3cce5af9f73d46be89fb61b08e04e408` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:12.425265 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b03870-a9dc-4d76-b4ed-e8a09349ae8f None admin] RBAC: Authorizing `identity:get_project(project_id=3cce5af9f73d46be89fb61b08e04e408)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:12.425265 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b03870-a9dc-4d76-b4ed-e8a09349ae8f None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:12.427164 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 217/431] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Oct 4 11:40:12 2022] GET /identity/v3/projects/3cce5af9f73d46be89fb61b08e04e408 => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:12.432490 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bb3670-48e4-4549-a020-ced6ac57589b None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:12.581857 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bb3670-48e4-4549-a020-ced6ac57589b None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:12.623545 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f6b982-6187-47b1-9cb1-93b88c7242b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:12.624187 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f6b982-6187-47b1-9cb1-93b88c7242b3 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:12.624461 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f6b982-6187-47b1-9cb1-93b88c7242b3 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:12.624764 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f6b982-6187-47b1-9cb1-93b88c7242b3 None admin] PATH_INFO: `/v3/groups/bf50c5df97c94d298b9a0c5de090dd62` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:12.625901 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f6b982-6187-47b1-9cb1-93b88c7242b3 None admin] RBAC: Authorizing `identity:get_group(group_id=bf50c5df97c94d298b9a0c5de090dd62)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:12.627388 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f6b982-6187-47b1-9cb1-93b88c7242b3 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:12.629423 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 215/432] 10.222.0.59 () {56 vars in 1180 bytes} [Tue Oct 4 11:40:12 2022] GET /identity/v3/groups/bf50c5df97c94d298b9a0c5de090dd62 => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:12.631617 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b03870-a9dc-4d76-b4ed-e8a09349ae8f None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:12.640635 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f6b982-6187-47b1-9cb1-93b88c7242b3 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:12.663366 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:12.749034 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f6b982-6187-47b1-9cb1-93b88c7242b3 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:12.789591 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b26c949-052e-45f3-8770-a03a01e12dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:12.790558 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b26c949-052e-45f3-8770-a03a01e12dba None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:12.790833 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b26c949-052e-45f3-8770-a03a01e12dba None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:12.791098 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b26c949-052e-45f3-8770-a03a01e12dba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:12.791716 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b03870-a9dc-4d76-b4ed-e8a09349ae8f None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:12.791818 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b26c949-052e-45f3-8770-a03a01e12dba None admin] RBAC: Adding query filter params (group.id=bf50c5df97c94d298b9a0c5de090dd62, role.id=b6018afb40c74d19b8cadc402256f23d, scope.project.id=3cce5af9f73d46be89fb61b08e04e408) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:12.792130 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b26c949-052e-45f3-8770-a03a01e12dba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:12.793598 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b26c949-052e-45f3-8770-a03a01e12dba None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:12.800309 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 216/433] 10.222.0.59 () {56 vars in 1376 bytes} [Tue Oct 4 11:40:12 2022] GET /identity/v3/role_assignments?group.id=bf50c5df97c94d298b9a0c5de090dd62&scope.project.id=3cce5af9f73d46be89fb61b08e04e408&role.id=b6018afb40c74d19b8cadc402256f23d => generated 611 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:12.801911 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50ca362-493d-47bf-b0c4-7f109d40a364 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:12.802191 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50ca362-493d-47bf-b0c4-7f109d40a364 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:12.804850 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50ca362-493d-47bf-b0c4-7f109d40a364 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:12.807532 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 217/434] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:40:12 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:40:12.813414 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae77bfb-07bf-4744-be94-bed500de8431 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:12.813716 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae77bfb-07bf-4744-be94-bed500de8431 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:12.813972 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae77bfb-07bf-4744-be94-bed500de8431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:12.835874 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-2ae77bfb-07bf-4744-be94-bed500de8431 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:40:12.837663 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-2ae77bfb-07bf-4744-be94-bed500de8431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:40:12.838763 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad819d69-2eb5-40b0-9be7-5352fbf1e19f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:12.839740 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad819d69-2eb5-40b0-9be7-5352fbf1e19f None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:12.840688 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad819d69-2eb5-40b0-9be7-5352fbf1e19f None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:12.842274 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad819d69-2eb5-40b0-9be7-5352fbf1e19f None admin] PATH_INFO: `/v3/roles/member` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:12.859266 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad819d69-2eb5-40b0-9be7-5352fbf1e19f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 11:40:12.865682 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-ad819d69-2eb5-40b0-9be7-5352fbf1e19f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 11:40:12.865682 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:12.865682 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:12.865682 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:12.865682 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:12.865682 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:12.865682 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:12.865682 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:12.865682 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:12.865682 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:12.865682 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:12.865682 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:12.865682 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 11:40:12.865682 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 11:40:12.865682 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 11:40:12.865682 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 11:40:12.867085 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 11:40:12.867085 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 11:40:12.867085 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 11:40:12.867085 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 11:40:12.867085 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:12.867085 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:12.867085 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:40:12.867085 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:40:12.867085 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:40:12.867085 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:40:12.867085 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:40:12.867085 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:40:12.867085 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:40:12.867085 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:40:12.867085 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:40:12.867085 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:40:12.867911 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:40:12.867911 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:40:12.867911 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:40:12.867911 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:40:12.867911 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 11:40:12.867911 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 11:40:12.867911 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 11:40:12.867911 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 11:40:12.867911 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 11:40:12.867911 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 11:40:12.867911 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 11:40:12.867911 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:40:12.871820 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 218/435] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Oct 4 11:40:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:40:12.877448 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad819d69-2eb5-40b0-9be7-5352fbf1e19f None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:12.931709 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 218/436] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:40:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 11:40:12.953433 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:12.957205 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb7fdf2-24f4-4d70-b396-bb1349b32f21 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:12.957473 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb7fdf2-24f4-4d70-b396-bb1349b32f21 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:12.957749 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb7fdf2-24f4-4d70-b396-bb1349b32f21 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:12.959270 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 219/437] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:40:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 11:40:12.966341 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bc57da-16ef-4996-9992-247784524f25 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:12.966625 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bc57da-16ef-4996-9992-247784524f25 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:12.966897 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bc57da-16ef-4996-9992-247784524f25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:12.996164 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-c0bc57da-16ef-4996-9992-247784524f25 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:40:12.999556 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-c0bc57da-16ef-4996-9992-247784524f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:40:13.011045 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad819d69-2eb5-40b0-9be7-5352fbf1e19f None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:13.017606 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:13.056568 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21db7b29-7354-4f00-8d33-0113d1eab849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:13.057350 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21db7b29-7354-4f00-8d33-0113d1eab849 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:13.057634 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21db7b29-7354-4f00-8d33-0113d1eab849 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:13.057951 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21db7b29-7354-4f00-8d33-0113d1eab849 None admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:13.058930 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21db7b29-7354-4f00-8d33-0113d1eab849 None admin] RBAC: Adding query filter params (name=member) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:13.059031 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21db7b29-7354-4f00-8d33-0113d1eab849 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:13.061370 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21db7b29-7354-4f00-8d33-0113d1eab849 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:13.072917 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 219/438] 10.222.0.59 () {56 vars in 1101 bytes} [Tue Oct 4 11:40:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 11:40:13.080470 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21db7b29-7354-4f00-8d33-0113d1eab849 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:13.103102 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 220/439] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:40:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 11:40:13.208135 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21db7b29-7354-4f00-8d33-0113d1eab849 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:13.227149 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:13.244841 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ab8094-c593-4757-9a03-991ac1b065ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:13.245455 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ab8094-c593-4757-9a03-991ac1b065ab None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:13.255866 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bc57da-16ef-4996-9992-247784524f25 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:13.255999 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ab8094-c593-4757-9a03-991ac1b065ab None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:13.255999 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ab8094-c593-4757-9a03-991ac1b065ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:13.335563 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ab8094-c593-4757-9a03-991ac1b065ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:13.337161 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ab8094-c593-4757-9a03-991ac1b065ab None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:13.371763 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bc57da-16ef-4996-9992-247784524f25 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:13.408845 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cb7b9f-1913-44ec-baad-37d4bcb6a408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:13.409624 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cb7b9f-1913-44ec-baad-37d4bcb6a408 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:13.409733 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cb7b9f-1913-44ec-baad-37d4bcb6a408 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:13.410007 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cb7b9f-1913-44ec-baad-37d4bcb6a408 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:13.423861 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cb7b9f-1913-44ec-baad-37d4bcb6a408 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 11:40:13.431038 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-59cb7b9f-1913-44ec-baad-37d4bcb6a408 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 11:40:13.431038 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:13.431038 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:13.431038 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:13.431038 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:13.431038 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:13.431038 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:13.431038 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:13.431038 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:13.431038 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:13.431038 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:13.431038 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:13.431038 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 11:40:13.431038 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 11:40:13.431038 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 11:40:13.431038 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 11:40:13.433232 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 11:40:13.433232 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 11:40:13.433232 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 11:40:13.433232 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 11:40:13.433232 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:13.433232 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:13.433232 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:40:13.433232 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:40:13.433232 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:40:13.433232 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:40:13.433232 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:40:13.433232 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:40:13.433232 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:40:13.433232 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:40:13.433232 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:40:13.433232 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:40:13.434406 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:40:13.434406 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:40:13.434406 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:40:13.434406 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:40:13.434406 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 11:40:13.434406 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 11:40:13.434406 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 11:40:13.434406 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 11:40:13.434406 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 11:40:13.434406 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 11:40:13.434406 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 11:40:13.434406 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:40:13.434406 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 221/440] 10.222.0.59 () {56 vars in 1114 bytes} [Tue Oct 4 11:40:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 11:40:13.434406 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cb7b9f-1913-44ec-baad-37d4bcb6a408 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:13.447994 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:13.460648 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 220/441] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Oct 4 11:40:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 11:40:13.460648 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ab8094-c593-4757-9a03-991ac1b065ab None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:13.484011 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:13.545485 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cb7b9f-1913-44ec-baad-37d4bcb6a408 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:13.571428 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ab8094-c593-4757-9a03-991ac1b065ab None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:13.578544 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad87653-2583-4169-bdb5-e1e7c7c72d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:13.579166 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad87653-2583-4169-bdb5-e1e7c7c72d2b None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:13.579445 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad87653-2583-4169-bdb5-e1e7c7c72d2b None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:13.579717 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad87653-2583-4169-bdb5-e1e7c7c72d2b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:13.590149 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad87653-2583-4169-bdb5-e1e7c7c72d2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 11:40:13.594842 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-5ad87653-2583-4169-bdb5-e1e7c7c72d2b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 11:40:13.594842 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:13.594842 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:13.594842 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:13.594842 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:13.594842 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:13.594842 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:13.594842 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:13.594842 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:13.594842 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:13.594842 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:13.594842 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:13.594842 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 11:40:13.594842 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 11:40:13.594842 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 11:40:13.594842 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 11:40:13.595725 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 11:40:13.595725 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 11:40:13.595725 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 11:40:13.595725 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 11:40:13.595725 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:13.595725 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:13.595725 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:40:13.595725 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:40:13.595725 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:40:13.595725 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:40:13.595725 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:40:13.595725 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:40:13.595725 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:40:13.595725 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:40:13.595725 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:40:13.595725 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:40:13.596548 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:40:13.596548 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:40:13.596548 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:40:13.596548 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:40:13.596548 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 11:40:13.596548 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 11:40:13.596548 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 11:40:13.596548 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 11:40:13.596548 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 11:40:13.596548 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 11:40:13.596548 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 11:40:13.596548 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:40:13.596548 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 222/442] 10.222.0.59 () {56 vars in 1096 bytes} [Tue Oct 4 11:40:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:40:13.598425 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad87653-2583-4169-bdb5-e1e7c7c72d2b None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:13.607423 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc04fe2e-a853-4759-816e-7d5e450812ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:13.608027 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc04fe2e-a853-4759-816e-7d5e450812ab None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:13.608299 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc04fe2e-a853-4759-816e-7d5e450812ab None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:13.608567 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc04fe2e-a853-4759-816e-7d5e450812ab None admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:13.609248 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc04fe2e-a853-4759-816e-7d5e450812ab None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:13.609546 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc04fe2e-a853-4759-816e-7d5e450812ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:13.610892 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc04fe2e-a853-4759-816e-7d5e450812ab None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:13.618896 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 221/443] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Oct 4 11:40:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:13.619664 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc04fe2e-a853-4759-816e-7d5e450812ab None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:13.665519 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:13.698955 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad87653-2583-4169-bdb5-e1e7c7c72d2b None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:13.701887 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:13.719808 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc04fe2e-a853-4759-816e-7d5e450812ab None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:13.733647 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e15480-c766-4bf9-bec4-856a49db2927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:13.734275 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e15480-c766-4bf9-bec4-856a49db2927 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:13.734554 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e15480-c766-4bf9-bec4-856a49db2927 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:13.734824 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e15480-c766-4bf9-bec4-856a49db2927 None admin] PATH_INFO: `/v3/projects/c883e45022464667b26d995f7ba3657d` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:13.735974 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e15480-c766-4bf9-bec4-856a49db2927 None admin] RBAC: Authorizing `identity:get_project(project_id=c883e45022464667b26d995f7ba3657d)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:13.737476 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e15480-c766-4bf9-bec4-856a49db2927 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:13.739502 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 223/444] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Oct 4 11:40:13 2022] GET /identity/v3/projects/c883e45022464667b26d995f7ba3657d => generated 302 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:13.740266 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e15480-c766-4bf9-bec4-856a49db2927 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:13.755785 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350b68fc-db03-4971-b31e-f8146e24da6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:13.756837 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350b68fc-db03-4971-b31e-f8146e24da6e None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:13.757117 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350b68fc-db03-4971-b31e-f8146e24da6e None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:13.757391 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350b68fc-db03-4971-b31e-f8146e24da6e None admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:13.758053 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350b68fc-db03-4971-b31e-f8146e24da6e None admin] RBAC: Adding query filter params (name=admin) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:13.758362 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350b68fc-db03-4971-b31e-f8146e24da6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:13.759784 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350b68fc-db03-4971-b31e-f8146e24da6e None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:13.768127 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 222/445] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Oct 4 11:40:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:13.768829 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350b68fc-db03-4971-b31e-f8146e24da6e None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:13.840826 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e15480-c766-4bf9-bec4-856a49db2927 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:13.874883 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54334df-9bce-47ca-9eb1-6ec468c95f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:13.875491 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54334df-9bce-47ca-9eb1-6ec468c95f33 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:13.875769 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54334df-9bce-47ca-9eb1-6ec468c95f33 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:13.876043 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54334df-9bce-47ca-9eb1-6ec468c95f33 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:13.879672 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:13.887604 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350b68fc-db03-4971-b31e-f8146e24da6e None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:13.920780 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c8d89d-06c7-4b43-855b-47268698509a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:13.921408 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c8d89d-06c7-4b43-855b-47268698509a None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:13.921683 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c8d89d-06c7-4b43-855b-47268698509a None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:13.921956 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c8d89d-06c7-4b43-855b-47268698509a None admin] PATH_INFO: `/v3/groups/bf50c5df97c94d298b9a0c5de090dd62` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:13.923053 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c8d89d-06c7-4b43-855b-47268698509a None admin] RBAC: Authorizing `identity:get_group(group_id=bf50c5df97c94d298b9a0c5de090dd62)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:13.924492 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c8d89d-06c7-4b43-855b-47268698509a None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:13.926207 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 223/446] 10.222.0.59 () {56 vars in 1180 bytes} [Tue Oct 4 11:40:13 2022] GET /identity/v3/groups/bf50c5df97c94d298b9a0c5de090dd62 => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:13.926951 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c8d89d-06c7-4b43-855b-47268698509a None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:13.940897 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:13.946175 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54334df-9bce-47ca-9eb1-6ec468c95f33 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:13.947637 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54334df-9bce-47ca-9eb1-6ec468c95f33 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:14.028720 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c8d89d-06c7-4b43-855b-47268698509a None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:14.045634 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 224/447] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Oct 4 11:40:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 11:40:14.046459 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54334df-9bce-47ca-9eb1-6ec468c95f33 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:14.064469 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e6e672-907f-4f3d-9ecf-21d8a6402777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:14.065121 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e6e672-907f-4f3d-9ecf-21d8a6402777 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:14.065403 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e6e672-907f-4f3d-9ecf-21d8a6402777 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:14.065677 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e6e672-907f-4f3d-9ecf-21d8a6402777 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:14.081199 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:14.133927 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e6e672-907f-4f3d-9ecf-21d8a6402777 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:14.135315 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e6e672-907f-4f3d-9ecf-21d8a6402777 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:14.142583 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54334df-9bce-47ca-9eb1-6ec468c95f33 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:14.146671 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:14.175604 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c9bdc3-2180-4e22-9b81-d076a989547d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:14.176736 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c9bdc3-2180-4e22-9b81-d076a989547d None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:14.177012 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c9bdc3-2180-4e22-9b81-d076a989547d None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:14.177281 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c9bdc3-2180-4e22-9b81-d076a989547d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:14.177985 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c9bdc3-2180-4e22-9b81-d076a989547d None admin] RBAC: Adding query filter params (group.id=bf50c5df97c94d298b9a0c5de090dd62, role.id=ab4307f3b7994c1c80036fa7db93b6b9, scope.project.id=c883e45022464667b26d995f7ba3657d) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:14.178287 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c9bdc3-2180-4e22-9b81-d076a989547d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:14.179695 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c9bdc3-2180-4e22-9b81-d076a989547d None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:14.185227 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 225/448] 10.222.0.59 () {56 vars in 1376 bytes} [Tue Oct 4 11:40:14 2022] GET /identity/v3/role_assignments?group.id=bf50c5df97c94d298b9a0c5de090dd62&scope.project.id=c883e45022464667b26d995f7ba3657d&role.id=ab4307f3b7994c1c80036fa7db93b6b9 => generated 611 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:14.185992 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c9bdc3-2180-4e22-9b81-d076a989547d None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:14.251482 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 224/449] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Oct 4 11:40:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 11:40:14.257579 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e6e672-907f-4f3d-9ecf-21d8a6402777 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:14.298370 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:14.302225 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c9bdc3-2180-4e22-9b81-d076a989547d None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:14.341864 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4cbf61-721c-4eca-9df5-f2a28533493a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:14.342506 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4cbf61-721c-4eca-9df5-f2a28533493a None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:14.342783 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4cbf61-721c-4eca-9df5-f2a28533493a None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:14.343055 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4cbf61-721c-4eca-9df5-f2a28533493a None admin] PATH_INFO: `/v3/projects/c883e45022464667b26d995f7ba3657d` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:14.344236 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4cbf61-721c-4eca-9df5-f2a28533493a None admin] RBAC: Authorizing `identity:get_project(project_id=c883e45022464667b26d995f7ba3657d)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:14.346254 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4cbf61-721c-4eca-9df5-f2a28533493a None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:14.348524 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 226/450] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Oct 4 11:40:14 2022] GET /identity/v3/projects/c883e45022464667b26d995f7ba3657d => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:14.354230 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4cbf61-721c-4eca-9df5-f2a28533493a None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:14.382011 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e6e672-907f-4f3d-9ecf-21d8a6402777 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:14.396173 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:14.422587 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a62b879-0214-40f0-a765-ed93724fdda4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:14.424007 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a62b879-0214-40f0-a765-ed93724fdda4 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:14.424293 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a62b879-0214-40f0-a765-ed93724fdda4 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:14.424566 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a62b879-0214-40f0-a765-ed93724fdda4 None admin] PATH_INFO: `/v3/projects/f4d88030405047648869d4fa21dc117c` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:14.426781 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a62b879-0214-40f0-a765-ed93724fdda4 None admin] RBAC: Authorizing `identity:get_project(project_id=f4d88030405047648869d4fa21dc117c)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:14.428291 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a62b879-0214-40f0-a765-ed93724fdda4 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:14.430286 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 225/451] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Oct 4 11:40:14 2022] GET /identity/v3/projects/f4d88030405047648869d4fa21dc117c => generated 344 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 11:40:14.435593 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a62b879-0214-40f0-a765-ed93724fdda4 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:14.473098 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4cbf61-721c-4eca-9df5-f2a28533493a None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:14.518678 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772081b6-5558-4013-b3ac-6cf8b80add08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:14.519313 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772081b6-5558-4013-b3ac-6cf8b80add08 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:14.519665 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772081b6-5558-4013-b3ac-6cf8b80add08 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:14.520111 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772081b6-5558-4013-b3ac-6cf8b80add08 None admin] PATH_INFO: `/v3/groups/bf50c5df97c94d298b9a0c5de090dd62` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:14.524657 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772081b6-5558-4013-b3ac-6cf8b80add08 None admin] RBAC: Authorizing `identity:get_group(group_id=bf50c5df97c94d298b9a0c5de090dd62)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:14.525939 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772081b6-5558-4013-b3ac-6cf8b80add08 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:14.527565 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 227/452] 10.222.0.59 () {56 vars in 1180 bytes} [Tue Oct 4 11:40:14 2022] GET /identity/v3/groups/bf50c5df97c94d298b9a0c5de090dd62 => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:14.533329 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772081b6-5558-4013-b3ac-6cf8b80add08 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:14.571635 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a62b879-0214-40f0-a765-ed93724fdda4 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:14.574570 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:14.606398 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c4638b-8cb1-4894-935e-fea72d636d13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:14.607022 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c4638b-8cb1-4894-935e-fea72d636d13 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:14.607295 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c4638b-8cb1-4894-935e-fea72d636d13 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:14.607561 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c4638b-8cb1-4894-935e-fea72d636d13 None admin] PATH_INFO: `/v3/groups/08ce265b567a454bbdeebb8379b6f218` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:14.608686 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c4638b-8cb1-4894-935e-fea72d636d13 None admin] RBAC: Authorizing `identity:get_group(group_id=08ce265b567a454bbdeebb8379b6f218)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:14.610104 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c4638b-8cb1-4894-935e-fea72d636d13 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:14.611642 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 226/453] 10.222.0.59 () {56 vars in 1180 bytes} [Tue Oct 4 11:40:14 2022] GET /identity/v3/groups/08ce265b567a454bbdeebb8379b6f218 => generated 229 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 11:40:14.618058 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c4638b-8cb1-4894-935e-fea72d636d13 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:14.638706 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772081b6-5558-4013-b3ac-6cf8b80add08 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:14.663931 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:14.672177 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287bcfdc-3a26-4032-b555-2e73915e8a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:14.672887 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287bcfdc-3a26-4032-b555-2e73915e8a69 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:14.673161 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287bcfdc-3a26-4032-b555-2e73915e8a69 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:14.673429 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287bcfdc-3a26-4032-b555-2e73915e8a69 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:14.674138 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287bcfdc-3a26-4032-b555-2e73915e8a69 None admin] RBAC: Adding query filter params (group.id=bf50c5df97c94d298b9a0c5de090dd62, role.id=b6018afb40c74d19b8cadc402256f23d, scope.project.id=c883e45022464667b26d995f7ba3657d) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:14.674439 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287bcfdc-3a26-4032-b555-2e73915e8a69 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:14.676512 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287bcfdc-3a26-4032-b555-2e73915e8a69 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:14.682383 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 228/454] 10.222.0.59 () {56 vars in 1376 bytes} [Tue Oct 4 11:40:14 2022] GET /identity/v3/role_assignments?group.id=bf50c5df97c94d298b9a0c5de090dd62&scope.project.id=c883e45022464667b26d995f7ba3657d&role.id=b6018afb40c74d19b8cadc402256f23d => generated 611 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 11:40:14.717945 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c4638b-8cb1-4894-935e-fea72d636d13 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:14.755064 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c06363-18f3-4fa9-96f7-f3de78c3dd74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:14.755692 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c06363-18f3-4fa9-96f7-f3de78c3dd74 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:14.755970 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c06363-18f3-4fa9-96f7-f3de78c3dd74 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:14.756239 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c06363-18f3-4fa9-96f7-f3de78c3dd74 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:14.757014 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c06363-18f3-4fa9-96f7-f3de78c3dd74 None admin] RBAC: Adding query filter params (group.id=08ce265b567a454bbdeebb8379b6f218, role.id=d6e7421d1ff9451c808004b818354550, scope.project.id=f4d88030405047648869d4fa21dc117c) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:14.757324 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c06363-18f3-4fa9-96f7-f3de78c3dd74 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:14.758780 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c06363-18f3-4fa9-96f7-f3de78c3dd74 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:14.765245 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 227/455] 10.222.0.59 () {56 vars in 1376 bytes} [Tue Oct 4 11:40:14 2022] GET /identity/v3/role_assignments?group.id=08ce265b567a454bbdeebb8379b6f218&scope.project.id=f4d88030405047648869d4fa21dc117c&role.id=d6e7421d1ff9451c808004b818354550 => generated 611 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 11:40:17.433965 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c445b2dc-fa4c-40b3-aa8f-87a1a06554b6 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:17.434483 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c445b2dc-fa4c-40b3-aa8f-87a1a06554b6 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:17.434774 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c445b2dc-fa4c-40b3-aa8f-87a1a06554b6 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:17.436293 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 229/456] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:40:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:40:17.442439 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e913721f-6f69-4f78-9334-db1481ff76ad None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:17.442866 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e913721f-6f69-4f78-9334-db1481ff76ad None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:17.443043 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e913721f-6f69-4f78-9334-db1481ff76ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:17.465651 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-e913721f-6f69-4f78-9334-db1481ff76ad None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:40:17.466868 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-e913721f-6f69-4f78-9334-db1481ff76ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:40:17.571435 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 228/457] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:40:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 11:40:17.918134 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c445b2dc-fa4c-40b3-aa8f-87a1a06554b6 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:17.962808 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233f55a6-bce6-46f5-91c9-3c2897a079bc None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:17.963481 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233f55a6-bce6-46f5-91c9-3c2897a079bc None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:17.963873 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233f55a6-bce6-46f5-91c9-3c2897a079bc None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:17.965457 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 229/458] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:40:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:40:17.979846 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce30f0d-eeac-4d26-8689-8b0108c1f280 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:17.980487 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce30f0d-eeac-4d26-8689-8b0108c1f280 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:17.981040 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce30f0d-eeac-4d26-8689-8b0108c1f280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:18.011247 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-2ce30f0d-eeac-4d26-8689-8b0108c1f280 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:40:18.017091 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-2ce30f0d-eeac-4d26-8689-8b0108c1f280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:40:18.056983 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:18.063138 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c445b2dc-fa4c-40b3-aa8f-87a1a06554b6 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:18.089095 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:18.126290 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afa5998-4a36-4e07-99fe-643d45501e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:18.126935 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afa5998-4a36-4e07-99fe-643d45501e8b None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:18.127218 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afa5998-4a36-4e07-99fe-643d45501e8b None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:18.127488 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afa5998-4a36-4e07-99fe-643d45501e8b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:18.148044 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 230/459] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:40:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 11:40:18.154083 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afa5998-4a36-4e07-99fe-643d45501e8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:18.156084 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afa5998-4a36-4e07-99fe-643d45501e8b None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:18.158372 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0758b86e-4980-4ef7-b7fe-6c7e9a5f259d None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:18.158660 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0758b86e-4980-4ef7-b7fe-6c7e9a5f259d None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:18.158939 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0758b86e-4980-4ef7-b7fe-6c7e9a5f259d None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:18.164649 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 231/460] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:40:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:40:18.170928 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7c61b3-8284-47bd-a4e2-1e03aceb874b None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:18.171119 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7c61b3-8284-47bd-a4e2-1e03aceb874b None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:18.171384 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7c61b3-8284-47bd-a4e2-1e03aceb874b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:18.194246 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-9afa5998-4a36-4e07-99fe-643d45501e8b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:40:18.194246 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:18.194246 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:18.194246 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:18.194246 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:18.194246 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:18.194246 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:18.194246 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:18.194246 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:18.194246 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:18.194246 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:18.194246 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:18.194246 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 11:40:18.194246 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 11:40:18.194246 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 11:40:18.194246 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 11:40:18.195262 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:18.195262 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:18.195262 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:40:18.195262 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:40:18.195262 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:40:18.195262 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:40:18.195262 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:40:18.195262 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:40:18.195262 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:40:18.195262 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:40:18.195262 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:40:18.195262 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:40:18.195262 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:40:18.195262 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:40:18.195262 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:40:18.195262 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:40:18.195262 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 11:40:18.196138 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 11:40:18.196138 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:40:18.196138 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:40:18.200633 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 230/461] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Oct 4 11:40:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:40:18.201448 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afa5998-4a36-4e07-99fe-643d45501e8b None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:18.202717 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-3a7c61b3-8284-47bd-a4e2-1e03aceb874b None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:40:18.203891 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-3a7c61b3-8284-47bd-a4e2-1e03aceb874b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:40:18.288152 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 232/462] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:40:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 11:40:18.289450 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d02b50c-eb8b-4b0a-a8b1-b1cf6d6880f7 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:18.289807 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d02b50c-eb8b-4b0a-a8b1-b1cf6d6880f7 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:18.290069 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d02b50c-eb8b-4b0a-a8b1-b1cf6d6880f7 None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:18.291561 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 233/463] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:40:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:40:18.296768 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9ff1a8-9351-4667-8bf4-26270135e025 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:18.297052 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9ff1a8-9351-4667-8bf4-26270135e025 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:18.297327 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9ff1a8-9351-4667-8bf4-26270135e025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:18.341770 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-5f9ff1a8-9351-4667-8bf4-26270135e025 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:40:18.342984 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-5f9ff1a8-9351-4667-8bf4-26270135e025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:40:18.382447 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afa5998-4a36-4e07-99fe-643d45501e8b None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:18.417229 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa5b4e8-6ec8-4dea-9f3b-4b5a04252213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:18.417823 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa5b4e8-6ec8-4dea-9f3b-4b5a04252213 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:18.418096 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa5b4e8-6ec8-4dea-9f3b-4b5a04252213 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:18.418446 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa5b4e8-6ec8-4dea-9f3b-4b5a04252213 None admin] PATH_INFO: `/v3/domains` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:18.419195 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa5b4e8-6ec8-4dea-9f3b-4b5a04252213 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:18.419519 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa5b4e8-6ec8-4dea-9f3b-4b5a04252213 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:18.421030 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa5b4e8-6ec8-4dea-9f3b-4b5a04252213 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:18.434628 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 231/464] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Oct 4 11:40:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:18.445672 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa5b4e8-6ec8-4dea-9f3b-4b5a04252213 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:18.454216 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 234/465] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:40:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 11:40:18.460908 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:18.497554 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9ff1a8-9351-4667-8bf4-26270135e025 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:18.549642 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:18.552285 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa5b4e8-6ec8-4dea-9f3b-4b5a04252213 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:18.587423 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22334d4-9344-4925-a795-f59abac42ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:18.588025 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22334d4-9344-4925-a795-f59abac42ad5 None admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:18.588293 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22334d4-9344-4925-a795-f59abac42ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:18.588563 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22334d4-9344-4925-a795-f59abac42ad5 None admin] PATH_INFO: `/v3/users` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:18.589235 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22334d4-9344-4925-a795-f59abac42ad5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:18.590659 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22334d4-9344-4925-a795-f59abac42ad5 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:18.652623 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9ff1a8-9351-4667-8bf4-26270135e025 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:18.695957 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 232/466] 10.222.0.59 () {60 vars in 1132 bytes} [Tue Oct 4 11:40:18 2022] POST /identity/v3/users => generated 246 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 11:40:18.712084 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6bbaf3-cff3-4406-b5c4-e654f60479a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:18.712822 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6bbaf3-cff3-4406-b5c4-e654f60479a1 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:18.713189 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6bbaf3-cff3-4406-b5c4-e654f60479a1 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:18.713466 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6bbaf3-cff3-4406-b5c4-e654f60479a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:18.721152 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22334d4-9344-4925-a795-f59abac42ad5 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:18.726306 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6bbaf3-cff3-4406-b5c4-e654f60479a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:18.727776 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6bbaf3-cff3-4406-b5c4-e654f60479a1 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:18.762236 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-fb6bbaf3-cff3-4406-b5c4-e654f60479a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:40:18.762236 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:18.762236 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:18.762236 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:18.762236 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:18.762236 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:18.762236 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:18.762236 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:18.762236 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:18.762236 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:18.762236 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:18.762236 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:18.762236 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 11:40:18.762236 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 11:40:18.762236 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 11:40:18.762236 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 11:40:18.763235 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:18.763235 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:18.763235 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:40:18.763235 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:40:18.763235 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:40:18.763235 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:40:18.763235 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:40:18.763235 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:40:18.763235 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:40:18.763235 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:40:18.763235 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:40:18.763235 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:40:18.763235 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:40:18.763235 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:40:18.763235 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:40:18.763235 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:40:18.763235 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 11:40:18.764084 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 11:40:18.764084 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:40:18.764084 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:40:18.766757 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 235/467] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Oct 4 11:40:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 11:40:18.772996 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6bbaf3-cff3-4406-b5c4-e654f60479a1 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:18.822760 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:18.863619 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22334d4-9344-4925-a795-f59abac42ad5 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:18.898016 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:18.909130 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00473d32-5d84-42cf-b9ca-450ec08147ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:18.910572 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00473d32-5d84-42cf-b9ca-450ec08147ec None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:18.911348 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00473d32-5d84-42cf-b9ca-450ec08147ec None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:18.912067 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00473d32-5d84-42cf-b9ca-450ec08147ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:18.920510 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6bbaf3-cff3-4406-b5c4-e654f60479a1 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:18.929401 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00473d32-5d84-42cf-b9ca-450ec08147ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:18.931077 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00473d32-5d84-42cf-b9ca-450ec08147ec None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:18.946768 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-00473d32-5d84-42cf-b9ca-450ec08147ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:40:18.946768 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:18.946768 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:18.946768 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:18.946768 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:18.946768 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:18.946768 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:18.946768 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:18.946768 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:18.946768 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:18.946768 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:18.946768 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:18.946768 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 11:40:18.946768 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 11:40:18.946768 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 11:40:18.946768 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 11:40:18.947731 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:18.947731 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:18.947731 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:40:18.947731 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:40:18.947731 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:40:18.947731 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:40:18.947731 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:40:18.947731 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:40:18.947731 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:40:18.947731 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:40:18.947731 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:40:18.947731 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:40:18.947731 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:40:18.947731 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:40:18.947731 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:40:18.947731 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:40:18.947731 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 11:40:18.948633 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 11:40:18.948633 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:40:18.948633 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:40:18.948633 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 233/468] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Oct 4 11:40:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:40:18.949036 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00473d32-5d84-42cf-b9ca-450ec08147ec None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:19.007872 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3644bfd-aba4-469b-9534-6a87692e0a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:19.008483 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3644bfd-aba4-469b-9534-6a87692e0a80 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:19.008808 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3644bfd-aba4-469b-9534-6a87692e0a80 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:19.009082 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3644bfd-aba4-469b-9534-6a87692e0a80 None admin] PATH_INFO: `/v3/domains` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:19.009987 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3644bfd-aba4-469b-9534-6a87692e0a80 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:19.010296 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3644bfd-aba4-469b-9534-6a87692e0a80 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:19.012064 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3644bfd-aba4-469b-9534-6a87692e0a80 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:19.033415 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 236/469] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Oct 4 11:40:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 11:40:19.034299 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3644bfd-aba4-469b-9534-6a87692e0a80 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:19.074525 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00473d32-5d84-42cf-b9ca-450ec08147ec None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:19.096660 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:19.112535 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0d71ed-8449-4330-b1a3-ace884ec7d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:19.113584 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0d71ed-8449-4330-b1a3-ace884ec7d49 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:19.114143 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0d71ed-8449-4330-b1a3-ace884ec7d49 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:19.114584 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0d71ed-8449-4330-b1a3-ace884ec7d49 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:19.125785 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0d71ed-8449-4330-b1a3-ace884ec7d49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:19.127470 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0d71ed-8449-4330-b1a3-ace884ec7d49 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:19.143987 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-1b0d71ed-8449-4330-b1a3-ace884ec7d49 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:40:19.143987 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:19.143987 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:19.143987 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:19.143987 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:19.143987 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:19.143987 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:19.143987 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:19.143987 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:19.143987 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:19.143987 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:19.143987 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:19.143987 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 11:40:19.143987 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 11:40:19.143987 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 11:40:19.143987 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 11:40:19.145316 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:19.145316 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:19.145316 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:40:19.145316 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:40:19.145316 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:40:19.145316 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:40:19.145316 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:40:19.145316 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:40:19.145316 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:40:19.145316 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:40:19.145316 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:40:19.145316 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:40:19.145316 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:40:19.145316 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:40:19.145316 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:40:19.145316 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:40:19.145316 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 11:40:19.146176 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 11:40:19.146176 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:40:19.146176 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:40:19.148279 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 234/470] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Oct 4 11:40:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:40:19.149293 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0d71ed-8449-4330-b1a3-ace884ec7d49 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:19.167653 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3644bfd-aba4-469b-9534-6a87692e0a80 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:19.209881 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea0ae18-6250-49a3-b46f-fffb1702d8aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:19.210417 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea0ae18-6250-49a3-b46f-fffb1702d8aa None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:19.210697 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea0ae18-6250-49a3-b46f-fffb1702d8aa None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:19.210970 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea0ae18-6250-49a3-b46f-fffb1702d8aa None admin] PATH_INFO: `/v3/domains` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:19.211617 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea0ae18-6250-49a3-b46f-fffb1702d8aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:19.211917 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea0ae18-6250-49a3-b46f-fffb1702d8aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:19.213322 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea0ae18-6250-49a3-b46f-fffb1702d8aa None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:19.226455 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 237/471] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Oct 4 11:40:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:19.229508 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea0ae18-6250-49a3-b46f-fffb1702d8aa None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:19.233494 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:19.256840 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0d71ed-8449-4330-b1a3-ace884ec7d49 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:19.293799 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eb6eb2-b0e2-4beb-9e3e-cf8ee1eca7ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:19.294395 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eb6eb2-b0e2-4beb-9e3e-cf8ee1eca7ef None admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:19.294670 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eb6eb2-b0e2-4beb-9e3e-cf8ee1eca7ef None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:19.294983 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eb6eb2-b0e2-4beb-9e3e-cf8ee1eca7ef None admin] PATH_INFO: `/v3/users` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:19.295572 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8eb6eb2-b0e2-4beb-9e3e-cf8ee1eca7ef None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:19.297030 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8eb6eb2-b0e2-4beb-9e3e-cf8ee1eca7ef None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:19.337503 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea0ae18-6250-49a3-b46f-fffb1702d8aa None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:19.365972 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 235/472] 10.222.0.59 () {60 vars in 1132 bytes} [Tue Oct 4 11:40:19 2022] POST /identity/v3/users => generated 248 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 11:40:19.367521 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0b74e3-6860-4836-bbb4-f7e2f717a388 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:19.367813 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0b74e3-6860-4836-bbb4-f7e2f717a388 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:19.368090 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0b74e3-6860-4836-bbb4-f7e2f717a388 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:19.369573 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 236/473] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:40:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:40:19.374754 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0b74e3-6860-4836-bbb4-f7e2f717a388 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:19.383056 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcead60a-0c98-4db7-86f4-71b1ebd5b68c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:19.384113 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcead60a-0c98-4db7-86f4-71b1ebd5b68c None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:19.384543 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcead60a-0c98-4db7-86f4-71b1ebd5b68c None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:19.384990 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcead60a-0c98-4db7-86f4-71b1ebd5b68c None admin] PATH_INFO: `/v3/domains` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:19.385979 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcead60a-0c98-4db7-86f4-71b1ebd5b68c None admin] RBAC: Adding query filter params (name=Default) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:19.386547 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcead60a-0c98-4db7-86f4-71b1ebd5b68c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:19.388353 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcead60a-0c98-4db7-86f4-71b1ebd5b68c None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:19.403641 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 238/474] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Oct 4 11:40:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:19.405769 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e4a999-672e-44d8-9923-0007e29cda4c None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:19.406380 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e4a999-672e-44d8-9923-0007e29cda4c None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:19.410895 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e4a999-672e-44d8-9923-0007e29cda4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:19.411028 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:19.430956 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-50e4a999-672e-44d8-9923-0007e29cda4c None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:40:19.432648 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-50e4a999-672e-44d8-9923-0007e29cda4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:40:19.505981 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0b74e3-6860-4836-bbb4-f7e2f717a388 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:19.523438 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:19.545013 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 239/475] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:40:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 11:40:19.545013 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e4a999-672e-44d8-9923-0007e29cda4c None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:19.576925 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21994f2-1a23-4f8c-b099-a7dfab859f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:19.577526 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21994f2-1a23-4f8c-b099-a7dfab859f85 None admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:19.577806 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21994f2-1a23-4f8c-b099-a7dfab859f85 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:19.578080 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21994f2-1a23-4f8c-b099-a7dfab859f85 None admin] PATH_INFO: `/v3/users` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:19.578731 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21994f2-1a23-4f8c-b099-a7dfab859f85 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:19.580163 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21994f2-1a23-4f8c-b099-a7dfab859f85 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:19.670380 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e4a999-672e-44d8-9923-0007e29cda4c None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:19.710422 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a05ff9-8a76-42cb-8327-f9b88cc7d101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:19.711031 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a05ff9-8a76-42cb-8327-f9b88cc7d101 None admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:19.711306 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a05ff9-8a76-42cb-8327-f9b88cc7d101 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:19.711573 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a05ff9-8a76-42cb-8327-f9b88cc7d101 None admin] PATH_INFO: `/v3/users` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:19.712229 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a05ff9-8a76-42cb-8327-f9b88cc7d101 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:19.714335 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a05ff9-8a76-42cb-8327-f9b88cc7d101 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:19.725332 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 237/476] 10.222.0.59 () {60 vars in 1132 bytes} [Tue Oct 4 11:40:19 2022] POST /identity/v3/users => generated 248 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 11:40:19.841368 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 240/477] 10.222.0.59 () {60 vars in 1132 bytes} [Tue Oct 4 11:40:19 2022] POST /identity/v3/users => generated 249 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 11:40:19.844020 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21994f2-1a23-4f8c-b099-a7dfab859f85 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:19.971479 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:19.994946 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21994f2-1a23-4f8c-b099-a7dfab859f85 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:20.034168 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae64fd7-4410-42c4-9ebd-2be25b559a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:20.035522 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae64fd7-4410-42c4-9ebd-2be25b559a5e None admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:20.035630 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae64fd7-4410-42c4-9ebd-2be25b559a5e None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:20.035871 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae64fd7-4410-42c4-9ebd-2be25b559a5e None admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:20.036545 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae64fd7-4410-42c4-9ebd-2be25b559a5e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:20.037998 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae64fd7-4410-42c4-9ebd-2be25b559a5e None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:20.074735 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.sql.core [None req-0ae64fd7-4410-42c4-9ebd-2be25b559a5e None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 04 11:40:20.074735 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 04 11:40:20.074735 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [parameters: {'id': '443d01d589854e5fb1c9b8d86ccabec2', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 04 11:40:20.074735 dv-cinder-860212-2-smb devstack@keystone.service[98475]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=98475) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 04 11:40:20.092890 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-0ae64fd7-4410-42c4-9ebd-2be25b559a5e None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 04 11:40:20.092890 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:20.092890 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 11:40:20.092890 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 04 11:40:20.092890 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 11:40:20.092890 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 04 11:40:20.092890 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 11:40:20.092890 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application result = self._query(query) Oct 04 11:40:20.092890 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 11:40:20.092890 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application conn.query(q) Oct 04 11:40:20.092890 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 11:40:20.092890 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 11:40:20.092890 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 11:40:20.092890 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application result.read() Oct 04 11:40:20.092890 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 11:40:20.093791 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 04 11:40:20.093791 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 11:40:20.093791 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 04 11:40:20.093791 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 11:40:20.093791 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 04 11:40:20.093791 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 11:40:20.093791 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 04 11:40:20.093791 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 04 11:40:20.093791 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:40:20.093791 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 04 11:40:20.093791 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:40:20.093791 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:20.093791 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 04 11:40:20.093791 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 04 11:40:20.093791 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Oct 04 11:40:20.093791 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return ref.to_dict() Oct 04 11:40:20.093791 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 04 11:40:20.093791 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application next(self.gen) Oct 04 11:40:20.094690 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 04 11:40:20.094690 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application yield resource Oct 04 11:40:20.094690 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 04 11:40:20.094690 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application next(self.gen) Oct 04 11:40:20.094690 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 04 11:40:20.094690 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application self.session.rollback() Oct 04 11:40:20.094690 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 11:40:20.094690 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application self.force_reraise() Oct 04 11:40:20.094690 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 11:40:20.094690 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise self.value Oct 04 11:40:20.094690 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 04 11:40:20.094690 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 04 11:40:20.094690 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 04 11:40:20.094690 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application session.commit() Oct 04 11:40:20.094690 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 04 11:40:20.094690 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 04 11:40:20.094690 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 04 11:40:20.095588 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application self._prepare_impl() Oct 04 11:40:20.095588 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 04 11:40:20.095588 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application self.session.flush() Oct 04 11:40:20.095588 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 04 11:40:20.095588 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application self._flush(objects) Oct 04 11:40:20.095588 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 04 11:40:20.095588 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 04 11:40:20.095588 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 04 11:40:20.095588 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application compat.raise_( Oct 04 11:40:20.095588 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 11:40:20.095588 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception Oct 04 11:40:20.095588 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 04 11:40:20.095588 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application flush_context.execute() Oct 04 11:40:20.095588 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 04 11:40:20.095588 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rec.execute(self) Oct 04 11:40:20.095588 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 04 11:40:20.095588 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 04 11:40:20.097987 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 04 11:40:20.097987 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 04 11:40:20.097987 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 04 11:40:20.097987 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 04 11:40:20.097987 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 04 11:40:20.097987 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 04 11:40:20.097987 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 04 11:40:20.097987 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 04 11:40:20.097987 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 04 11:40:20.097987 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 04 11:40:20.097987 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 04 11:40:20.097987 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 04 11:40:20.097987 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 04 11:40:20.097987 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 04 11:40:20.097987 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 11:40:20.097987 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception Oct 04 11:40:20.100361 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 11:40:20.100361 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 04 11:40:20.100361 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 11:40:20.100361 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 04 11:40:20.100361 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 11:40:20.100361 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application result = self._query(query) Oct 04 11:40:20.100361 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 11:40:20.100361 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application conn.query(q) Oct 04 11:40:20.100361 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 11:40:20.100361 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 11:40:20.100361 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 11:40:20.100361 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application result.read() Oct 04 11:40:20.100361 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 11:40:20.100361 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 04 11:40:20.100361 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 11:40:20.100361 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 04 11:40:20.103952 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 11:40:20.103952 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 04 11:40:20.103952 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 11:40:20.103952 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 04 11:40:20.103952 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 04 11:40:20.103952 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 04 11:40:20.103952 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [parameters: {'id': '443d01d589854e5fb1c9b8d86ccabec2', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 04 11:40:20.103952 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 04 11:40:20.103952 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:40:20.103952 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 11:40:20.103952 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:40:20.103952 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:20.103952 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:20.103952 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:20.103952 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:20.103952 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:20.105924 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:20.105924 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:20.105924 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:20.105924 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:20.105924 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:20.105924 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:20.105924 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Oct 04 11:40:20.105924 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Oct 04 11:40:20.105924 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:20.105924 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:20.105924 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Oct 04 11:40:20.105924 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Oct 04 11:40:20.105924 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 04 11:40:20.105924 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 04 11:40:20.105924 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 04 11:40:20.105924 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:40:20.108708 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 238/478] 10.222.0.59 () {60 vars in 1131 bytes} [Tue Oct 4 11:40:19 2022] POST /identity/v3/roles => generated 144 bytes in 251 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:40:20.110041 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a05ff9-8a76-42cb-8327-f9b88cc7d101 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:20.166007 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:20.228879 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a05ff9-8a76-42cb-8327-f9b88cc7d101 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:20.276926 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5be7d3-4139-4c80-9276-1c66bc02b4d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:20.277563 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5be7d3-4139-4c80-9276-1c66bc02b4d6 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:20.277838 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5be7d3-4139-4c80-9276-1c66bc02b4d6 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:20.278106 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5be7d3-4139-4c80-9276-1c66bc02b4d6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:20.292619 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5be7d3-4139-4c80-9276-1c66bc02b4d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 11:40:20.298024 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-6e5be7d3-4139-4c80-9276-1c66bc02b4d6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 11:40:20.298024 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:20.298024 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:20.298024 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:20.298024 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:20.298024 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:20.298024 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:20.298024 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:20.298024 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:20.298024 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:20.298024 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:20.298024 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:20.298024 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 11:40:20.298024 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 11:40:20.298024 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 11:40:20.298024 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 11:40:20.298891 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 11:40:20.298891 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 11:40:20.298891 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 11:40:20.298891 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 11:40:20.298891 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:20.298891 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:20.298891 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:40:20.298891 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:40:20.298891 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:40:20.298891 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:40:20.298891 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:40:20.298891 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:40:20.298891 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:40:20.298891 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:40:20.298891 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:40:20.298891 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:40:20.299700 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:40:20.299700 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:40:20.299700 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:40:20.299700 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:40:20.299700 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 11:40:20.299700 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 11:40:20.299700 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 11:40:20.299700 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 11:40:20.299700 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 11:40:20.299700 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 11:40:20.299700 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 11:40:20.299700 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:40:20.299700 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 241/479] 10.222.0.59 () {56 vars in 1114 bytes} [Tue Oct 4 11:40:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:40:20.306081 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae64fd7-4410-42c4-9ebd-2be25b559a5e None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:20.450461 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae64fd7-4410-42c4-9ebd-2be25b559a5e None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:20.486501 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2249119-a4a6-4c78-9c74-012b4352b9e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:20.487101 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2249119-a4a6-4c78-9c74-012b4352b9e3 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:20.487377 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2249119-a4a6-4c78-9c74-012b4352b9e3 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:20.487646 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2249119-a4a6-4c78-9c74-012b4352b9e3 None admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:20.488865 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2249119-a4a6-4c78-9c74-012b4352b9e3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:20.489380 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2249119-a4a6-4c78-9c74-012b4352b9e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:20.491855 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2249119-a4a6-4c78-9c74-012b4352b9e3 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:20.505918 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 239/480] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Oct 4 11:40:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:21.238946 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d34844-a6c3-4fa4-8d08-44d630577046 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:21.239503 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d34844-a6c3-4fa4-8d08-44d630577046 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:21.239503 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d34844-a6c3-4fa4-8d08-44d630577046 None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:21.240844 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 242/481] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:40:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:40:21.245955 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fa6ed2-bbdf-422e-8304-a698d35d7ff6 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:21.246340 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fa6ed2-bbdf-422e-8304-a698d35d7ff6 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:21.246532 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fa6ed2-bbdf-422e-8304-a698d35d7ff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:21.273526 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-28fa6ed2-bbdf-422e-8304-a698d35d7ff6 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:40:21.274702 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-28fa6ed2-bbdf-422e-8304-a698d35d7ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:40:21.277579 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:21.360798 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 240/482] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:40:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 11:40:21.766803 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d34844-a6c3-4fa4-8d08-44d630577046 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:21.889986 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d34844-a6c3-4fa4-8d08-44d630577046 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:21.900312 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:21.927126 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c147eb5-4459-4210-97e2-a51405c9b699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:21.928119 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c147eb5-4459-4210-97e2-a51405c9b699 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:21.928633 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c147eb5-4459-4210-97e2-a51405c9b699 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:21.929115 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c147eb5-4459-4210-97e2-a51405c9b699 None admin] PATH_INFO: `/v3/roles/service` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:21.941091 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c147eb5-4459-4210-97e2-a51405c9b699 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 11:40:21.946486 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-0c147eb5-4459-4210-97e2-a51405c9b699 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 11:40:21.946486 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:21.946486 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:21.946486 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:21.946486 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:21.946486 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:21.946486 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:21.946486 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:21.946486 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:21.946486 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:21.946486 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:21.946486 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:21.946486 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 11:40:21.946486 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 11:40:21.946486 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 11:40:21.946486 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 11:40:21.947445 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 11:40:21.947445 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 11:40:21.947445 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 11:40:21.947445 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 11:40:21.947445 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:21.947445 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:21.947445 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:40:21.947445 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:40:21.947445 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:40:21.947445 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:40:21.947445 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:40:21.947445 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:40:21.947445 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:40:21.947445 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:40:21.947445 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:40:21.947445 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:40:21.948291 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:40:21.948291 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:40:21.948291 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:40:21.948291 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:40:21.948291 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 11:40:21.948291 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 11:40:21.948291 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 11:40:21.948291 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 11:40:21.948291 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 11:40:21.948291 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 11:40:21.948291 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 11:40:21.948291 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:40:21.950878 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 243/483] 10.222.0.59 () {56 vars in 1102 bytes} [Tue Oct 4 11:40:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:40:21.957054 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fa6ed2-bbdf-422e-8304-a698d35d7ff6 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:22.111846 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fa6ed2-bbdf-422e-8304-a698d35d7ff6 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:22.152659 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7c19f4-7883-4b9e-baee-4ccc25232b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:22.153621 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7c19f4-7883-4b9e-baee-4ccc25232b7a None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:22.154109 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7c19f4-7883-4b9e-baee-4ccc25232b7a None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:22.154581 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7c19f4-7883-4b9e-baee-4ccc25232b7a None admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:22.155435 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7c19f4-7883-4b9e-baee-4ccc25232b7a None admin] RBAC: Adding query filter params (name=service) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:22.155934 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7c19f4-7883-4b9e-baee-4ccc25232b7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:22.157595 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7c19f4-7883-4b9e-baee-4ccc25232b7a None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:22.167357 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 241/484] 10.222.0.59 () {56 vars in 1103 bytes} [Tue Oct 4 11:40:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:22.173262 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c147eb5-4459-4210-97e2-a51405c9b699 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:22.183911 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3ac067-662d-4ed0-84f7-be4858fba1fb None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:22.186061 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3ac067-662d-4ed0-84f7-be4858fba1fb None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:22.186564 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3ac067-662d-4ed0-84f7-be4858fba1fb None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:22.189362 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 242/485] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:40:22 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 11:40:22.196624 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dd3f81-9b65-4c14-8ba4-9112b058bd53 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:22.198671 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dd3f81-9b65-4c14-8ba4-9112b058bd53 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:22.199181 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dd3f81-9b65-4c14-8ba4-9112b058bd53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:22.213480 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:22.233189 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-99dd3f81-9b65-4c14-8ba4-9112b058bd53 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:40:22.235085 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-99dd3f81-9b65-4c14-8ba4-9112b058bd53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:40:22.320218 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 243/486] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:40:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 11:40:22.397075 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c147eb5-4459-4210-97e2-a51405c9b699 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:22.432534 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2fcdfc-bd80-4651-b705-3df912304ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:22.433118 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2fcdfc-bd80-4651-b705-3df912304ae6 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:22.433400 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2fcdfc-bd80-4651-b705-3df912304ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:22.433671 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2fcdfc-bd80-4651-b705-3df912304ae6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:22.444779 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2fcdfc-bd80-4651-b705-3df912304ae6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:22.446245 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2fcdfc-bd80-4651-b705-3df912304ae6 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:22.461373 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-bf2fcdfc-bd80-4651-b705-3df912304ae6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:40:22.461373 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:22.461373 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:22.461373 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:22.461373 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:22.461373 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:22.461373 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:22.461373 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:22.461373 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:22.461373 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:22.461373 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:22.461373 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:22.461373 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 11:40:22.461373 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 11:40:22.461373 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 11:40:22.461373 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 11:40:22.462345 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:22.462345 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:22.462345 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:40:22.462345 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:40:22.462345 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:40:22.462345 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:40:22.462345 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:40:22.462345 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:40:22.462345 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:40:22.462345 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:40:22.462345 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:40:22.462345 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:40:22.462345 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:40:22.462345 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:40:22.462345 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:40:22.462345 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:40:22.462345 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 11:40:22.463214 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 11:40:22.463214 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:40:22.463214 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:40:22.463214 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 244/487] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Oct 4 11:40:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:40:22.469953 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dd3f81-9b65-4c14-8ba4-9112b058bd53 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:22.600091 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dd3f81-9b65-4c14-8ba4-9112b058bd53 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:22.634117 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:22.640439 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6779f337-edf0-46c7-b648-1188dd20ce26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:22.640790 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2fcdfc-bd80-4651-b705-3df912304ae6 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:22.641564 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6779f337-edf0-46c7-b648-1188dd20ce26 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:22.642057 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6779f337-edf0-46c7-b648-1188dd20ce26 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:22.642752 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6779f337-edf0-46c7-b648-1188dd20ce26 None admin] PATH_INFO: `/v3/domains` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:22.643595 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6779f337-edf0-46c7-b648-1188dd20ce26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:22.644791 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6779f337-edf0-46c7-b648-1188dd20ce26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:22.654682 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6779f337-edf0-46c7-b648-1188dd20ce26 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:22.659081 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 244/488] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Oct 4 11:40:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:22.660722 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c69da8-2091-4086-aae7-a741dcedaeb0 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:22.661333 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c69da8-2091-4086-aae7-a741dcedaeb0 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:22.665017 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c69da8-2091-4086-aae7-a741dcedaeb0 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:22.666748 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 245/489] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:40:22 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:40:22.669309 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c69da8-2091-4086-aae7-a741dcedaeb0 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:22.671912 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:22.756544 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2fcdfc-bd80-4651-b705-3df912304ae6 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:22.785746 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c69da8-2091-4086-aae7-a741dcedaeb0 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:22.792810 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eb35c5-deea-43d8-be85-0bf3d0894474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:22.793436 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eb35c5-deea-43d8-be85-0bf3d0894474 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:22.793727 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eb35c5-deea-43d8-be85-0bf3d0894474 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:22.793993 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eb35c5-deea-43d8-be85-0bf3d0894474 None admin] PATH_INFO: `/v3/roles/service` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:22.804881 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eb35c5-deea-43d8-be85-0bf3d0894474 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 11:40:22.810090 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-e2eb35c5-deea-43d8-be85-0bf3d0894474 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 11:40:22.810090 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:22.810090 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:22.810090 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:22.810090 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:22.810090 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:22.810090 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:22.810090 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:22.810090 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:22.810090 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:22.810090 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:22.810090 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:22.810090 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 11:40:22.810090 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 11:40:22.810090 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 11:40:22.810090 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 11:40:22.811183 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 11:40:22.811183 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 11:40:22.811183 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 11:40:22.811183 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 11:40:22.811183 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:22.811183 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:22.811183 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:40:22.811183 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:40:22.811183 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:40:22.811183 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:40:22.811183 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:40:22.811183 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:40:22.811183 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:40:22.811183 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:40:22.811183 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:40:22.811183 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:40:22.812120 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:40:22.812120 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:40:22.812120 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:40:22.812120 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:40:22.812120 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 11:40:22.812120 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 11:40:22.812120 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 11:40:22.812120 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 11:40:22.812120 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 11:40:22.812120 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 11:40:22.812120 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 11:40:22.812120 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:40:22.812120 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 245/490] 10.222.0.59 () {56 vars in 1102 bytes} [Tue Oct 4 11:40:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:40:22.817505 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d5d885-aa52-461b-9cbc-5f96aa64987a None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:22.818053 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d5d885-aa52-461b-9cbc-5f96aa64987a None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:22.818053 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d5d885-aa52-461b-9cbc-5f96aa64987a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:22.825738 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e2844f-cd8a-47e7-942e-2ce786239ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:22.826348 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e2844f-cd8a-47e7-942e-2ce786239ee1 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:22.826627 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e2844f-cd8a-47e7-942e-2ce786239ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:22.826895 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e2844f-cd8a-47e7-942e-2ce786239ee1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:22.835050 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e2844f-cd8a-47e7-942e-2ce786239ee1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:22.836470 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e2844f-cd8a-47e7-942e-2ce786239ee1 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:22.836584 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-06d5d885-aa52-461b-9cbc-5f96aa64987a None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:40:22.837778 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-06d5d885-aa52-461b-9cbc-5f96aa64987a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:40:22.849775 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-d3e2844f-cd8a-47e7-942e-2ce786239ee1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 04 11:40:22.849775 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:22.849775 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:22.849775 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:22.849775 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:22.849775 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:22.849775 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:22.849775 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:22.849775 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:22.849775 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:22.849775 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:22.849775 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:22.849775 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 11:40:22.849775 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 11:40:22.849775 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 11:40:22.849775 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 11:40:22.851023 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:22.851023 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:22.851023 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 11:40:22.851023 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 11:40:22.851023 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 11:40:22.851023 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 11:40:22.851023 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:40:22.851023 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:40:22.851023 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:40:22.851023 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:40:22.851023 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:40:22.851023 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:40:22.851023 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:40:22.851023 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:40:22.851023 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:40:22.851023 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:40:22.851023 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:40:22.851023 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:40:22.852128 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:40:22.852128 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:40:22.852128 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 11:40:22.852128 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 11:40:22.852128 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 11:40:22.852128 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 11:40:22.852128 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 11:40:22.852128 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 11:40:22.852128 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 04 11:40:22.852128 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:40:22.855367 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 246/491] 10.222.0.59 () {56 vars in 1093 bytes} [Tue Oct 4 11:40:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 11:40:22.856510 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c81032-272c-4910-9582-87ae3b471df9 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:22.856811 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c81032-272c-4910-9582-87ae3b471df9 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:22.857107 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c81032-272c-4910-9582-87ae3b471df9 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:22.860647 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 247/492] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:40:22 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:40:22.860647 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c81032-272c-4910-9582-87ae3b471df9 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:22.914851 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:22.928628 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 246/493] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:40:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 11:40:22.928628 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d5d885-aa52-461b-9cbc-5f96aa64987a None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:22.939950 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:22.984142 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c81032-272c-4910-9582-87ae3b471df9 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:23.030584 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c059fd1-a9b7-46f7-95d2-24a2edb661b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:23.031503 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c059fd1-a9b7-46f7-95d2-24a2edb661b7 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:23.032051 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c059fd1-a9b7-46f7-95d2-24a2edb661b7 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:23.032321 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c059fd1-a9b7-46f7-95d2-24a2edb661b7 None admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:23.033241 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c059fd1-a9b7-46f7-95d2-24a2edb661b7 None admin] RBAC: Adding query filter params (name=service) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:23.033552 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c059fd1-a9b7-46f7-95d2-24a2edb661b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:23.036509 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c059fd1-a9b7-46f7-95d2-24a2edb661b7 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:23.040351 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d5d885-aa52-461b-9cbc-5f96aa64987a None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:23.047237 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 248/494] 10.222.0.59 () {56 vars in 1103 bytes} [Tue Oct 4 11:40:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:23.049089 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e691acf2-14fa-4054-86d4-db6e3bc18dca None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:23.049375 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e691acf2-14fa-4054-86d4-db6e3bc18dca None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:23.049645 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e691acf2-14fa-4054-86d4-db6e3bc18dca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:23.073591 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-e691acf2-14fa-4054-86d4-db6e3bc18dca None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:40:23.074778 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-e691acf2-14fa-4054-86d4-db6e3bc18dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:40:23.085915 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba10eca-a79e-4e6a-9e84-2be1e48035c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:23.086916 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba10eca-a79e-4e6a-9e84-2be1e48035c6 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:23.087379 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba10eca-a79e-4e6a-9e84-2be1e48035c6 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:23.087870 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba10eca-a79e-4e6a-9e84-2be1e48035c6 None admin] PATH_INFO: `/v3/users` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:23.088974 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba10eca-a79e-4e6a-9e84-2be1e48035c6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:23.089513 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba10eca-a79e-4e6a-9e84-2be1e48035c6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:23.091292 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba10eca-a79e-4e6a-9e84-2be1e48035c6 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:23.135696 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 247/495] 10.222.0.59 () {56 vars in 1133 bytes} [Tue Oct 4 11:40:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:23.136918 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba10eca-a79e-4e6a-9e84-2be1e48035c6 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:23.155551 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 249/496] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:40:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 11:40:23.156474 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e691acf2-14fa-4054-86d4-db6e3bc18dca None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:23.203240 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:23.218388 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:23.256708 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba10eca-a79e-4e6a-9e84-2be1e48035c6 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:23.292994 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004e00f8-4a75-41a0-8dbd-d5eefe0c2082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:23.294048 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004e00f8-4a75-41a0-8dbd-d5eefe0c2082 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:23.294540 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004e00f8-4a75-41a0-8dbd-d5eefe0c2082 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:23.295081 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004e00f8-4a75-41a0-8dbd-d5eefe0c2082 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:23.307027 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004e00f8-4a75-41a0-8dbd-d5eefe0c2082 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:23.308933 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004e00f8-4a75-41a0-8dbd-d5eefe0c2082 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:23.310701 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e691acf2-14fa-4054-86d4-db6e3bc18dca None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:23.326637 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-004e00f8-4a75-41a0-8dbd-d5eefe0c2082 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:40:23.326637 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:23.326637 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:23.326637 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:23.326637 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:23.326637 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:23.326637 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:23.326637 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:23.326637 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:23.326637 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:23.326637 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:23.326637 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:23.326637 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 11:40:23.326637 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 11:40:23.326637 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 11:40:23.326637 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 11:40:23.327573 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:23.327573 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:23.327573 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:40:23.327573 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:40:23.327573 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:40:23.327573 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:40:23.327573 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:40:23.327573 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:40:23.327573 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:40:23.327573 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:40:23.327573 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:40:23.327573 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:40:23.327573 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:40:23.327573 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:40:23.327573 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:40:23.327573 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:40:23.327573 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 11:40:23.328426 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 11:40:23.328426 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:40:23.328426 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:40:23.330364 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 248/497] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Oct 4 11:40:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:40:23.331556 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004e00f8-4a75-41a0-8dbd-d5eefe0c2082 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:23.348057 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341abb20-89f9-4fcb-bd10-688f9a59a228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:23.348740 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341abb20-89f9-4fcb-bd10-688f9a59a228 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:23.348967 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341abb20-89f9-4fcb-bd10-688f9a59a228 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:23.349237 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341abb20-89f9-4fcb-bd10-688f9a59a228 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:23.424816 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341abb20-89f9-4fcb-bd10-688f9a59a228 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:23.427213 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341abb20-89f9-4fcb-bd10-688f9a59a228 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:23.451157 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004e00f8-4a75-41a0-8dbd-d5eefe0c2082 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:23.472728 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:23.474292 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:23.489831 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c53d968-011b-4d77-ac8a-b521fc038b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:23.490463 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c53d968-011b-4d77-ac8a-b521fc038b64 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:23.490738 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c53d968-011b-4d77-ac8a-b521fc038b64 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:23.491009 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c53d968-011b-4d77-ac8a-b521fc038b64 None admin] PATH_INFO: `/v3/roles/service` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:23.501963 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c53d968-011b-4d77-ac8a-b521fc038b64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 11:40:23.507366 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-9c53d968-011b-4d77-ac8a-b521fc038b64 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 11:40:23.507366 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:23.507366 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:23.507366 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:23.507366 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:23.507366 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:23.507366 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:23.507366 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:23.507366 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:23.507366 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:23.507366 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:23.507366 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:23.507366 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 11:40:23.507366 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 11:40:23.507366 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 11:40:23.507366 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 11:40:23.510251 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 11:40:23.510251 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 11:40:23.510251 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 11:40:23.510251 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 11:40:23.510251 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:23.510251 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:23.510251 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:40:23.510251 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:40:23.510251 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:40:23.510251 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:40:23.510251 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:40:23.510251 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:40:23.510251 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:40:23.510251 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:40:23.510251 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:40:23.510251 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:40:23.511684 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:40:23.511684 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:40:23.511684 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:40:23.511684 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:40:23.511684 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 11:40:23.511684 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 11:40:23.511684 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 11:40:23.511684 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 11:40:23.511684 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 11:40:23.511684 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 11:40:23.511684 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 11:40:23.511684 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:40:23.511684 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 249/498] 10.222.0.59 () {56 vars in 1102 bytes} [Tue Oct 4 11:40:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:40:23.511684 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c53d968-011b-4d77-ac8a-b521fc038b64 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:23.536718 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 250/499] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Oct 4 11:40:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 11:40:23.537563 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341abb20-89f9-4fcb-bd10-688f9a59a228 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:23.612399 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c53d968-011b-4d77-ac8a-b521fc038b64 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:23.637752 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341abb20-89f9-4fcb-bd10-688f9a59a228 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:23.645671 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3fc634-339d-44ac-b603-740d6495a224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:23.646276 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3fc634-339d-44ac-b603-740d6495a224 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:23.646560 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3fc634-339d-44ac-b603-740d6495a224 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:23.646833 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3fc634-339d-44ac-b603-740d6495a224 None admin] PATH_INFO: `/v3/domains` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:23.647470 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3fc634-339d-44ac-b603-740d6495a224 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:23.647775 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3fc634-339d-44ac-b603-740d6495a224 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:23.649183 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3fc634-339d-44ac-b603-740d6495a224 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:23.661130 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 250/500] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Oct 4 11:40:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:23.662449 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb67e353-0ad4-47dd-b9fd-3afab61f0a6b None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:23.662743 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb67e353-0ad4-47dd-b9fd-3afab61f0a6b None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:23.663020 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb67e353-0ad4-47dd-b9fd-3afab61f0a6b None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:23.664534 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 251/501] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:40:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:40:23.665681 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb67e353-0ad4-47dd-b9fd-3afab61f0a6b None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:23.676694 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cc7309-9322-45d2-b887-cc66cfd4b02c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:23.677326 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cc7309-9322-45d2-b887-cc66cfd4b02c None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:23.677605 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cc7309-9322-45d2-b887-cc66cfd4b02c None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:23.677880 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cc7309-9322-45d2-b887-cc66cfd4b02c None admin] PATH_INFO: `/v3/roles/service` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:23.687804 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cc7309-9322-45d2-b887-cc66cfd4b02c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 11:40:23.692866 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-c3cc7309-9322-45d2-b887-cc66cfd4b02c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 11:40:23.692866 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:23.692866 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:23.692866 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:23.692866 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:23.692866 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:23.692866 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:23.692866 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:23.692866 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:23.692866 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:23.692866 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:23.692866 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:23.692866 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 11:40:23.692866 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 11:40:23.692866 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 11:40:23.692866 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 11:40:23.693765 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 11:40:23.693765 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 11:40:23.693765 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 11:40:23.693765 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 11:40:23.693765 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:23.693765 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:23.693765 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:40:23.693765 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:40:23.693765 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:40:23.693765 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:40:23.693765 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:40:23.693765 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:40:23.693765 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:40:23.693765 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:40:23.693765 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:40:23.693765 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:40:23.694638 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:40:23.694638 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:40:23.694638 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:40:23.694638 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:40:23.694638 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 11:40:23.694638 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 11:40:23.694638 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 11:40:23.694638 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 11:40:23.694638 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 11:40:23.694638 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 11:40:23.694638 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 11:40:23.694638 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:40:23.694638 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 251/502] 10.222.0.59 () {56 vars in 1102 bytes} [Tue Oct 4 11:40:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:40:23.695308 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cc7309-9322-45d2-b887-cc66cfd4b02c None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:23.698479 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:23.713164 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:23.770663 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb67e353-0ad4-47dd-b9fd-3afab61f0a6b None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:23.794444 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cc7309-9322-45d2-b887-cc66cfd4b02c None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:23.806333 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e5c7a0-6aaf-4715-8ad6-b201dfa44a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:23.806924 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e5c7a0-6aaf-4715-8ad6-b201dfa44a66 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:23.807197 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e5c7a0-6aaf-4715-8ad6-b201dfa44a66 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:23.807466 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e5c7a0-6aaf-4715-8ad6-b201dfa44a66 None admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:23.808267 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e5c7a0-6aaf-4715-8ad6-b201dfa44a66 None admin] RBAC: Adding query filter params (name=service) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:23.808962 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e5c7a0-6aaf-4715-8ad6-b201dfa44a66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:23.810316 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e5c7a0-6aaf-4715-8ad6-b201dfa44a66 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:23.818170 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 252/503] 10.222.0.59 () {56 vars in 1103 bytes} [Tue Oct 4 11:40:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:23.818936 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e5c7a0-6aaf-4715-8ad6-b201dfa44a66 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:23.833725 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee63f392-f0e2-47e2-a0ec-48c446d0d453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:23.834348 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee63f392-f0e2-47e2-a0ec-48c446d0d453 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:23.834625 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee63f392-f0e2-47e2-a0ec-48c446d0d453 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:23.834896 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee63f392-f0e2-47e2-a0ec-48c446d0d453 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:23.845131 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee63f392-f0e2-47e2-a0ec-48c446d0d453 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:23.846580 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee63f392-f0e2-47e2-a0ec-48c446d0d453 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:23.861624 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-ee63f392-f0e2-47e2-a0ec-48c446d0d453 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:40:23.861624 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:23.861624 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:23.861624 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:23.861624 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:23.861624 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:23.861624 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:23.861624 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:23.861624 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:23.861624 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:23.861624 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:23.861624 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:23.861624 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 11:40:23.861624 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 11:40:23.861624 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 11:40:23.861624 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 11:40:23.862769 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:23.862769 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:23.862769 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:40:23.862769 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:40:23.862769 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:40:23.862769 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:40:23.862769 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:40:23.862769 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:40:23.862769 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:40:23.862769 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:40:23.862769 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:40:23.862769 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:40:23.862769 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:40:23.862769 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:40:23.862769 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:40:23.862769 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:40:23.862769 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 11:40:23.863658 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 11:40:23.863658 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:40:23.863658 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:40:23.863658 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 252/504] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Oct 4 11:40:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:40:23.864281 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8250b34-dc7d-4caf-b1fc-7f45c8607b4f None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:23.864281 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8250b34-dc7d-4caf-b1fc-7f45c8607b4f None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:23.864439 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8250b34-dc7d-4caf-b1fc-7f45c8607b4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:23.881994 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-e8250b34-dc7d-4caf-b1fc-7f45c8607b4f None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:40:23.883176 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-e8250b34-dc7d-4caf-b1fc-7f45c8607b4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:40:23.921810 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e5c7a0-6aaf-4715-8ad6-b201dfa44a66 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:23.923296 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:23.933516 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:23.949384 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 253/505] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:40:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 11:40:23.950196 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8250b34-dc7d-4caf-b1fc-7f45c8607b4f None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:23.954377 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7450f064-4331-46f4-94e6-402753591e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:23.955409 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7450f064-4331-46f4-94e6-402753591e70 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:23.956065 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7450f064-4331-46f4-94e6-402753591e70 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:23.957371 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7450f064-4331-46f4-94e6-402753591e70 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:23.965574 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7450f064-4331-46f4-94e6-402753591e70 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:23.967000 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7450f064-4331-46f4-94e6-402753591e70 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:23.979764 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-7450f064-4331-46f4-94e6-402753591e70 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 04 11:40:23.979764 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:23.979764 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:23.979764 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:23.979764 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:23.979764 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:23.979764 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:23.979764 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:23.979764 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:23.979764 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:23.979764 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:23.979764 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:23.979764 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 11:40:23.979764 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 11:40:23.979764 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 11:40:23.979764 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 11:40:23.980742 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:23.980742 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:23.980742 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 11:40:23.980742 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 11:40:23.980742 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 11:40:23.980742 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 11:40:23.980742 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:40:23.980742 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:40:23.980742 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:40:23.980742 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:40:23.980742 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:40:23.980742 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:40:23.980742 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:40:23.980742 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:40:23.980742 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:40:23.980742 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:40:23.980742 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:40:23.980742 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:40:23.981661 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:40:23.981661 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:40:23.981661 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 11:40:23.981661 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 11:40:23.981661 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 11:40:23.981661 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 11:40:23.981661 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 11:40:23.981661 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 11:40:23.981661 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 04 11:40:23.981661 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:40:23.981661 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 253/506] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Oct 4 11:40:23 2022] GET /identity/v3/users/cinder => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:40:23.981661 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7450f064-4331-46f4-94e6-402753591e70 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:24.057185 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8250b34-dc7d-4caf-b1fc-7f45c8607b4f None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:24.087495 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7450f064-4331-46f4-94e6-402753591e70 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:24.093825 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6283873c-bd2a-4ee4-8d57-e194336cfe04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:24.094550 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6283873c-bd2a-4ee4-8d57-e194336cfe04 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:24.094828 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6283873c-bd2a-4ee4-8d57-e194336cfe04 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:24.095102 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6283873c-bd2a-4ee4-8d57-e194336cfe04 None admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:24.095758 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6283873c-bd2a-4ee4-8d57-e194336cfe04 None admin] RBAC: Adding query filter params (name=service) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:24.096178 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6283873c-bd2a-4ee4-8d57-e194336cfe04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:24.097615 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6283873c-bd2a-4ee4-8d57-e194336cfe04 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:24.106556 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 254/507] 10.222.0.59 () {56 vars in 1103 bytes} [Tue Oct 4 11:40:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:24.111902 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6283873c-bd2a-4ee4-8d57-e194336cfe04 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:24.122871 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aedbd6-080d-4e7c-8c30-6bcfd0fb256c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:24.123784 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aedbd6-080d-4e7c-8c30-6bcfd0fb256c None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:24.124060 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aedbd6-080d-4e7c-8c30-6bcfd0fb256c None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:24.124346 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aedbd6-080d-4e7c-8c30-6bcfd0fb256c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:24.136806 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21aedbd6-080d-4e7c-8c30-6bcfd0fb256c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:24.138410 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21aedbd6-080d-4e7c-8c30-6bcfd0fb256c None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:24.152573 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-21aedbd6-080d-4e7c-8c30-6bcfd0fb256c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:40:24.152573 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:24.152573 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:24.152573 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:24.152573 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:24.152573 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:24.152573 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:24.152573 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:24.152573 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:24.152573 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:24.152573 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:24.152573 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:24.152573 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 11:40:24.152573 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 11:40:24.152573 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 11:40:24.152573 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 11:40:24.153631 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:24.153631 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:24.153631 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:40:24.153631 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:40:24.153631 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:40:24.153631 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:40:24.153631 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:40:24.153631 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:40:24.153631 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:40:24.153631 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:40:24.153631 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:40:24.153631 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:40:24.153631 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:40:24.153631 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:40:24.153631 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:40:24.153631 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:40:24.153631 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 11:40:24.154694 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 11:40:24.154694 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:40:24.154694 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:40:24.158318 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 254/508] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Oct 4 11:40:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:40:24.159066 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aedbd6-080d-4e7c-8c30-6bcfd0fb256c None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:24.164512 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:24.178603 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:24.219302 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6283873c-bd2a-4ee4-8d57-e194336cfe04 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:24.253998 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f443acd5-9c34-45be-95e7-4f4101a476df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:24.254603 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f443acd5-9c34-45be-95e7-4f4101a476df None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:24.254881 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f443acd5-9c34-45be-95e7-4f4101a476df None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:24.255153 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f443acd5-9c34-45be-95e7-4f4101a476df None admin] PATH_INFO: `/v3/domains` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:24.255779 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f443acd5-9c34-45be-95e7-4f4101a476df None admin] RBAC: Adding query filter params (name=Default) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:24.256076 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f443acd5-9c34-45be-95e7-4f4101a476df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:24.257511 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f443acd5-9c34-45be-95e7-4f4101a476df None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:24.265234 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aedbd6-080d-4e7c-8c30-6bcfd0fb256c None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:24.268905 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 255/509] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Oct 4 11:40:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:24.269695 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f443acd5-9c34-45be-95e7-4f4101a476df None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:24.299942 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517a39ff-230f-4d97-8b63-19e37abc3a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:24.301145 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517a39ff-230f-4d97-8b63-19e37abc3a99 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:24.301412 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517a39ff-230f-4d97-8b63-19e37abc3a99 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:24.301685 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517a39ff-230f-4d97-8b63-19e37abc3a99 None admin] PATH_INFO: `/v3/users` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:24.302402 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517a39ff-230f-4d97-8b63-19e37abc3a99 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:24.302711 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517a39ff-230f-4d97-8b63-19e37abc3a99 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:24.304135 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517a39ff-230f-4d97-8b63-19e37abc3a99 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:24.321302 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 255/510] 10.222.0.59 () {56 vars in 1137 bytes} [Tue Oct 4 11:40:24 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:24.322025 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517a39ff-230f-4d97-8b63-19e37abc3a99 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:24.370649 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f443acd5-9c34-45be-95e7-4f4101a476df None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:24.380648 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:24.391545 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:24.404700 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e8c61c-7cb2-4baf-8846-df448b5a45f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:24.405321 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e8c61c-7cb2-4baf-8846-df448b5a45f0 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:24.405599 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e8c61c-7cb2-4baf-8846-df448b5a45f0 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:24.405872 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e8c61c-7cb2-4baf-8846-df448b5a45f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:24.415549 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e8c61c-7cb2-4baf-8846-df448b5a45f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:24.417011 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e8c61c-7cb2-4baf-8846-df448b5a45f0 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:24.420208 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517a39ff-230f-4d97-8b63-19e37abc3a99 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:24.431685 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-35e8c61c-7cb2-4baf-8846-df448b5a45f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:40:24.431685 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:24.431685 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:24.431685 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:24.431685 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:24.431685 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:24.431685 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:24.431685 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:24.431685 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:24.431685 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:24.431685 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:24.431685 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:24.431685 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 11:40:24.431685 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 11:40:24.431685 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 11:40:24.431685 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 11:40:24.440159 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:24.440159 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:24.440159 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:40:24.440159 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:40:24.440159 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:40:24.440159 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:40:24.440159 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:40:24.440159 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:40:24.440159 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:40:24.440159 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:40:24.440159 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:40:24.440159 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:40:24.440159 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:40:24.440159 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:40:24.440159 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:40:24.440159 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:40:24.440159 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 11:40:24.441690 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 11:40:24.441690 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:40:24.441690 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:40:24.441690 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 256/511] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Oct 4 11:40:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:40:24.441690 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e8c61c-7cb2-4baf-8846-df448b5a45f0 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:24.455168 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414d377d-30ea-4fb3-a817-95ea1a1cd5e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:24.455771 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414d377d-30ea-4fb3-a817-95ea1a1cd5e8 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:24.456043 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414d377d-30ea-4fb3-a817-95ea1a1cd5e8 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:24.456439 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414d377d-30ea-4fb3-a817-95ea1a1cd5e8 None admin] PATH_INFO: `/v3/domains` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:24.457117 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414d377d-30ea-4fb3-a817-95ea1a1cd5e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:24.457412 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414d377d-30ea-4fb3-a817-95ea1a1cd5e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:24.458787 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414d377d-30ea-4fb3-a817-95ea1a1cd5e8 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:24.470357 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 256/512] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Oct 4 11:40:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:24.471436 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414d377d-30ea-4fb3-a817-95ea1a1cd5e8 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:24.542164 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e8c61c-7cb2-4baf-8846-df448b5a45f0 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:24.573651 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414d377d-30ea-4fb3-a817-95ea1a1cd5e8 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:24.575919 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcf5f4b-7baf-4067-8b6f-64527652354f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:24.576535 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcf5f4b-7baf-4067-8b6f-64527652354f None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:24.576838 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcf5f4b-7baf-4067-8b6f-64527652354f None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:24.577106 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcf5f4b-7baf-4067-8b6f-64527652354f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:24.587449 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcf5f4b-7baf-4067-8b6f-64527652354f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:24.588921 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcf5f4b-7baf-4067-8b6f-64527652354f None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:24.602013 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:24.603873 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-2dcf5f4b-7baf-4067-8b6f-64527652354f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:40:24.603873 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:24.603873 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:24.603873 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:24.603873 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:24.603873 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:24.603873 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:24.603873 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:24.603873 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:24.603873 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:24.603873 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:24.603873 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:24.603873 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 11:40:24.603873 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 11:40:24.603873 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 11:40:24.603873 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 11:40:24.604799 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:24.604799 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:24.604799 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:40:24.604799 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:40:24.604799 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:40:24.604799 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:40:24.604799 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:40:24.604799 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:40:24.604799 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:40:24.604799 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:40:24.604799 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:40:24.604799 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:40:24.604799 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:40:24.604799 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:40:24.604799 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:40:24.604799 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:40:24.604799 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 11:40:24.605672 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 11:40:24.605672 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:40:24.605672 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:40:24.605672 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 257/513] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Oct 4 11:40:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:40:24.606097 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcf5f4b-7baf-4067-8b6f-64527652354f None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:24.610205 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d7f52c-e864-4d84-bd00-2aa95fb06b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:24.610839 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d7f52c-e864-4d84-bd00-2aa95fb06b2b None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:24.611114 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d7f52c-e864-4d84-bd00-2aa95fb06b2b None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:24.616438 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d7f52c-e864-4d84-bd00-2aa95fb06b2b None admin] PATH_INFO: `/v3/projects/service` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:24.618756 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d7f52c-e864-4d84-bd00-2aa95fb06b2b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:24.620178 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d7f52c-e864-4d84-bd00-2aa95fb06b2b None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:24.623477 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:24.632146 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-19d7f52c-e864-4d84-bd00-2aa95fb06b2b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 11:40:24.632146 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:24.632146 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:24.632146 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:24.632146 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:24.632146 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:24.632146 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:24.632146 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:24.632146 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:24.632146 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:24.632146 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:24.632146 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:24.632146 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 11:40:24.632146 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 11:40:24.632146 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 11:40:24.633015 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 11:40:24.633015 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:24.633015 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:24.633015 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:40:24.633015 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:40:24.633015 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:40:24.633015 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:40:24.633015 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:40:24.633015 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:40:24.633015 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:40:24.633015 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:40:24.633015 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:40:24.633015 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:40:24.633015 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:40:24.633015 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:40:24.633015 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:40:24.633015 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:40:24.633924 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 11:40:24.633924 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 11:40:24.633924 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 11:40:24.633924 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 11:40:24.633924 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 11:40:24.633924 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 11:40:24.633924 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 11:40:24.633924 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:40:24.633924 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 257/514] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Oct 4 11:40:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:40:24.634403 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d7f52c-e864-4d84-bd00-2aa95fb06b2b None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:24.710389 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcf5f4b-7baf-4067-8b6f-64527652354f None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:24.734290 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d7f52c-e864-4d84-bd00-2aa95fb06b2b None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:24.744575 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26337ac-a06e-4c68-bb26-e3478eb18c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:24.745192 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26337ac-a06e-4c68-bb26-e3478eb18c3b None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:24.745464 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26337ac-a06e-4c68-bb26-e3478eb18c3b None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:24.745731 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26337ac-a06e-4c68-bb26-e3478eb18c3b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:24.767472 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb1bcdb-c74e-4666-bf48-fb44ee1a8fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:24.768062 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb1bcdb-c74e-4666-bf48-fb44ee1a8fa7 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:24.768338 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb1bcdb-c74e-4666-bf48-fb44ee1a8fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:24.768621 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb1bcdb-c74e-4666-bf48-fb44ee1a8fa7 None admin] PATH_INFO: `/v3/domains` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:24.770017 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb1bcdb-c74e-4666-bf48-fb44ee1a8fa7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:24.770313 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb1bcdb-c74e-4666-bf48-fb44ee1a8fa7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:24.771673 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb1bcdb-c74e-4666-bf48-fb44ee1a8fa7 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:24.782807 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 258/515] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Oct 4 11:40:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:24.783604 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb1bcdb-c74e-4666-bf48-fb44ee1a8fa7 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:24.811786 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26337ac-a06e-4c68-bb26-e3478eb18c3b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:24.813274 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26337ac-a06e-4c68-bb26-e3478eb18c3b None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:24.826358 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:24.836240 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:24.882443 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb1bcdb-c74e-4666-bf48-fb44ee1a8fa7 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:24.912813 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 258/516] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Oct 4 11:40:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 11:40:24.913644 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26337ac-a06e-4c68-bb26-e3478eb18c3b None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:24.915953 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579129b2-8872-4a20-ad8d-f72af6b70604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:24.916582 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579129b2-8872-4a20-ad8d-f72af6b70604 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:24.916948 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579129b2-8872-4a20-ad8d-f72af6b70604 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:24.920577 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579129b2-8872-4a20-ad8d-f72af6b70604 None admin] PATH_INFO: `/v3/users/glance` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:24.924381 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579129b2-8872-4a20-ad8d-f72af6b70604 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:24.926488 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579129b2-8872-4a20-ad8d-f72af6b70604 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:24.937823 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-579129b2-8872-4a20-ad8d-f72af6b70604 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 04 11:40:24.937823 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:24.937823 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:24.937823 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:24.937823 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:24.937823 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:24.937823 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:24.937823 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:24.937823 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:24.937823 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:24.937823 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:24.937823 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:24.937823 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 11:40:24.937823 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 11:40:24.937823 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 11:40:24.937823 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 11:40:24.938907 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:24.938907 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:24.938907 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 11:40:24.938907 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 11:40:24.938907 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 11:40:24.938907 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 11:40:24.938907 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:40:24.938907 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:40:24.938907 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:40:24.938907 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:40:24.938907 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:40:24.938907 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:40:24.938907 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:40:24.938907 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:40:24.938907 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:40:24.938907 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:40:24.938907 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:40:24.938907 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:40:24.939841 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:40:24.939841 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:40:24.939841 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 11:40:24.939841 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 11:40:24.939841 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 11:40:24.939841 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 11:40:24.939841 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 11:40:24.939841 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 11:40:24.939841 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 04 11:40:24.939841 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:40:24.939841 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 259/517] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Oct 4 11:40:24 2022] GET /identity/v3/users/glance => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:40:24.939841 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579129b2-8872-4a20-ad8d-f72af6b70604 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:25.016860 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26337ac-a06e-4c68-bb26-e3478eb18c3b None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:25.030509 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:25.046647 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579129b2-8872-4a20-ad8d-f72af6b70604 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:25.050747 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e34f733-2706-4f90-bc21-4467952713a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:25.051507 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e34f733-2706-4f90-bc21-4467952713a0 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:25.052100 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e34f733-2706-4f90-bc21-4467952713a0 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:25.052374 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e34f733-2706-4f90-bc21-4467952713a0 None admin] PATH_INFO: `/v3/domains` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:25.053044 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e34f733-2706-4f90-bc21-4467952713a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:25.053349 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e34f733-2706-4f90-bc21-4467952713a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:25.054720 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e34f733-2706-4f90-bc21-4467952713a0 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:25.059328 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:25.066384 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 259/518] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Oct 4 11:40:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:25.067148 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e34f733-2706-4f90-bc21-4467952713a0 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:25.080143 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b0d38e-1c38-4fcd-b0c8-d70cc8f06842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:25.080775 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b0d38e-1c38-4fcd-b0c8-d70cc8f06842 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:25.081056 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b0d38e-1c38-4fcd-b0c8-d70cc8f06842 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:25.081920 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b0d38e-1c38-4fcd-b0c8-d70cc8f06842 None admin] PATH_INFO: `/v3/projects` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:25.082874 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b0d38e-1c38-4fcd-b0c8-d70cc8f06842 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:25.083174 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b0d38e-1c38-4fcd-b0c8-d70cc8f06842 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:25.084670 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b0d38e-1c38-4fcd-b0c8-d70cc8f06842 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:25.103080 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 260/519] 10.222.0.59 () {56 vars in 1148 bytes} [Tue Oct 4 11:40:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:25.104047 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b0d38e-1c38-4fcd-b0c8-d70cc8f06842 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:25.168423 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e34f733-2706-4f90-bc21-4467952713a0 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:25.201971 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75905ece-9b27-4bce-9ea6-743c7bae899e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:25.202588 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75905ece-9b27-4bce-9ea6-743c7bae899e None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:25.202866 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75905ece-9b27-4bce-9ea6-743c7bae899e None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:25.203136 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75905ece-9b27-4bce-9ea6-743c7bae899e None admin] PATH_INFO: `/v3/users/neutron` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:25.211553 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75905ece-9b27-4bce-9ea6-743c7bae899e None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:25.212019 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b0d38e-1c38-4fcd-b0c8-d70cc8f06842 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:25.213135 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75905ece-9b27-4bce-9ea6-743c7bae899e None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:25.226083 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-75905ece-9b27-4bce-9ea6-743c7bae899e None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 04 11:40:25.226083 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:25.226083 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:25.226083 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:25.226083 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:25.226083 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:25.226083 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:25.226083 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:25.226083 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:25.226083 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:25.226083 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:25.226083 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:25.226083 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 11:40:25.226083 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 11:40:25.226083 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 11:40:25.226083 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 11:40:25.227242 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:25.227242 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:25.227242 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 11:40:25.227242 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 11:40:25.227242 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 11:40:25.227242 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 11:40:25.227242 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:40:25.227242 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:40:25.227242 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:40:25.227242 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:40:25.227242 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:40:25.227242 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:40:25.227242 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:40:25.227242 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:40:25.227242 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:40:25.227242 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:40:25.227242 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:40:25.227242 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:40:25.228141 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:40:25.228141 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:40:25.228141 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 11:40:25.228141 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 11:40:25.228141 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 11:40:25.228141 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 11:40:25.228141 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 11:40:25.228141 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 11:40:25.228141 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 04 11:40:25.228141 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:40:25.228141 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 260/520] 10.222.0.59 () {56 vars in 1102 bytes} [Tue Oct 4 11:40:25 2022] GET /identity/v3/users/neutron => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:40:25.228141 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75905ece-9b27-4bce-9ea6-743c7bae899e None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:25.246379 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d09e68-cc50-4855-ac7a-d4d7f245144c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:25.247009 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d09e68-cc50-4855-ac7a-d4d7f245144c None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:25.247289 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d09e68-cc50-4855-ac7a-d4d7f245144c None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:25.247559 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d09e68-cc50-4855-ac7a-d4d7f245144c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:25.257909 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d09e68-cc50-4855-ac7a-d4d7f245144c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:25.259350 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d09e68-cc50-4855-ac7a-d4d7f245144c None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:25.260850 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:25.274826 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-38d09e68-cc50-4855-ac7a-d4d7f245144c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:40:25.274826 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:25.274826 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:25.274826 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:25.274826 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:25.274826 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:25.274826 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:25.274826 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:25.274826 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:25.274826 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:25.274826 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:25.274826 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:25.274826 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 11:40:25.274826 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 11:40:25.274826 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 11:40:25.274826 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 11:40:25.277829 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:25.277829 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:25.277829 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:40:25.277829 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:40:25.277829 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:40:25.277829 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:40:25.277829 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:40:25.277829 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:40:25.277829 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:40:25.277829 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:40:25.277829 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:40:25.277829 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:40:25.277829 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:40:25.277829 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:40:25.277829 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:40:25.277829 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:40:25.277829 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 11:40:25.278684 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 11:40:25.278684 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:40:25.278684 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:40:25.278684 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 261/521] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Oct 4 11:40:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:40:25.278684 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d09e68-cc50-4855-ac7a-d4d7f245144c None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:25.303215 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:25.331929 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75905ece-9b27-4bce-9ea6-743c7bae899e None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:25.365727 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17738372-0c4a-4684-ab3e-d577d5298038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:25.366405 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17738372-0c4a-4684-ab3e-d577d5298038 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:25.366751 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17738372-0c4a-4684-ab3e-d577d5298038 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:25.367088 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17738372-0c4a-4684-ab3e-d577d5298038 None admin] PATH_INFO: `/v3/users` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:25.367868 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17738372-0c4a-4684-ab3e-d577d5298038 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:25.368236 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17738372-0c4a-4684-ab3e-d577d5298038 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:25.369781 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17738372-0c4a-4684-ab3e-d577d5298038 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:25.377913 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d09e68-cc50-4855-ac7a-d4d7f245144c None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:25.406556 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 261/522] 10.222.0.59 () {56 vars in 1137 bytes} [Tue Oct 4 11:40:25 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:25.407380 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17738372-0c4a-4684-ab3e-d577d5298038 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:25.412562 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f00762a-29b7-4a03-b8cd-9cd38d7d4422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:25.413200 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f00762a-29b7-4a03-b8cd-9cd38d7d4422 None admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:25.413482 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f00762a-29b7-4a03-b8cd-9cd38d7d4422 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:25.413755 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f00762a-29b7-4a03-b8cd-9cd38d7d4422 None admin] PATH_INFO: `/v3/users` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:25.414405 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f00762a-29b7-4a03-b8cd-9cd38d7d4422 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:25.415842 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f00762a-29b7-4a03-b8cd-9cd38d7d4422 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:25.496156 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:25.506084 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17738372-0c4a-4684-ab3e-d577d5298038 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:25.519548 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 262/523] 10.222.0.59 () {60 vars in 1132 bytes} [Tue Oct 4 11:40:25 2022] POST /identity/v3/users => generated 247 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 11:40:25.523013 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f00762a-29b7-4a03-b8cd-9cd38d7d4422 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:25.552259 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfea4ee0-792d-43f9-beb9-a9c7334c43fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:25.552924 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfea4ee0-792d-43f9-beb9-a9c7334c43fc None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:25.553207 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfea4ee0-792d-43f9-beb9-a9c7334c43fc None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:25.553483 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfea4ee0-792d-43f9-beb9-a9c7334c43fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:25.554224 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfea4ee0-792d-43f9-beb9-a9c7334c43fc None admin] RBAC: Adding query filter params (role.id=01769bbdbd2e48f2bf8e855ba6a8507e, scope.project.id=39913dbe3e984f27a61493dd75381501, user.id=a8e23d1d2fe24bdf9552e7c2f0ae3424) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:25.554535 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfea4ee0-792d-43f9-beb9-a9c7334c43fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:25.556033 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfea4ee0-792d-43f9-beb9-a9c7334c43fc None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:25.562805 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 262/524] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Oct 4 11:40:25 2022] GET /identity/v3/role_assignments?user.id=a8e23d1d2fe24bdf9552e7c2f0ae3424&scope.project.id=39913dbe3e984f27a61493dd75381501&role.id=01769bbdbd2e48f2bf8e855ba6a8507e => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:25.563658 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfea4ee0-792d-43f9-beb9-a9c7334c43fc None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:25.630172 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:25.655201 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f00762a-29b7-4a03-b8cd-9cd38d7d4422 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:25.699041 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b08b94e-200a-4fe8-839f-b7ca0303f812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:25.699933 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b08b94e-200a-4fe8-839f-b7ca0303f812 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:25.700441 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b08b94e-200a-4fe8-839f-b7ca0303f812 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:25.700888 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b08b94e-200a-4fe8-839f-b7ca0303f812 None admin] PATH_INFO: `/v3/users` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:25.701975 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b08b94e-200a-4fe8-839f-b7ca0303f812 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:25.702268 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b08b94e-200a-4fe8-839f-b7ca0303f812 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:25.703744 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b08b94e-200a-4fe8-839f-b7ca0303f812 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:25.734055 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 263/525] 10.222.0.59 () {56 vars in 1139 bytes} [Tue Oct 4 11:40:25 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:25.736237 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b08b94e-200a-4fe8-839f-b7ca0303f812 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:25.742020 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfea4ee0-792d-43f9-beb9-a9c7334c43fc None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:25.820727 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b17667-f08c-4cad-9a13-434f49a46a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:25.820727 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b17667-f08c-4cad-9a13-434f49a46a00 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:25.820727 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b17667-f08c-4cad-9a13-434f49a46a00 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:25.820727 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b17667-f08c-4cad-9a13-434f49a46a00 None admin] PATH_INFO: `/v3/domains` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:25.821335 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b17667-f08c-4cad-9a13-434f49a46a00 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:25.821335 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b17667-f08c-4cad-9a13-434f49a46a00 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:25.821335 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b17667-f08c-4cad-9a13-434f49a46a00 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:25.838943 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 263/526] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Oct 4 11:40:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:25.839800 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b17667-f08c-4cad-9a13-434f49a46a00 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:25.857894 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:25.879362 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b08b94e-200a-4fe8-839f-b7ca0303f812 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:25.915054 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ea9626-88d0-4610-9c98-73e1f1eb111f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:25.915667 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ea9626-88d0-4610-9c98-73e1f1eb111f None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:25.915949 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ea9626-88d0-4610-9c98-73e1f1eb111f None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:25.916223 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ea9626-88d0-4610-9c98-73e1f1eb111f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:25.924672 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:25.955134 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b17667-f08c-4cad-9a13-434f49a46a00 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:25.989118 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ea9626-88d0-4610-9c98-73e1f1eb111f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:25.990583 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ea9626-88d0-4610-9c98-73e1f1eb111f None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:25.994273 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea367fe-a814-45e4-a3f2-d3908da24342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:25.994875 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea367fe-a814-45e4-a3f2-d3908da24342 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:25.995152 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea367fe-a814-45e4-a3f2-d3908da24342 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:25.995418 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea367fe-a814-45e4-a3f2-d3908da24342 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:26.070317 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea367fe-a814-45e4-a3f2-d3908da24342 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:26.072042 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea367fe-a814-45e4-a3f2-d3908da24342 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:26.088237 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:26.095620 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 264/527] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Oct 4 11:40:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 11:40:26.102949 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ea9626-88d0-4610-9c98-73e1f1eb111f None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:26.145578 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:26.202652 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 264/528] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Oct 4 11:40:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 11:40:26.203502 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea367fe-a814-45e4-a3f2-d3908da24342 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:26.220731 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ea9626-88d0-4610-9c98-73e1f1eb111f None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:26.263035 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d56056-721b-4395-8ba0-fd8f47922a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:26.263956 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d56056-721b-4395-8ba0-fd8f47922a9c None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:26.264238 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d56056-721b-4395-8ba0-fd8f47922a9c None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:26.264514 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d56056-721b-4395-8ba0-fd8f47922a9c None admin] PATH_INFO: `/v3/projects/service` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:26.273582 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d56056-721b-4395-8ba0-fd8f47922a9c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:26.275052 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d56056-721b-4395-8ba0-fd8f47922a9c None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:26.289391 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-60d56056-721b-4395-8ba0-fd8f47922a9c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 11:40:26.289391 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:26.289391 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:26.289391 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:26.289391 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:26.289391 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:26.289391 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:26.289391 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:26.289391 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:26.289391 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:26.289391 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:26.289391 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:26.289391 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 11:40:26.289391 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 11:40:26.289391 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 11:40:26.290300 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 11:40:26.290300 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:26.290300 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:26.290300 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:40:26.290300 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:40:26.290300 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:40:26.290300 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:40:26.290300 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:40:26.290300 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:40:26.290300 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:40:26.290300 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:40:26.290300 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:40:26.290300 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:40:26.290300 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:40:26.290300 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:40:26.290300 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:40:26.290300 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:40:26.291155 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 11:40:26.291155 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 11:40:26.291155 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 11:40:26.291155 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 11:40:26.291155 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 11:40:26.291155 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 11:40:26.291155 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 11:40:26.291155 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:40:26.291155 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 265/529] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Oct 4 11:40:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:40:26.292112 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d56056-721b-4395-8ba0-fd8f47922a9c None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:26.313743 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea367fe-a814-45e4-a3f2-d3908da24342 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:26.329473 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:26.355811 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1048412-bfcf-4ca9-baf7-558307c7576e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:26.357190 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1048412-bfcf-4ca9-baf7-558307c7576e None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:26.357629 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1048412-bfcf-4ca9-baf7-558307c7576e None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:26.358047 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1048412-bfcf-4ca9-baf7-558307c7576e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:26.373110 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1048412-bfcf-4ca9-baf7-558307c7576e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:26.375120 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1048412-bfcf-4ca9-baf7-558307c7576e None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:26.397343 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-d1048412-bfcf-4ca9-baf7-558307c7576e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:40:26.397343 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:26.397343 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:26.397343 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:26.397343 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:26.397343 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:26.397343 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:26.397343 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:26.397343 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:26.397343 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:26.397343 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:26.397343 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:26.397343 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 11:40:26.397343 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 11:40:26.397343 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 11:40:26.397343 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 11:40:26.398536 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:26.398536 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:26.398536 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:40:26.398536 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:40:26.398536 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:40:26.398536 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:40:26.398536 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:40:26.398536 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:40:26.398536 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:40:26.398536 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:40:26.398536 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:40:26.398536 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:40:26.398536 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:40:26.398536 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:40:26.398536 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:40:26.398536 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:40:26.398536 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 11:40:26.399609 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 11:40:26.399609 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:40:26.399609 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:40:26.401749 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 265/530] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Oct 4 11:40:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:40:26.403032 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1048412-bfcf-4ca9-baf7-558307c7576e None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:26.408839 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:26.414220 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d56056-721b-4395-8ba0-fd8f47922a9c None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:26.456882 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0520d844-fb78-41d5-abfe-c45651ceee2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:26.457606 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0520d844-fb78-41d5-abfe-c45651ceee2d None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:26.457989 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0520d844-fb78-41d5-abfe-c45651ceee2d None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:26.458388 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0520d844-fb78-41d5-abfe-c45651ceee2d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:26.470933 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0520d844-fb78-41d5-abfe-c45651ceee2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:26.473231 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0520d844-fb78-41d5-abfe-c45651ceee2d None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:26.490073 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-0520d844-fb78-41d5-abfe-c45651ceee2d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:40:26.490073 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:26.490073 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:26.490073 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:26.490073 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:26.490073 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:26.490073 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:26.490073 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:26.490073 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:26.490073 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:26.490073 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:26.490073 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:26.490073 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 11:40:26.490073 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 11:40:26.490073 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 11:40:26.490073 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 11:40:26.491224 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:26.491224 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:26.491224 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:40:26.491224 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:40:26.491224 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:40:26.491224 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:40:26.491224 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:40:26.491224 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:40:26.491224 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:40:26.491224 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:40:26.491224 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:40:26.491224 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:40:26.491224 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:40:26.491224 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:40:26.491224 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:40:26.491224 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:40:26.491224 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 11:40:26.492136 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 11:40:26.492136 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:40:26.492136 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:40:26.492794 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 266/531] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Oct 4 11:40:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:40:26.493740 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0520d844-fb78-41d5-abfe-c45651ceee2d None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:26.552760 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1048412-bfcf-4ca9-baf7-558307c7576e None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:26.591241 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d18b40a-fae2-4fd4-9364-13f9bea2e0a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:26.591817 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d18b40a-fae2-4fd4-9364-13f9bea2e0a4 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:26.592096 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d18b40a-fae2-4fd4-9364-13f9bea2e0a4 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:26.592364 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d18b40a-fae2-4fd4-9364-13f9bea2e0a4 None admin] PATH_INFO: `/v3/projects` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:26.593084 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d18b40a-fae2-4fd4-9364-13f9bea2e0a4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:26.593363 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d18b40a-fae2-4fd4-9364-13f9bea2e0a4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:26.594913 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d18b40a-fae2-4fd4-9364-13f9bea2e0a4 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:26.613180 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 266/532] 10.222.0.59 () {56 vars in 1148 bytes} [Tue Oct 4 11:40:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:26.613943 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d18b40a-fae2-4fd4-9364-13f9bea2e0a4 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:26.636514 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0520d844-fb78-41d5-abfe-c45651ceee2d None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:26.642157 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:26.680197 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4c84fd-deb8-4f04-a142-e8484d8dee67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:26.681319 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4c84fd-deb8-4f04-a142-e8484d8dee67 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:26.681800 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4c84fd-deb8-4f04-a142-e8484d8dee67 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:26.682318 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4c84fd-deb8-4f04-a142-e8484d8dee67 None admin] PATH_INFO: `/v3/domains` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:26.683148 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4c84fd-deb8-4f04-a142-e8484d8dee67 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:26.683663 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4c84fd-deb8-4f04-a142-e8484d8dee67 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:26.686333 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4c84fd-deb8-4f04-a142-e8484d8dee67 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:26.702492 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 267/533] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Oct 4 11:40:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:26.703649 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4c84fd-deb8-4f04-a142-e8484d8dee67 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:26.718033 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d18b40a-fae2-4fd4-9364-13f9bea2e0a4 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:26.719319 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:26.755544 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9333c8ec-bf69-4df4-b921-bf7a01e18086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:26.756147 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9333c8ec-bf69-4df4-b921-bf7a01e18086 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:26.756474 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9333c8ec-bf69-4df4-b921-bf7a01e18086 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:26.756790 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9333c8ec-bf69-4df4-b921-bf7a01e18086 None admin] PATH_INFO: `/v3/domains` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:26.757425 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9333c8ec-bf69-4df4-b921-bf7a01e18086 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:26.757724 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9333c8ec-bf69-4df4-b921-bf7a01e18086 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:26.759506 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9333c8ec-bf69-4df4-b921-bf7a01e18086 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:26.772172 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 267/534] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Oct 4 11:40:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:26.772875 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9333c8ec-bf69-4df4-b921-bf7a01e18086 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:26.833745 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4c84fd-deb8-4f04-a142-e8484d8dee67 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:26.871309 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:26.874460 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a7ca2c-72be-4a4e-bc48-8668c9f36b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:26.875078 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a7ca2c-72be-4a4e-bc48-8668c9f36b05 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:26.875358 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a7ca2c-72be-4a4e-bc48-8668c9f36b05 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:26.875632 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a7ca2c-72be-4a4e-bc48-8668c9f36b05 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:26.876860 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a7ca2c-72be-4a4e-bc48-8668c9f36b05 None admin] RBAC: Adding query filter params (role.id=01769bbdbd2e48f2bf8e855ba6a8507e, scope.project.id=39913dbe3e984f27a61493dd75381501, user.id=6e2a05b782424ab2928b5864f1bfd556) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:26.877172 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a7ca2c-72be-4a4e-bc48-8668c9f36b05 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:26.880047 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a7ca2c-72be-4a4e-bc48-8668c9f36b05 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:26.892632 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 268/535] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Oct 4 11:40:26 2022] GET /identity/v3/role_assignments?user.id=6e2a05b782424ab2928b5864f1bfd556&scope.project.id=39913dbe3e984f27a61493dd75381501&role.id=01769bbdbd2e48f2bf8e855ba6a8507e => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:26.892632 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a7ca2c-72be-4a4e-bc48-8668c9f36b05 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:26.897303 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9333c8ec-bf69-4df4-b921-bf7a01e18086 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:26.998087 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:27.000427 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74ae159-8110-4cb7-be1b-d743a625a1ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:27.001239 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74ae159-8110-4cb7-be1b-d743a625a1ab None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:27.001392 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74ae159-8110-4cb7-be1b-d743a625a1ab None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:27.001696 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74ae159-8110-4cb7-be1b-d743a625a1ab None admin] PATH_INFO: `/v3/projects/service` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:27.033878 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74ae159-8110-4cb7-be1b-d743a625a1ab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:27.033878 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74ae159-8110-4cb7-be1b-d743a625a1ab None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:27.050801 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-c74ae159-8110-4cb7-be1b-d743a625a1ab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 11:40:27.050801 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:27.050801 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:27.050801 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:27.050801 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:27.050801 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:27.050801 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:27.050801 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:27.050801 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:27.050801 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:27.050801 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:27.050801 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:27.050801 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 11:40:27.050801 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 11:40:27.050801 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 11:40:27.051772 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 11:40:27.051772 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:27.051772 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:27.051772 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:40:27.051772 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:40:27.051772 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:40:27.051772 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:40:27.051772 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:40:27.051772 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:40:27.051772 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:40:27.051772 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:40:27.051772 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:40:27.051772 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:40:27.051772 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:40:27.051772 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:40:27.051772 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:40:27.051772 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:40:27.052868 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 11:40:27.052868 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 11:40:27.052868 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 11:40:27.052868 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 11:40:27.052868 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 11:40:27.052868 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 11:40:27.052868 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 11:40:27.052868 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:40:27.052868 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 268/536] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Oct 4 11:40:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:40:27.058952 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74ae159-8110-4cb7-be1b-d743a625a1ab None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:27.061075 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a7ca2c-72be-4a4e-bc48-8668c9f36b05 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:27.157748 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5224394e-136f-440b-a803-e3a253b14e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:27.157748 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5224394e-136f-440b-a803-e3a253b14e81 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:27.157748 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5224394e-136f-440b-a803-e3a253b14e81 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:27.157748 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5224394e-136f-440b-a803-e3a253b14e81 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:27.171333 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5224394e-136f-440b-a803-e3a253b14e81 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:27.176196 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5224394e-136f-440b-a803-e3a253b14e81 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:27.201053 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-5224394e-136f-440b-a803-e3a253b14e81 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 11:40:27.201053 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:27.201053 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:27.201053 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:27.201053 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:27.201053 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:27.201053 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:27.201053 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:27.201053 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:27.201053 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:27.201053 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:27.201053 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:27.201053 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 11:40:27.201053 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 11:40:27.201053 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 11:40:27.201971 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 11:40:27.201971 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:27.201971 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:27.201971 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:40:27.201971 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:40:27.201971 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:40:27.201971 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:40:27.201971 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:40:27.201971 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:40:27.201971 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:40:27.201971 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:40:27.201971 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:40:27.201971 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:40:27.201971 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:40:27.201971 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:40:27.201971 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:40:27.201971 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:40:27.202819 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 11:40:27.202819 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 11:40:27.202819 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 11:40:27.202819 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 11:40:27.202819 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 11:40:27.202819 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 11:40:27.202819 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 11:40:27.202819 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:40:27.202819 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 269/537] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Oct 4 11:40:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:40:27.209707 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5224394e-136f-440b-a803-e3a253b14e81 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:27.272847 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74ae159-8110-4cb7-be1b-d743a625a1ab None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:27.373927 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1526227-3bbe-40f2-aa6b-7c25f304515d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:27.374547 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1526227-3bbe-40f2-aa6b-7c25f304515d None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:27.374825 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1526227-3bbe-40f2-aa6b-7c25f304515d None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:27.375096 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1526227-3bbe-40f2-aa6b-7c25f304515d None admin] PATH_INFO: `/v3/projects` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:27.375786 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1526227-3bbe-40f2-aa6b-7c25f304515d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:27.376089 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1526227-3bbe-40f2-aa6b-7c25f304515d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:27.377576 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1526227-3bbe-40f2-aa6b-7c25f304515d None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:27.407197 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 269/538] 10.222.0.59 () {56 vars in 1148 bytes} [Tue Oct 4 11:40:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:27.416094 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1526227-3bbe-40f2-aa6b-7c25f304515d None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:27.440691 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5224394e-136f-440b-a803-e3a253b14e81 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:27.441013 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:27.584357 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b668cc91-e6a1-4237-a6b1-8e8b388f78cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:27.585011 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b668cc91-e6a1-4237-a6b1-8e8b388f78cd None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:27.588627 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b668cc91-e6a1-4237-a6b1-8e8b388f78cd None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:27.588627 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b668cc91-e6a1-4237-a6b1-8e8b388f78cd None admin] PATH_INFO: `/v3/projects` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:27.588627 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b668cc91-e6a1-4237-a6b1-8e8b388f78cd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:27.588627 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b668cc91-e6a1-4237-a6b1-8e8b388f78cd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:27.588627 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b668cc91-e6a1-4237-a6b1-8e8b388f78cd None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:27.596492 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:27.619049 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 270/539] 10.222.0.59 () {56 vars in 1148 bytes} [Tue Oct 4 11:40:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 409 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:27.624917 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b668cc91-e6a1-4237-a6b1-8e8b388f78cd None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:27.705498 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1526227-3bbe-40f2-aa6b-7c25f304515d None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:27.767539 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e9429c-2f29-4c68-be53-dcf06290d65e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:27.768147 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e9429c-2f29-4c68-be53-dcf06290d65e None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:27.768421 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e9429c-2f29-4c68-be53-dcf06290d65e None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:27.769256 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e9429c-2f29-4c68-be53-dcf06290d65e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:27.769982 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e9429c-2f29-4c68-be53-dcf06290d65e None admin] RBAC: Adding query filter params (role.id=01769bbdbd2e48f2bf8e855ba6a8507e, scope.project.id=39913dbe3e984f27a61493dd75381501, user.id=d516d0755be84b7293156625df1b13b3) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:27.770284 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e9429c-2f29-4c68-be53-dcf06290d65e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:27.771727 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e9429c-2f29-4c68-be53-dcf06290d65e None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:27.788746 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 270/540] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Oct 4 11:40:27 2022] GET /identity/v3/role_assignments?user.id=d516d0755be84b7293156625df1b13b3&scope.project.id=39913dbe3e984f27a61493dd75381501&role.id=01769bbdbd2e48f2bf8e855ba6a8507e => generated 259 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:27.799999 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b668cc91-e6a1-4237-a6b1-8e8b388f78cd None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:27.852344 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7153b9fc-11ca-44a7-a20d-43bdc65e121f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:27.853041 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7153b9fc-11ca-44a7-a20d-43bdc65e121f None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:27.853323 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7153b9fc-11ca-44a7-a20d-43bdc65e121f None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:27.853596 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7153b9fc-11ca-44a7-a20d-43bdc65e121f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:27.854378 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7153b9fc-11ca-44a7-a20d-43bdc65e121f None admin] RBAC: Adding query filter params (role.id=01769bbdbd2e48f2bf8e855ba6a8507e, scope.project.id=39913dbe3e984f27a61493dd75381501, user.id=e7289515c5c44914a19daa439de98cb1) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:27.854686 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7153b9fc-11ca-44a7-a20d-43bdc65e121f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:27.856253 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7153b9fc-11ca-44a7-a20d-43bdc65e121f None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:27.863616 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 271/541] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Oct 4 11:40:27 2022] GET /identity/v3/role_assignments?user.id=e7289515c5c44914a19daa439de98cb1&scope.project.id=39913dbe3e984f27a61493dd75381501&role.id=01769bbdbd2e48f2bf8e855ba6a8507e => generated 259 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:27.971255 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f701c2fd-336e-42a5-9f53-214961fc3f62 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:27.971620 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f701c2fd-336e-42a5-9f53-214961fc3f62 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:27.972516 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f701c2fd-336e-42a5-9f53-214961fc3f62 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:27.974133 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 271/542] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:40:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:40:27.980412 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0d4958-0795-40f6-b2fc-a0b6d87b036a None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:27.980718 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0d4958-0795-40f6-b2fc-a0b6d87b036a None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:27.980998 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0d4958-0795-40f6-b2fc-a0b6d87b036a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:28.005792 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-7b0d4958-0795-40f6-b2fc-a0b6d87b036a None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:40:28.007040 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-7b0d4958-0795-40f6-b2fc-a0b6d87b036a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:40:28.055073 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27dda2f-a9f3-4746-a2fd-37ae96168bef None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:28.055390 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27dda2f-a9f3-4746-a2fd-37ae96168bef None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:28.055617 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27dda2f-a9f3-4746-a2fd-37ae96168bef None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:28.057226 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 272/543] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:40:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 11:40:28.067601 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d441378-0440-43d9-8967-74868038689b None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:28.067888 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d441378-0440-43d9-8967-74868038689b None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:28.068160 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d441378-0440-43d9-8967-74868038689b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:28.089076 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:28.093684 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-4d441378-0440-43d9-8967-74868038689b None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:40:28.094955 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-4d441378-0440-43d9-8967-74868038689b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:40:28.102170 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 272/544] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:40:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 11:40:28.173642 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:28.179211 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 273/545] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:40:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 11:40:28.557006 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0d4958-0795-40f6-b2fc-a0b6d87b036a None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:28.561707 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d441378-0440-43d9-8967-74868038689b None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:28.664452 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d441378-0440-43d9-8967-74868038689b None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:28.720349 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0d4958-0795-40f6-b2fc-a0b6d87b036a None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:28.724059 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479dcba4-e510-475e-87d6-1dab63bb66f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:28.724999 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479dcba4-e510-475e-87d6-1dab63bb66f8 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:28.725269 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479dcba4-e510-475e-87d6-1dab63bb66f8 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:28.725540 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479dcba4-e510-475e-87d6-1dab63bb66f8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:28.743115 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479dcba4-e510-475e-87d6-1dab63bb66f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 11:40:28.756330 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-479dcba4-e510-475e-87d6-1dab63bb66f8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 11:40:28.756330 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:28.756330 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:28.756330 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:28.756330 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:28.756330 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:28.756330 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:28.756330 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:28.756330 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:28.756330 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:28.756330 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:28.756330 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:28.756330 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 11:40:28.756330 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 11:40:28.756330 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 11:40:28.756330 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 11:40:28.757306 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 11:40:28.757306 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 11:40:28.757306 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 11:40:28.757306 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 11:40:28.757306 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:28.757306 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:28.757306 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:40:28.757306 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:40:28.757306 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:40:28.757306 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:40:28.757306 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:40:28.757306 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:40:28.757306 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:40:28.757306 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:40:28.757306 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:40:28.757306 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:40:28.758120 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:40:28.758120 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:40:28.758120 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:40:28.758120 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:40:28.758120 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 11:40:28.758120 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 11:40:28.758120 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 11:40:28.758120 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 11:40:28.758120 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 11:40:28.758120 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 11:40:28.758120 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 11:40:28.758120 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:40:28.758120 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 274/546] 10.222.0.59 () {56 vars in 1102 bytes} [Tue Oct 4 11:40:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 11:40:28.763636 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479dcba4-e510-475e-87d6-1dab63bb66f8 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:28.768480 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dbbdb3-513b-4daf-80b1-0d77d9b0ca50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:28.769585 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dbbdb3-513b-4daf-80b1-0d77d9b0ca50 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:28.769910 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dbbdb3-513b-4daf-80b1-0d77d9b0ca50 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:28.770117 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dbbdb3-513b-4daf-80b1-0d77d9b0ca50 None admin] PATH_INFO: `/v3/roles/service` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:28.792663 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dbbdb3-513b-4daf-80b1-0d77d9b0ca50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 11:40:28.805701 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-e2dbbdb3-513b-4daf-80b1-0d77d9b0ca50 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 11:40:28.805701 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:28.805701 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:28.805701 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:28.805701 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:28.805701 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:28.805701 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:28.805701 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:28.805701 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:28.805701 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:28.805701 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:28.805701 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:28.805701 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 11:40:28.805701 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 11:40:28.805701 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 11:40:28.805701 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 11:40:28.808289 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 11:40:28.808289 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 11:40:28.808289 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 11:40:28.808289 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 11:40:28.808289 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:28.808289 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:28.808289 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:40:28.808289 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:40:28.808289 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:40:28.808289 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:40:28.808289 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:40:28.808289 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:40:28.808289 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:40:28.808289 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:40:28.808289 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:40:28.808289 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:40:28.810788 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:40:28.810788 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:40:28.810788 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:40:28.810788 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:40:28.810788 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 11:40:28.810788 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 11:40:28.810788 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 11:40:28.810788 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 11:40:28.810788 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 11:40:28.810788 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 11:40:28.810788 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 11:40:28.810788 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:40:28.810788 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 273/547] 10.222.0.59 () {56 vars in 1102 bytes} [Tue Oct 4 11:40:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:40:28.817197 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dbbdb3-513b-4daf-80b1-0d77d9b0ca50 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:28.827260 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:28.873908 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479dcba4-e510-475e-87d6-1dab63bb66f8 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:28.911529 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c642056-772c-44f3-9fba-0e9d8dc4fa9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:28.913479 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c642056-772c-44f3-9fba-0e9d8dc4fa9a None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:28.913479 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c642056-772c-44f3-9fba-0e9d8dc4fa9a None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:28.913479 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c642056-772c-44f3-9fba-0e9d8dc4fa9a None admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:28.913729 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c642056-772c-44f3-9fba-0e9d8dc4fa9a None admin] RBAC: Adding query filter params (name=service) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:28.913817 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c642056-772c-44f3-9fba-0e9d8dc4fa9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:28.920618 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c642056-772c-44f3-9fba-0e9d8dc4fa9a None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:28.924013 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 275/548] 10.222.0.59 () {56 vars in 1103 bytes} [Tue Oct 4 11:40:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 11:40:28.929673 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c642056-772c-44f3-9fba-0e9d8dc4fa9a None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:28.931376 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:29.033994 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c642056-772c-44f3-9fba-0e9d8dc4fa9a None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:29.065843 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:29.073092 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af01f28-356d-43ee-a469-a7797cc67fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:29.074089 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af01f28-356d-43ee-a469-a7797cc67fb9 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:29.074572 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af01f28-356d-43ee-a469-a7797cc67fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:29.075047 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af01f28-356d-43ee-a469-a7797cc67fb9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:29.084030 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dbbdb3-513b-4daf-80b1-0d77d9b0ca50 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:29.087474 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af01f28-356d-43ee-a469-a7797cc67fb9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:29.089257 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af01f28-356d-43ee-a469-a7797cc67fb9 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:29.105150 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-5af01f28-356d-43ee-a469-a7797cc67fb9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:40:29.105150 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:29.105150 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:29.105150 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:29.105150 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:29.105150 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:29.105150 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:29.105150 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:29.105150 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:29.105150 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:29.105150 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:29.105150 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:29.105150 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 11:40:29.105150 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 11:40:29.105150 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 11:40:29.105150 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 11:40:29.106116 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:29.106116 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:29.106116 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:40:29.106116 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:40:29.106116 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:40:29.106116 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:40:29.106116 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:40:29.106116 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:40:29.106116 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:40:29.106116 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:40:29.106116 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:40:29.106116 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:40:29.106116 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:40:29.106116 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:40:29.106116 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:40:29.106116 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:40:29.106116 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 11:40:29.107087 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 11:40:29.107087 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:40:29.107087 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:40:29.109375 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 276/549] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Oct 4 11:40:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 11:40:29.115111 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af01f28-356d-43ee-a469-a7797cc67fb9 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:29.169783 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c452ae7e-a0d4-4640-8799-3c597129ab9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:29.170841 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c452ae7e-a0d4-4640-8799-3c597129ab9d None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:29.171358 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c452ae7e-a0d4-4640-8799-3c597129ab9d None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:29.171921 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c452ae7e-a0d4-4640-8799-3c597129ab9d None admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:29.173242 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c452ae7e-a0d4-4640-8799-3c597129ab9d None admin] RBAC: Adding query filter params (name=service) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:29.173802 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c452ae7e-a0d4-4640-8799-3c597129ab9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:29.177208 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c452ae7e-a0d4-4640-8799-3c597129ab9d None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:29.196396 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 274/550] 10.222.0.59 () {56 vars in 1103 bytes} [Tue Oct 4 11:40:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 384 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 11:40:29.205351 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c452ae7e-a0d4-4640-8799-3c597129ab9d None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:29.265721 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af01f28-356d-43ee-a469-a7797cc67fb9 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:29.329953 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae9e202-1996-423b-b720-df4437d9fea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:29.330475 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae9e202-1996-423b-b720-df4437d9fea1 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:29.330753 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae9e202-1996-423b-b720-df4437d9fea1 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:29.331546 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae9e202-1996-423b-b720-df4437d9fea1 None admin] PATH_INFO: `/v3/domains` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:29.332198 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae9e202-1996-423b-b720-df4437d9fea1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:29.332495 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae9e202-1996-423b-b720-df4437d9fea1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:29.334581 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae9e202-1996-423b-b720-df4437d9fea1 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:29.348523 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 277/551] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Oct 4 11:40:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 11:40:29.361436 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae9e202-1996-423b-b720-df4437d9fea1 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:29.380385 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c452ae7e-a0d4-4640-8799-3c597129ab9d None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:29.391299 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:29.416165 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c1f4eb-a975-4a54-9da1-3da7a8750a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:29.416826 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c1f4eb-a975-4a54-9da1-3da7a8750a0b None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:29.417105 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c1f4eb-a975-4a54-9da1-3da7a8750a0b None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:29.417372 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c1f4eb-a975-4a54-9da1-3da7a8750a0b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:29.427880 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:29.430117 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c1f4eb-a975-4a54-9da1-3da7a8750a0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:29.431589 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c1f4eb-a975-4a54-9da1-3da7a8750a0b None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:29.446824 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-b0c1f4eb-a975-4a54-9da1-3da7a8750a0b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:40:29.446824 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:29.446824 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:29.446824 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:29.446824 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:29.446824 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:29.446824 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:29.446824 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:29.446824 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:29.446824 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:29.446824 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:29.446824 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:29.446824 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 11:40:29.446824 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 11:40:29.446824 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 11:40:29.446824 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 11:40:29.447792 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:29.447792 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:29.447792 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:40:29.447792 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:40:29.447792 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:40:29.447792 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:40:29.447792 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:40:29.447792 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:40:29.447792 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:40:29.447792 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:40:29.447792 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:40:29.447792 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:40:29.447792 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:40:29.447792 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:40:29.447792 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:40:29.447792 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:40:29.447792 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 11:40:29.448776 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 11:40:29.448776 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:40:29.448776 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:40:29.448776 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 275/552] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Oct 4 11:40:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 11:40:29.456320 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c1f4eb-a975-4a54-9da1-3da7a8750a0b None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:29.538231 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae9e202-1996-423b-b720-df4437d9fea1 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:29.604383 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f237ed54-df10-45ca-a128-770f42d716f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:29.606545 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f237ed54-df10-45ca-a128-770f42d716f4 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:29.608101 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f237ed54-df10-45ca-a128-770f42d716f4 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:29.608612 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f237ed54-df10-45ca-a128-770f42d716f4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:29.622380 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f237ed54-df10-45ca-a128-770f42d716f4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:29.625702 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f237ed54-df10-45ca-a128-770f42d716f4 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:29.645212 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-f237ed54-df10-45ca-a128-770f42d716f4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 04 11:40:29.645212 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:29.645212 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:29.645212 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:29.645212 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:29.645212 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:29.645212 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:29.645212 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:29.645212 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:29.645212 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:29.645212 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:29.645212 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:29.645212 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 11:40:29.645212 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 11:40:29.645212 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 11:40:29.645212 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 11:40:29.646204 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:29.646204 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:29.646204 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 11:40:29.646204 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 11:40:29.646204 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 11:40:29.646204 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 11:40:29.646204 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:40:29.646204 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:40:29.646204 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:40:29.646204 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:40:29.646204 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:40:29.646204 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:40:29.646204 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:40:29.646204 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:40:29.646204 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:40:29.646204 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:40:29.646204 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:40:29.646204 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:40:29.647769 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:40:29.647769 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:40:29.647769 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 11:40:29.647769 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 11:40:29.647769 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 11:40:29.647769 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 11:40:29.647769 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 11:40:29.647769 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 11:40:29.647769 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 04 11:40:29.647769 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:40:29.647769 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 278/553] 10.222.0.59 () {56 vars in 1093 bytes} [Tue Oct 4 11:40:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:40:29.653499 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f237ed54-df10-45ca-a128-770f42d716f4 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:29.663198 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c1f4eb-a975-4a54-9da1-3da7a8750a0b None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:29.701886 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef4e844-6fdd-4c94-a857-3d1c3d8bf7b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:29.702882 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef4e844-6fdd-4c94-a857-3d1c3d8bf7b5 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:29.703378 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef4e844-6fdd-4c94-a857-3d1c3d8bf7b5 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:29.703854 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef4e844-6fdd-4c94-a857-3d1c3d8bf7b5 None admin] PATH_INFO: `/v3/domains` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:29.704709 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef4e844-6fdd-4c94-a857-3d1c3d8bf7b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:29.705205 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef4e844-6fdd-4c94-a857-3d1c3d8bf7b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:29.707546 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef4e844-6fdd-4c94-a857-3d1c3d8bf7b5 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:29.727435 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 276/554] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Oct 4 11:40:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 11:40:29.729109 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef4e844-6fdd-4c94-a857-3d1c3d8bf7b5 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:29.756935 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:29.846842 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:29.858699 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f237ed54-df10-45ca-a128-770f42d716f4 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:29.869148 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef4e844-6fdd-4c94-a857-3d1c3d8bf7b5 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:29.892647 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e92e096-dbd5-4302-8e4e-69ad652fcabc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:29.894240 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e92e096-dbd5-4302-8e4e-69ad652fcabc None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:29.894906 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e92e096-dbd5-4302-8e4e-69ad652fcabc None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:29.895398 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e92e096-dbd5-4302-8e4e-69ad652fcabc None admin] PATH_INFO: `/v3/users` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:29.896317 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e92e096-dbd5-4302-8e4e-69ad652fcabc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:29.896859 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e92e096-dbd5-4302-8e4e-69ad652fcabc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:29.898552 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e92e096-dbd5-4302-8e4e-69ad652fcabc None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:29.906636 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0645445-91b6-4aae-89d5-2746685e2a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:29.907670 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0645445-91b6-4aae-89d5-2746685e2a46 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:29.907951 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0645445-91b6-4aae-89d5-2746685e2a46 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:29.908218 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0645445-91b6-4aae-89d5-2746685e2a46 None admin] PATH_INFO: `/v3/users/swift` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:29.916467 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0645445-91b6-4aae-89d5-2746685e2a46 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:29.917995 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0645445-91b6-4aae-89d5-2746685e2a46 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:29.920463 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 279/555] 10.222.0.59 () {56 vars in 1133 bytes} [Tue Oct 4 11:40:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:29.922084 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ccf78d-768f-49dd-a86f-ce3a13fe416c None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:29.922587 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ccf78d-768f-49dd-a86f-ce3a13fe416c None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:29.923069 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ccf78d-768f-49dd-a86f-ce3a13fe416c None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:29.926033 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 280/556] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:40:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:40:29.926981 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ccf78d-768f-49dd-a86f-ce3a13fe416c None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:29.932212 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-f0645445-91b6-4aae-89d5-2746685e2a46 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 04 11:40:29.932212 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:29.932212 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:29.932212 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:29.932212 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:29.932212 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:29.932212 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:29.932212 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:29.932212 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:29.932212 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:29.932212 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:29.932212 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:29.932212 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 11:40:29.932212 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 11:40:29.932212 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 11:40:29.932212 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 11:40:29.933959 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:29.933959 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:29.933959 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 11:40:29.933959 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 11:40:29.933959 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 11:40:29.933959 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 11:40:29.933959 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:40:29.933959 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:40:29.933959 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:40:29.933959 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:40:29.933959 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:40:29.933959 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:40:29.933959 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:40:29.933959 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:40:29.933959 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:40:29.933959 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:40:29.933959 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:40:29.933959 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:40:29.935167 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:40:29.935167 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:40:29.935167 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 11:40:29.935167 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 11:40:29.935167 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 11:40:29.935167 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 11:40:29.935167 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 11:40:29.935167 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 11:40:29.935167 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 04 11:40:29.935167 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:40:29.935167 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 277/557] 10.222.0.59 () {56 vars in 1096 bytes} [Tue Oct 4 11:40:29 2022] GET /identity/v3/users/swift => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:40:29.937962 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faf075c-49d3-4b5e-96a9-3cc7a1af252e None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:29.938249 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faf075c-49d3-4b5e-96a9-3cc7a1af252e None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:29.938518 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faf075c-49d3-4b5e-96a9-3cc7a1af252e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:29.959190 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-4faf075c-49d3-4b5e-96a9-3cc7a1af252e None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:40:29.960362 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-4faf075c-49d3-4b5e-96a9-3cc7a1af252e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:40:30.034931 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 278/558] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:40:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 11:40:30.035854 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faf075c-49d3-4b5e-96a9-3cc7a1af252e None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:30.051177 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:30.055032 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ccf78d-768f-49dd-a86f-ce3a13fe416c None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:30.145413 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353a2be9-22b4-413c-aa35-e74c21aa8e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:30.145922 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faf075c-49d3-4b5e-96a9-3cc7a1af252e None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:30.146053 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353a2be9-22b4-413c-aa35-e74c21aa8e54 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:30.146250 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353a2be9-22b4-413c-aa35-e74c21aa8e54 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:30.146522 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353a2be9-22b4-413c-aa35-e74c21aa8e54 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:30.166550 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353a2be9-22b4-413c-aa35-e74c21aa8e54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:30.168002 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353a2be9-22b4-413c-aa35-e74c21aa8e54 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:30.192435 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8f1273-1eae-475e-ab75-192219bf21ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:30.193471 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8f1273-1eae-475e-ab75-192219bf21ff None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:30.193951 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8f1273-1eae-475e-ab75-192219bf21ff None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:30.194511 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8f1273-1eae-475e-ab75-192219bf21ff None admin] PATH_INFO: `/v3/users` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:30.195477 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8f1273-1eae-475e-ab75-192219bf21ff None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:30.197249 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8f1273-1eae-475e-ab75-192219bf21ff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:30.202394 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8f1273-1eae-475e-ab75-192219bf21ff None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:30.204425 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-353a2be9-22b4-413c-aa35-e74c21aa8e54 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:40:30.204425 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:30.204425 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:30.204425 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:30.204425 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:30.204425 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:30.204425 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:30.204425 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:30.204425 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:30.204425 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:30.204425 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:30.204425 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:30.204425 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 11:40:30.204425 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 11:40:30.204425 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 11:40:30.204425 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 11:40:30.205428 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:30.205428 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:30.205428 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:40:30.205428 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:40:30.205428 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:40:30.205428 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:40:30.205428 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:40:30.205428 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:40:30.205428 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:40:30.205428 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:40:30.205428 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:40:30.205428 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:40:30.205428 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:40:30.205428 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:40:30.205428 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:40:30.205428 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:40:30.205428 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 11:40:30.206451 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 11:40:30.206451 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:40:30.206451 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:40:30.208517 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 281/559] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Oct 4 11:40:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:40:30.215672 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353a2be9-22b4-413c-aa35-e74c21aa8e54 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:30.222842 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:30.247321 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 279/560] 10.222.0.59 () {56 vars in 1135 bytes} [Tue Oct 4 11:40:30 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:30.262162 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8f1273-1eae-475e-ab75-192219bf21ff None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:30.344502 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:30.378354 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8f1273-1eae-475e-ab75-192219bf21ff None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:30.380122 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353a2be9-22b4-413c-aa35-e74c21aa8e54 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:30.416980 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebfeb20-4c9c-436e-9992-83c137ce3cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:30.417503 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebfeb20-4c9c-436e-9992-83c137ce3cda None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:30.417777 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebfeb20-4c9c-436e-9992-83c137ce3cda None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:30.418041 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebfeb20-4c9c-436e-9992-83c137ce3cda None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:30.419379 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea6e900-bc89-4c56-87e2-e4dca40d1a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:30.420136 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea6e900-bc89-4c56-87e2-e4dca40d1a14 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:30.420868 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea6e900-bc89-4c56-87e2-e4dca40d1a14 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:30.422195 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea6e900-bc89-4c56-87e2-e4dca40d1a14 None admin] PATH_INFO: `/v3/domains` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:30.422999 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea6e900-bc89-4c56-87e2-e4dca40d1a14 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:30.423449 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea6e900-bc89-4c56-87e2-e4dca40d1a14 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:30.425530 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea6e900-bc89-4c56-87e2-e4dca40d1a14 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:30.441307 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 282/561] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Oct 4 11:40:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:30.442359 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7acebd5-7869-4738-8b90-579e802d8f92 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:30.442637 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7acebd5-7869-4738-8b90-579e802d8f92 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:30.442903 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7acebd5-7869-4738-8b90-579e802d8f92 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:30.446428 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 283/562] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:40:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:40:30.446428 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7acebd5-7869-4738-8b90-579e802d8f92 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:30.499513 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebfeb20-4c9c-436e-9992-83c137ce3cda None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:30.501052 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebfeb20-4c9c-436e-9992-83c137ce3cda None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:30.527805 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:30.570335 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7acebd5-7869-4738-8b90-579e802d8f92 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:30.578496 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:30.614963 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee8a66f-7a6a-46d8-a66f-32e993b8e8d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:30.615595 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee8a66f-7a6a-46d8-a66f-32e993b8e8d2 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:30.615871 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee8a66f-7a6a-46d8-a66f-32e993b8e8d2 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:30.616139 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee8a66f-7a6a-46d8-a66f-32e993b8e8d2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:30.622478 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 280/563] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Oct 4 11:40:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 11:40:30.623230 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebfeb20-4c9c-436e-9992-83c137ce3cda None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:30.630318 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee8a66f-7a6a-46d8-a66f-32e993b8e8d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 11:40:30.635491 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-3ee8a66f-7a6a-46d8-a66f-32e993b8e8d2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 11:40:30.635491 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:30.635491 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:30.635491 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:30.635491 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:30.635491 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:30.635491 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:30.635491 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:30.635491 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:30.635491 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:30.635491 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:30.635491 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:30.635491 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 11:40:30.635491 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 11:40:30.635491 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 11:40:30.635491 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 11:40:30.636502 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 11:40:30.636502 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 11:40:30.636502 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 11:40:30.636502 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 11:40:30.636502 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:30.636502 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:30.636502 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:40:30.636502 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:40:30.636502 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:40:30.636502 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:40:30.636502 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:40:30.636502 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:40:30.636502 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:40:30.636502 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:40:30.636502 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:40:30.636502 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:40:30.637404 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:40:30.637404 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:40:30.637404 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:40:30.637404 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:40:30.637404 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 11:40:30.637404 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 11:40:30.637404 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 11:40:30.637404 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 11:40:30.637404 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 11:40:30.637404 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 11:40:30.637404 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 11:40:30.637404 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:40:30.637404 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 284/564] 10.222.0.59 () {56 vars in 1102 bytes} [Tue Oct 4 11:40:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:40:30.638108 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5a68e1-24c1-4f9d-9c69-9774f289b9e4 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:30.638616 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5a68e1-24c1-4f9d-9c69-9774f289b9e4 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:30.638616 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5a68e1-24c1-4f9d-9c69-9774f289b9e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:30.656016 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-6e5a68e1-24c1-4f9d-9c69-9774f289b9e4 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:40:30.657208 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-6e5a68e1-24c1-4f9d-9c69-9774f289b9e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:40:30.724955 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebfeb20-4c9c-436e-9992-83c137ce3cda None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:30.727073 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 285/565] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:40:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 11:40:30.728219 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f203f4-4e42-4ef2-b23f-f6696a50c0b6 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:30.728561 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f203f4-4e42-4ef2-b23f-f6696a50c0b6 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:30.728874 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f203f4-4e42-4ef2-b23f-f6696a50c0b6 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:30.732701 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 286/566] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:40:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:40:30.732701 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f203f4-4e42-4ef2-b23f-f6696a50c0b6 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:30.761530 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab0edce-90df-49f1-a60d-061a2577fead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:30.762515 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab0edce-90df-49f1-a60d-061a2577fead None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:30.762971 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab0edce-90df-49f1-a60d-061a2577fead None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:30.763517 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab0edce-90df-49f1-a60d-061a2577fead None admin] PATH_INFO: `/v3/projects/service` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:30.771286 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab0edce-90df-49f1-a60d-061a2577fead None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:30.773134 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab0edce-90df-49f1-a60d-061a2577fead None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:30.784624 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-aab0edce-90df-49f1-a60d-061a2577fead None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 11:40:30.784624 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:30.784624 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:30.784624 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:30.784624 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:30.784624 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:30.784624 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:30.784624 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:30.784624 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:30.784624 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:30.784624 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:30.784624 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:30.784624 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 11:40:30.784624 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 11:40:30.784624 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 11:40:30.785508 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 11:40:30.785508 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:30.785508 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:30.785508 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:40:30.785508 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:40:30.785508 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:40:30.785508 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:40:30.785508 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:40:30.785508 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:40:30.785508 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:40:30.785508 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:40:30.785508 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:40:30.785508 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:40:30.785508 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:40:30.785508 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:40:30.785508 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:40:30.785508 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:40:30.786440 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 11:40:30.786440 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 11:40:30.786440 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 11:40:30.786440 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 11:40:30.786440 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 11:40:30.786440 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 11:40:30.786440 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 11:40:30.786440 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:40:30.786440 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 281/567] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Oct 4 11:40:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:40:30.786962 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab0edce-90df-49f1-a60d-061a2577fead None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:30.804725 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:30.819085 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:30.852043 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f203f4-4e42-4ef2-b23f-f6696a50c0b6 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:30.888928 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df314de-6027-49dd-81b2-230d8367914a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:30.889544 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df314de-6027-49dd-81b2-230d8367914a None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:30.889819 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df314de-6027-49dd-81b2-230d8367914a None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:30.890090 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df314de-6027-49dd-81b2-230d8367914a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:30.894873 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab0edce-90df-49f1-a60d-061a2577fead None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:30.901865 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df314de-6027-49dd-81b2-230d8367914a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:30.903328 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df314de-6027-49dd-81b2-230d8367914a None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:30.918961 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-7df314de-6027-49dd-81b2-230d8367914a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:40:30.918961 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:30.918961 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:30.918961 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:30.918961 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:30.918961 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:30.918961 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:30.918961 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:30.918961 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:30.918961 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:30.918961 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:30.918961 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:30.918961 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 11:40:30.918961 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 11:40:30.918961 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 11:40:30.918961 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 11:40:30.919937 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:30.919937 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:30.919937 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:40:30.919937 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:40:30.919937 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:40:30.919937 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:40:30.919937 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:40:30.919937 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:40:30.919937 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:40:30.919937 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:40:30.919937 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:40:30.919937 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:40:30.919937 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:40:30.919937 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:40:30.919937 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:40:30.919937 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:40:30.919937 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 11:40:30.921099 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 11:40:30.921099 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:40:30.921099 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:40:30.925021 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 287/568] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Oct 4 11:40:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:40:30.926187 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51494d84-2032-4a9a-baa1-ba796682f232 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:30.926465 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51494d84-2032-4a9a-baa1-ba796682f232 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:30.926735 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51494d84-2032-4a9a-baa1-ba796682f232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:30.937373 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9247a416-a428-4d7c-878a-3a12f6269f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:30.937989 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9247a416-a428-4d7c-878a-3a12f6269f96 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:30.938272 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9247a416-a428-4d7c-878a-3a12f6269f96 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:30.938549 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9247a416-a428-4d7c-878a-3a12f6269f96 None admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:30.939211 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9247a416-a428-4d7c-878a-3a12f6269f96 None admin] RBAC: Adding query filter params (name=service) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:30.939513 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9247a416-a428-4d7c-878a-3a12f6269f96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:30.941635 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9247a416-a428-4d7c-878a-3a12f6269f96 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:30.955401 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 282/569] 10.222.0.59 () {56 vars in 1103 bytes} [Tue Oct 4 11:40:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:30.955401 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9247a416-a428-4d7c-878a-3a12f6269f96 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:30.966631 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-51494d84-2032-4a9a-baa1-ba796682f232 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:40:30.967984 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-51494d84-2032-4a9a-baa1-ba796682f232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:40:31.041379 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 288/570] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:40:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 11:40:31.042079 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51494d84-2032-4a9a-baa1-ba796682f232 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:31.056230 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:31.065839 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9247a416-a428-4d7c-878a-3a12f6269f96 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:31.084942 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:31.100943 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7a6137-8b1b-4e85-8e5b-2b4cfdda2b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:31.101548 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7a6137-8b1b-4e85-8e5b-2b4cfdda2b3b None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:31.101826 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7a6137-8b1b-4e85-8e5b-2b4cfdda2b3b None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:31.102094 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7a6137-8b1b-4e85-8e5b-2b4cfdda2b3b None admin] PATH_INFO: `/v3/projects` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:31.102774 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7a6137-8b1b-4e85-8e5b-2b4cfdda2b3b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:31.103074 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7a6137-8b1b-4e85-8e5b-2b4cfdda2b3b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:31.104481 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7a6137-8b1b-4e85-8e5b-2b4cfdda2b3b None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:31.122600 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 283/571] 10.222.0.59 () {56 vars in 1148 bytes} [Tue Oct 4 11:40:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:31.122600 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7a6137-8b1b-4e85-8e5b-2b4cfdda2b3b None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:31.157745 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51494d84-2032-4a9a-baa1-ba796682f232 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:31.196303 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7975ac7e-428a-4b6a-b5c4-cf75b49a5e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:31.197019 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7975ac7e-428a-4b6a-b5c4-cf75b49a5e3d None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:31.197295 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7975ac7e-428a-4b6a-b5c4-cf75b49a5e3d None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:31.197563 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7975ac7e-428a-4b6a-b5c4-cf75b49a5e3d None admin] PATH_INFO: `/v3/domains` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:31.198381 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7975ac7e-428a-4b6a-b5c4-cf75b49a5e3d None admin] RBAC: Adding query filter params (name=Default) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:31.198609 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7975ac7e-428a-4b6a-b5c4-cf75b49a5e3d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:31.200049 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7975ac7e-428a-4b6a-b5c4-cf75b49a5e3d None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:31.213171 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 289/572] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Oct 4 11:40:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:31.214035 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7975ac7e-428a-4b6a-b5c4-cf75b49a5e3d None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:31.239490 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7a6137-8b1b-4e85-8e5b-2b4cfdda2b3b None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:31.276315 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fbc39d-0f21-4d4d-a8f8-b833ddaf26e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:31.277100 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fbc39d-0f21-4d4d-a8f8-b833ddaf26e3 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:31.277442 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fbc39d-0f21-4d4d-a8f8-b833ddaf26e3 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:31.277792 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fbc39d-0f21-4d4d-a8f8-b833ddaf26e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:31.290615 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fbc39d-0f21-4d4d-a8f8-b833ddaf26e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:31.292755 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fbc39d-0f21-4d4d-a8f8-b833ddaf26e3 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:31.312153 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-c9fbc39d-0f21-4d4d-a8f8-b833ddaf26e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:40:31.312153 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:31.312153 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:31.312153 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:31.312153 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:31.312153 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:31.312153 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:31.312153 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:31.312153 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:31.312153 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:31.312153 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:31.312153 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:31.312153 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 11:40:31.312153 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 11:40:31.312153 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 11:40:31.312153 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 11:40:31.313361 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:31.313361 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:31.313361 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:40:31.313361 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:40:31.313361 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:40:31.313361 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:40:31.313361 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:40:31.313361 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:40:31.313361 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:40:31.313361 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:40:31.313361 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:40:31.313361 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:40:31.313361 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:40:31.313361 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:40:31.313361 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:40:31.313361 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:40:31.313361 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 11:40:31.314546 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 11:40:31.314546 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:40:31.314546 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:40:31.315327 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 284/573] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Oct 4 11:40:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:40:31.316244 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fbc39d-0f21-4d4d-a8f8-b833ddaf26e3 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:31.320212 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:31.333529 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:31.339346 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7975ac7e-428a-4b6a-b5c4-cf75b49a5e3d None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:31.374199 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9774dc48-1927-4952-94b9-ae6d8062196a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:31.374959 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9774dc48-1927-4952-94b9-ae6d8062196a None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:31.375335 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9774dc48-1927-4952-94b9-ae6d8062196a None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:31.375773 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9774dc48-1927-4952-94b9-ae6d8062196a None admin] PATH_INFO: `/v3/roles/service` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:31.386915 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9774dc48-1927-4952-94b9-ae6d8062196a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 11:40:31.391695 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-9774dc48-1927-4952-94b9-ae6d8062196a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 11:40:31.391695 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:31.391695 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:31.391695 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:31.391695 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:31.391695 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:31.391695 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:31.391695 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:31.391695 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:31.391695 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:31.391695 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:31.391695 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:31.391695 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 11:40:31.391695 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 11:40:31.391695 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 11:40:31.391695 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 11:40:31.392858 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 11:40:31.392858 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 11:40:31.392858 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 11:40:31.392858 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 11:40:31.392858 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:31.392858 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:31.392858 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:40:31.392858 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:40:31.392858 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:40:31.392858 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:40:31.392858 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:40:31.392858 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:40:31.392858 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:40:31.392858 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:40:31.392858 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:40:31.392858 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:40:31.394389 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:40:31.394389 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:40:31.394389 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:40:31.394389 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:40:31.394389 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 11:40:31.394389 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 11:40:31.394389 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 11:40:31.394389 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 11:40:31.394389 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 11:40:31.394389 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 11:40:31.394389 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 11:40:31.394389 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:40:31.394389 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 290/574] 10.222.0.59 () {56 vars in 1102 bytes} [Tue Oct 4 11:40:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:40:31.394389 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9774dc48-1927-4952-94b9-ae6d8062196a None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:31.420634 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fbc39d-0f21-4d4d-a8f8-b833ddaf26e3 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:31.453276 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7714236-b962-4479-a877-30b545733257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:31.453931 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7714236-b962-4479-a877-30b545733257 None admin] REQUEST_METHOD: `PUT` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:31.454214 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7714236-b962-4479-a877-30b545733257 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:31.454491 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7714236-b962-4479-a877-30b545733257 None admin] PATH_INFO: `/v3/projects/39913dbe3e984f27a61493dd75381501/users/a8e23d1d2fe24bdf9552e7c2f0ae3424/roles/01769bbdbd2e48f2bf8e855ba6a8507e` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:31.469048 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7714236-b962-4479-a877-30b545733257 None admin] RBAC: Authorizing `identity:create_grant(project_id=39913dbe3e984f27a61493dd75381501, user_id=a8e23d1d2fe24bdf9552e7c2f0ae3424, role_id=01769bbdbd2e48f2bf8e855ba6a8507e)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:31.470542 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7714236-b962-4479-a877-30b545733257 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:31.495655 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9774dc48-1927-4952-94b9-ae6d8062196a None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:31.529627 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1513c5f-67f5-4279-b88f-7c596db36edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:31.530247 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1513c5f-67f5-4279-b88f-7c596db36edf None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:31.530553 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1513c5f-67f5-4279-b88f-7c596db36edf None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:31.530833 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1513c5f-67f5-4279-b88f-7c596db36edf None admin] PATH_INFO: `/v3/projects/service` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:31.537917 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1513c5f-67f5-4279-b88f-7c596db36edf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:31.539351 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1513c5f-67f5-4279-b88f-7c596db36edf None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:31.550363 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-c1513c5f-67f5-4279-b88f-7c596db36edf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 11:40:31.550363 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:31.550363 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:31.550363 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:31.550363 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:31.550363 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:31.550363 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:31.550363 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:31.550363 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:31.550363 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:31.550363 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:31.550363 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:31.550363 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 11:40:31.550363 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 11:40:31.550363 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 11:40:31.551421 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 11:40:31.551421 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:31.551421 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:31.551421 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:40:31.551421 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:40:31.551421 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:40:31.551421 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:40:31.551421 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:40:31.551421 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:40:31.551421 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:40:31.551421 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:40:31.551421 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:40:31.551421 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:40:31.551421 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:40:31.551421 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:40:31.551421 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:40:31.551421 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:40:31.552490 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 11:40:31.552490 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 11:40:31.552490 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 11:40:31.552490 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 11:40:31.552490 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 11:40:31.552490 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 11:40:31.552490 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 11:40:31.552490 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:40:31.552490 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 291/575] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Oct 4 11:40:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:40:31.552490 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1513c5f-67f5-4279-b88f-7c596db36edf None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:31.560421 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 285/576] 10.222.0.59 () {58 vars in 1439 bytes} [Tue Oct 4 11:40:31 2022] PUT /identity/v3/projects/39913dbe3e984f27a61493dd75381501/users/a8e23d1d2fe24bdf9552e7c2f0ae3424/roles/01769bbdbd2e48f2bf8e855ba6a8507e => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 11:40:31.561261 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7714236-b962-4479-a877-30b545733257 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:31.571777 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:31.640870 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:31.679558 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1513c5f-67f5-4279-b88f-7c596db36edf None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:31.694506 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7714236-b962-4479-a877-30b545733257 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:31.719739 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437f3639-19b7-47f3-bee0-d44bd90ce4ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:31.720393 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437f3639-19b7-47f3-bee0-d44bd90ce4ff None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:31.720853 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437f3639-19b7-47f3-bee0-d44bd90ce4ff None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:31.721127 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437f3639-19b7-47f3-bee0-d44bd90ce4ff None admin] PATH_INFO: `/v3/roles/service` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:31.733098 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437f3639-19b7-47f3-bee0-d44bd90ce4ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 11:40:31.736204 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b70c3b-6dfb-4ce6-8530-6d29318ca434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:31.736865 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b70c3b-6dfb-4ce6-8530-6d29318ca434 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:31.737160 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b70c3b-6dfb-4ce6-8530-6d29318ca434 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:31.737614 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b70c3b-6dfb-4ce6-8530-6d29318ca434 None admin] PATH_INFO: `/v3/domains` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:31.738450 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-437f3639-19b7-47f3-bee0-d44bd90ce4ff None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 11:40:31.738450 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:31.738450 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:31.738450 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:31.738450 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:31.738450 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:31.738450 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:31.738450 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:31.738450 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:31.738450 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:31.738450 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:31.738450 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:31.738450 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 11:40:31.738450 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 11:40:31.738450 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 11:40:31.738450 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 11:40:31.739443 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 11:40:31.739443 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 11:40:31.739443 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 11:40:31.739443 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 11:40:31.739443 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:31.739443 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:31.739443 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:40:31.739443 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:40:31.739443 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:40:31.739443 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:40:31.739443 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:40:31.739443 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:40:31.739443 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:40:31.739443 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:40:31.739443 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:40:31.739443 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:40:31.741315 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:40:31.741315 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:40:31.741315 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:40:31.741315 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:40:31.741315 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 11:40:31.741315 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 11:40:31.741315 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 11:40:31.741315 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 11:40:31.741315 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 11:40:31.741315 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 11:40:31.741315 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 11:40:31.741315 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:40:31.742109 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b70c3b-6dfb-4ce6-8530-6d29318ca434 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:31.742109 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b70c3b-6dfb-4ce6-8530-6d29318ca434 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:31.742109 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b70c3b-6dfb-4ce6-8530-6d29318ca434 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:31.747915 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 292/577] 10.222.0.59 () {56 vars in 1102 bytes} [Tue Oct 4 11:40:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:40:31.747915 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437f3639-19b7-47f3-bee0-d44bd90ce4ff None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:31.762075 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 286/578] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Oct 4 11:40:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:31.763135 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b70c3b-6dfb-4ce6-8530-6d29318ca434 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:31.838457 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:31.863599 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437f3639-19b7-47f3-bee0-d44bd90ce4ff None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:31.872005 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b70c3b-6dfb-4ce6-8530-6d29318ca434 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:31.886449 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:31.896843 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e27c91-b551-4680-af39-ed51b6600489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:31.897443 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e27c91-b551-4680-af39-ed51b6600489 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:31.897718 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e27c91-b551-4680-af39-ed51b6600489 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:31.897985 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e27c91-b551-4680-af39-ed51b6600489 None admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:31.898634 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e27c91-b551-4680-af39-ed51b6600489 None admin] RBAC: Adding query filter params (name=service) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:31.898928 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e27c91-b551-4680-af39-ed51b6600489 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:31.900289 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e27c91-b551-4680-af39-ed51b6600489 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:31.908240 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ae8bb2-36f1-4f49-bb6b-542b37ef935f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:31.908902 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ae8bb2-36f1-4f49-bb6b-542b37ef935f None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:31.909644 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 293/579] 10.222.0.59 () {56 vars in 1103 bytes} [Tue Oct 4 11:40:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:31.914331 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ae8bb2-36f1-4f49-bb6b-542b37ef935f None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:31.914331 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ae8bb2-36f1-4f49-bb6b-542b37ef935f None admin] PATH_INFO: `/v3/projects` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:31.914497 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e27c91-b551-4680-af39-ed51b6600489 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:31.914594 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ae8bb2-36f1-4f49-bb6b-542b37ef935f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:31.914594 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ae8bb2-36f1-4f49-bb6b-542b37ef935f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:31.914594 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ae8bb2-36f1-4f49-bb6b-542b37ef935f None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:31.926384 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 287/580] 10.222.0.59 () {56 vars in 1148 bytes} [Tue Oct 4 11:40:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:31.927214 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ae8bb2-36f1-4f49-bb6b-542b37ef935f None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:32.019555 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e27c91-b551-4680-af39-ed51b6600489 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:32.031946 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ae8bb2-36f1-4f49-bb6b-542b37ef935f None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:32.053701 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9282ba3d-927f-469a-aadb-29a52139715e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:32.054301 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9282ba3d-927f-469a-aadb-29a52139715e None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:32.054576 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9282ba3d-927f-469a-aadb-29a52139715e None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:32.054843 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9282ba3d-927f-469a-aadb-29a52139715e None admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:32.055524 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9282ba3d-927f-469a-aadb-29a52139715e None admin] RBAC: Adding query filter params (name=service) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:32.055823 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9282ba3d-927f-469a-aadb-29a52139715e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:32.057225 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9282ba3d-927f-469a-aadb-29a52139715e None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:32.062793 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:32.066686 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 294/581] 10.222.0.59 () {56 vars in 1103 bytes} [Tue Oct 4 11:40:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:32.067295 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9282ba3d-927f-469a-aadb-29a52139715e None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:32.073102 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0874df5a-17f3-4781-bdc4-2e42ce8259cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:32.073748 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0874df5a-17f3-4781-bdc4-2e42ce8259cb None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:32.074029 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0874df5a-17f3-4781-bdc4-2e42ce8259cb None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:32.074301 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0874df5a-17f3-4781-bdc4-2e42ce8259cb None admin] PATH_INFO: `/v3/users/cinder` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:32.085378 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0874df5a-17f3-4781-bdc4-2e42ce8259cb None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:32.085378 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0874df5a-17f3-4781-bdc4-2e42ce8259cb None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:32.096164 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-0874df5a-17f3-4781-bdc4-2e42ce8259cb None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 04 11:40:32.096164 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:32.096164 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:32.096164 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:32.096164 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:32.096164 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:32.096164 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:32.096164 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:32.096164 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:32.096164 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:32.096164 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:32.096164 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:32.096164 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 11:40:32.096164 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 11:40:32.096164 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 11:40:32.096164 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 11:40:32.097745 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:32.097745 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:32.097745 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 11:40:32.097745 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 11:40:32.097745 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 11:40:32.097745 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 11:40:32.097745 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:40:32.097745 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:40:32.097745 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:40:32.097745 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:40:32.097745 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:40:32.097745 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:40:32.097745 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:40:32.097745 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:40:32.097745 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:40:32.097745 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:40:32.097745 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:40:32.097745 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:40:32.098710 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:40:32.098710 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:40:32.098710 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 11:40:32.098710 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 11:40:32.098710 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 11:40:32.098710 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 11:40:32.098710 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 11:40:32.098710 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 11:40:32.098710 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 04 11:40:32.098710 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:40:32.098710 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 288/582] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Oct 4 11:40:31 2022] GET /identity/v3/users/cinder => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:40:32.099600 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0874df5a-17f3-4781-bdc4-2e42ce8259cb None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:32.134080 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:32.173558 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9282ba3d-927f-469a-aadb-29a52139715e None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:32.207977 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0874df5a-17f3-4781-bdc4-2e42ce8259cb None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:32.208571 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b27836-aef7-4ce5-8e71-1e7a10b2b721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:32.209223 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b27836-aef7-4ce5-8e71-1e7a10b2b721 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:32.209504 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b27836-aef7-4ce5-8e71-1e7a10b2b721 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:32.209769 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b27836-aef7-4ce5-8e71-1e7a10b2b721 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:32.219788 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b27836-aef7-4ce5-8e71-1e7a10b2b721 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:32.221247 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b27836-aef7-4ce5-8e71-1e7a10b2b721 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:32.237259 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-c9b27836-aef7-4ce5-8e71-1e7a10b2b721 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:40:32.237259 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:32.237259 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:32.237259 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:32.237259 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:32.237259 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:32.237259 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:32.237259 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:32.237259 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:32.237259 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:32.237259 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:32.237259 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:32.237259 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 11:40:32.237259 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 11:40:32.237259 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 11:40:32.237259 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 11:40:32.238236 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:32.238236 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:32.238236 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:40:32.238236 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:40:32.238236 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:40:32.238236 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:40:32.238236 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:40:32.238236 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:40:32.238236 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:40:32.238236 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:40:32.238236 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:40:32.238236 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:40:32.238236 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:40:32.238236 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:40:32.238236 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:40:32.238236 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:40:32.238236 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 11:40:32.239146 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 11:40:32.239146 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:40:32.239146 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:40:32.239146 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 295/583] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Oct 4 11:40:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:40:32.239372 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b27836-aef7-4ce5-8e71-1e7a10b2b721 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:32.250859 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fc0a75-7d52-4ad3-a7ab-2448d9276e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:32.251557 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fc0a75-7d52-4ad3-a7ab-2448d9276e65 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:32.251846 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fc0a75-7d52-4ad3-a7ab-2448d9276e65 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:32.252124 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fc0a75-7d52-4ad3-a7ab-2448d9276e65 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:32.252904 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fc0a75-7d52-4ad3-a7ab-2448d9276e65 None admin] RBAC: Adding query filter params (role.id=01769bbdbd2e48f2bf8e855ba6a8507e, scope.project.id=39913dbe3e984f27a61493dd75381501, user.id=1605c3e03b7a4bcba4e19f0d92c671bc) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:32.253218 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fc0a75-7d52-4ad3-a7ab-2448d9276e65 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:32.254645 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fc0a75-7d52-4ad3-a7ab-2448d9276e65 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:32.260893 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 289/584] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Oct 4 11:40:32 2022] GET /identity/v3/role_assignments?user.id=1605c3e03b7a4bcba4e19f0d92c671bc&scope.project.id=39913dbe3e984f27a61493dd75381501&role.id=01769bbdbd2e48f2bf8e855ba6a8507e => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:32.261515 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fc0a75-7d52-4ad3-a7ab-2448d9276e65 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:32.316786 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:32.375483 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b27836-aef7-4ce5-8e71-1e7a10b2b721 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:32.403714 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:32.410844 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fc0a75-7d52-4ad3-a7ab-2448d9276e65 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:32.418695 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f6f409-046c-4829-8e3d-a230ed8da4d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:32.419350 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f6f409-046c-4829-8e3d-a230ed8da4d5 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:32.422951 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f6f409-046c-4829-8e3d-a230ed8da4d5 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:32.422951 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f6f409-046c-4829-8e3d-a230ed8da4d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:32.437897 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f6f409-046c-4829-8e3d-a230ed8da4d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:32.437897 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f6f409-046c-4829-8e3d-a230ed8da4d5 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:32.457948 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-d5f6f409-046c-4829-8e3d-a230ed8da4d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:40:32.457948 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:32.457948 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:32.457948 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:32.457948 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:32.457948 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:32.457948 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:32.457948 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:32.457948 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:32.457948 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:32.457948 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:32.457948 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:32.457948 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 11:40:32.457948 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 11:40:32.457948 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 11:40:32.457948 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 11:40:32.459183 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:32.459183 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:32.459183 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:40:32.459183 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:40:32.459183 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:40:32.459183 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:40:32.459183 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:40:32.459183 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:40:32.459183 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:40:32.459183 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:40:32.459183 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:40:32.459183 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:40:32.459183 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:40:32.459183 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:40:32.459183 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:40:32.459183 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:40:32.459183 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 11:40:32.460304 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 11:40:32.460304 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:40:32.460304 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:40:32.466563 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 296/585] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Oct 4 11:40:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:40:32.466563 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f6f409-046c-4829-8e3d-a230ed8da4d5 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:32.476845 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33150466-b1bb-49ed-9d12-cc61c8caff85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:32.477625 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33150466-b1bb-49ed-9d12-cc61c8caff85 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:32.478003 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33150466-b1bb-49ed-9d12-cc61c8caff85 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:32.478778 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33150466-b1bb-49ed-9d12-cc61c8caff85 None admin] PATH_INFO: `/v3/users` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:32.479621 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33150466-b1bb-49ed-9d12-cc61c8caff85 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:32.480023 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33150466-b1bb-49ed-9d12-cc61c8caff85 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:32.482301 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33150466-b1bb-49ed-9d12-cc61c8caff85 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:32.505438 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 290/586] 10.222.0.59 () {56 vars in 1137 bytes} [Tue Oct 4 11:40:32 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:32.506511 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33150466-b1bb-49ed-9d12-cc61c8caff85 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:32.580251 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f6f409-046c-4829-8e3d-a230ed8da4d5 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:32.582676 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:32.622906 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd9acf4-6f7f-4ac4-99f5-de98ac1ea494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:32.623752 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd9acf4-6f7f-4ac4-99f5-de98ac1ea494 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:32.624426 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd9acf4-6f7f-4ac4-99f5-de98ac1ea494 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:32.624868 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd9acf4-6f7f-4ac4-99f5-de98ac1ea494 None admin] PATH_INFO: `/v3/domains` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:32.626105 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd9acf4-6f7f-4ac4-99f5-de98ac1ea494 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:32.626816 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd9acf4-6f7f-4ac4-99f5-de98ac1ea494 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:32.629505 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd9acf4-6f7f-4ac4-99f5-de98ac1ea494 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:32.632903 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33150466-b1bb-49ed-9d12-cc61c8caff85 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:32.643897 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 297/587] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Oct 4 11:40:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:32.645035 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd9acf4-6f7f-4ac4-99f5-de98ac1ea494 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:32.680774 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fefc874-ca57-4abf-a835-35aaab3c21f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:32.681642 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fefc874-ca57-4abf-a835-35aaab3c21f1 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:32.682086 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fefc874-ca57-4abf-a835-35aaab3c21f1 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:32.682487 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fefc874-ca57-4abf-a835-35aaab3c21f1 None admin] PATH_INFO: `/v3/domains` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:32.683270 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fefc874-ca57-4abf-a835-35aaab3c21f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:32.683880 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fefc874-ca57-4abf-a835-35aaab3c21f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:32.685997 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fefc874-ca57-4abf-a835-35aaab3c21f1 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:32.700461 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 291/588] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Oct 4 11:40:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:32.701891 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fefc874-ca57-4abf-a835-35aaab3c21f1 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:32.723323 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:32.767180 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd9acf4-6f7f-4ac4-99f5-de98ac1ea494 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:32.806733 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8091ad-df31-46a2-b2c3-ca165804ee80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:32.807843 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8091ad-df31-46a2-b2c3-ca165804ee80 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:32.808286 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8091ad-df31-46a2-b2c3-ca165804ee80 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:32.808969 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8091ad-df31-46a2-b2c3-ca165804ee80 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:32.819450 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fefc874-ca57-4abf-a835-35aaab3c21f1 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:32.822937 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8091ad-df31-46a2-b2c3-ca165804ee80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:32.824113 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8091ad-df31-46a2-b2c3-ca165804ee80 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:32.839446 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-bd8091ad-df31-46a2-b2c3-ca165804ee80 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:40:32.839446 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:32.839446 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:32.839446 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:32.839446 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:32.839446 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:32.839446 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:32.839446 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:32.839446 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:32.839446 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:32.839446 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:32.839446 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:32.839446 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 11:40:32.839446 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 11:40:32.839446 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 11:40:32.839446 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 11:40:32.840460 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:32.840460 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:32.840460 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:40:32.840460 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:40:32.840460 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:40:32.840460 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:40:32.840460 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:40:32.840460 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:40:32.840460 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:40:32.840460 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:40:32.840460 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:40:32.840460 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:40:32.840460 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:40:32.840460 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:40:32.840460 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:40:32.840460 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:40:32.840460 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 11:40:32.841401 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 11:40:32.841401 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:40:32.841401 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:40:32.845183 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 298/589] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Oct 4 11:40:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:40:32.846027 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8091ad-df31-46a2-b2c3-ca165804ee80 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:32.863005 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee24961-d5a6-4426-b446-934deb173c28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:32.864445 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee24961-d5a6-4426-b446-934deb173c28 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:32.865468 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee24961-d5a6-4426-b446-934deb173c28 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:32.865888 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee24961-d5a6-4426-b446-934deb173c28 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:32.867814 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:32.876854 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee24961-d5a6-4426-b446-934deb173c28 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:32.878672 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee24961-d5a6-4426-b446-934deb173c28 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:32.891118 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-cee24961-d5a6-4426-b446-934deb173c28 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 04 11:40:32.891118 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:32.891118 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:32.891118 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:32.891118 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:32.891118 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:32.891118 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:32.891118 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:32.891118 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:32.891118 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:32.891118 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:32.891118 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:32.891118 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 11:40:32.891118 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 11:40:32.891118 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 11:40:32.891118 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 11:40:32.892372 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:32.892372 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:32.892372 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 11:40:32.892372 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 11:40:32.892372 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 11:40:32.892372 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 11:40:32.892372 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:40:32.892372 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:40:32.892372 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:40:32.892372 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:40:32.892372 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:40:32.892372 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:40:32.892372 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:40:32.892372 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:40:32.892372 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:40:32.892372 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:40:32.892372 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:40:32.892372 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:40:32.894088 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:40:32.894088 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:40:32.894088 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 11:40:32.894088 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 11:40:32.894088 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 11:40:32.894088 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 11:40:32.894088 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 11:40:32.894088 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 11:40:32.894088 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 04 11:40:32.894088 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:40:32.896173 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 292/590] 10.222.0.59 () {56 vars in 1102 bytes} [Tue Oct 4 11:40:32 2022] GET /identity/v3/users/neutron => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:40:32.897112 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee24961-d5a6-4426-b446-934deb173c28 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:32.989947 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:33.014652 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee24961-d5a6-4426-b446-934deb173c28 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:33.022544 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8091ad-df31-46a2-b2c3-ca165804ee80 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:33.055970 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601c0c81-4e10-47f5-8a1a-decb91807daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:33.056847 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601c0c81-4e10-47f5-8a1a-decb91807daf None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:33.057261 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601c0c81-4e10-47f5-8a1a-decb91807daf None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:33.057676 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601c0c81-4e10-47f5-8a1a-decb91807daf None admin] PATH_INFO: `/v3/domains` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:33.058470 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601c0c81-4e10-47f5-8a1a-decb91807daf None admin] RBAC: Adding query filter params (name=Default) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:33.058913 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601c0c81-4e10-47f5-8a1a-decb91807daf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:33.060409 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601c0c81-4e10-47f5-8a1a-decb91807daf None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:33.069897 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48326217-92a8-4ce7-8014-d57c98847c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:33.071200 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48326217-92a8-4ce7-8014-d57c98847c07 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:33.071596 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48326217-92a8-4ce7-8014-d57c98847c07 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:33.072198 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48326217-92a8-4ce7-8014-d57c98847c07 None admin] PATH_INFO: `/v3/users/glance` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:33.078786 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 293/591] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Oct 4 11:40:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:33.079891 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601c0c81-4e10-47f5-8a1a-decb91807daf None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:33.080557 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48326217-92a8-4ce7-8014-d57c98847c07 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:33.082826 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48326217-92a8-4ce7-8014-d57c98847c07 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:33.099650 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-48326217-92a8-4ce7-8014-d57c98847c07 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 04 11:40:33.099650 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:33.099650 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:33.099650 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:33.099650 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:33.099650 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:33.099650 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:33.099650 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:33.099650 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:33.099650 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:33.099650 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:33.099650 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:33.099650 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 11:40:33.099650 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 11:40:33.099650 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 11:40:33.099650 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 11:40:33.100877 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:33.100877 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:33.100877 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 11:40:33.100877 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 11:40:33.100877 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 11:40:33.100877 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 11:40:33.100877 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:40:33.100877 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:40:33.100877 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:40:33.100877 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:40:33.100877 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:40:33.100877 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:40:33.100877 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:40:33.100877 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:40:33.100877 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:40:33.100877 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:40:33.100877 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:40:33.100877 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:40:33.102042 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:40:33.102042 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:40:33.102042 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 11:40:33.102042 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 11:40:33.102042 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 11:40:33.102042 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 11:40:33.102042 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 11:40:33.102042 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 11:40:33.102042 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 04 11:40:33.102042 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:40:33.104674 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 299/592] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Oct 4 11:40:32 2022] GET /identity/v3/users/glance => generated 84 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:40:33.105772 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48326217-92a8-4ce7-8014-d57c98847c07 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:33.200013 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:33.209477 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601c0c81-4e10-47f5-8a1a-decb91807daf None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:33.225676 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48326217-92a8-4ce7-8014-d57c98847c07 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:33.258772 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bb8b14-f8c4-4825-bda0-7e17bc77d44d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:33.259619 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bb8b14-f8c4-4825-bda0-7e17bc77d44d None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:33.260049 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bb8b14-f8c4-4825-bda0-7e17bc77d44d None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:33.260394 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bb8b14-f8c4-4825-bda0-7e17bc77d44d None admin] PATH_INFO: `/v3/users` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:33.261216 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bb8b14-f8c4-4825-bda0-7e17bc77d44d None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:33.261588 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bb8b14-f8c4-4825-bda0-7e17bc77d44d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:33.263290 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bb8b14-f8c4-4825-bda0-7e17bc77d44d None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:33.263990 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5b6d69-c01a-4d50-8109-5c09df3c4ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:33.264840 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5b6d69-c01a-4d50-8109-5c09df3c4ade None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:33.265321 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5b6d69-c01a-4d50-8109-5c09df3c4ade None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:33.265788 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5b6d69-c01a-4d50-8109-5c09df3c4ade None admin] PATH_INFO: `/v3/projects/service` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:33.266145 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:33.273338 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5b6d69-c01a-4d50-8109-5c09df3c4ade None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:33.276637 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5b6d69-c01a-4d50-8109-5c09df3c4ade None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:33.287427 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-bb5b6d69-c01a-4d50-8109-5c09df3c4ade None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 11:40:33.287427 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:33.287427 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:33.287427 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:33.287427 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:33.287427 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:33.287427 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:33.287427 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:33.287427 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:33.287427 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:33.287427 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:33.287427 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:33.287427 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 11:40:33.287427 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 11:40:33.287427 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 11:40:33.288378 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 11:40:33.288378 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:33.288378 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:33.288378 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:40:33.288378 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:40:33.288378 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:40:33.288378 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:40:33.288378 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:40:33.288378 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:40:33.288378 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:40:33.288378 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:40:33.288378 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:40:33.288378 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:40:33.288378 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:40:33.288378 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:40:33.288378 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:40:33.288378 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:40:33.289355 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 11:40:33.289355 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 11:40:33.289355 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 11:40:33.289355 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 11:40:33.289355 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 11:40:33.289355 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 11:40:33.289355 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 11:40:33.289355 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:40:33.289805 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 294/593] 10.222.0.59 () {56 vars in 1139 bytes} [Tue Oct 4 11:40:33 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:33.289805 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bb8b14-f8c4-4825-bda0-7e17bc77d44d None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:33.291625 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 300/594] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Oct 4 11:40:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:40:33.292587 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5b6d69-c01a-4d50-8109-5c09df3c4ade None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:33.408294 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5b6d69-c01a-4d50-8109-5c09df3c4ade None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:33.417017 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bb8b14-f8c4-4825-bda0-7e17bc77d44d None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:33.445363 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78161861-2de3-47b8-828e-60739cf69676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:33.446384 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78161861-2de3-47b8-828e-60739cf69676 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:33.446866 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78161861-2de3-47b8-828e-60739cf69676 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:33.447346 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78161861-2de3-47b8-828e-60739cf69676 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:33.450385 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:33.458448 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab88b12-306a-4502-a375-ca1be026787b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:33.459250 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab88b12-306a-4502-a375-ca1be026787b None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:33.459674 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab88b12-306a-4502-a375-ca1be026787b None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:33.460114 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab88b12-306a-4502-a375-ca1be026787b None admin] PATH_INFO: `/v3/users` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:33.460379 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78161861-2de3-47b8-828e-60739cf69676 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:33.461161 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab88b12-306a-4502-a375-ca1be026787b None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:33.461610 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab88b12-306a-4502-a375-ca1be026787b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:33.462231 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78161861-2de3-47b8-828e-60739cf69676 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:33.463376 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab88b12-306a-4502-a375-ca1be026787b None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:33.477760 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-78161861-2de3-47b8-828e-60739cf69676 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:40:33.477760 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:33.477760 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:33.477760 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:33.477760 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:33.477760 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:33.477760 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:33.477760 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:33.477760 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:33.477760 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:33.477760 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:33.477760 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:33.477760 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 11:40:33.477760 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 11:40:33.477760 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 11:40:33.477760 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 11:40:33.478994 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:33.478994 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:33.478994 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:40:33.478994 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:40:33.478994 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:40:33.478994 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:40:33.478994 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:40:33.478994 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:40:33.478994 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:40:33.478994 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:40:33.478994 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:40:33.478994 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:40:33.478994 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:40:33.478994 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:40:33.478994 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:40:33.478994 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:40:33.478994 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 11:40:33.480112 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 11:40:33.480112 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:40:33.480112 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:40:33.485856 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 301/595] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Oct 4 11:40:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:40:33.485856 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78161861-2de3-47b8-828e-60739cf69676 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:33.492301 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 295/596] 10.222.0.59 () {56 vars in 1137 bytes} [Tue Oct 4 11:40:33 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:33.493418 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab88b12-306a-4502-a375-ca1be026787b None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:33.569019 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:33.624735 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78161861-2de3-47b8-828e-60739cf69676 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:33.629599 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab88b12-306a-4502-a375-ca1be026787b None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:33.664133 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8289271-2088-420e-a49f-534bb61b2fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:33.665120 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8289271-2088-420e-a49f-534bb61b2fcd None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:33.665547 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8289271-2088-420e-a49f-534bb61b2fcd None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:33.666009 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8289271-2088-420e-a49f-534bb61b2fcd None admin] PATH_INFO: `/v3/projects` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:33.667011 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8289271-2088-420e-a49f-534bb61b2fcd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:33.667459 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8289271-2088-420e-a49f-534bb61b2fcd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:33.669173 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8289271-2088-420e-a49f-534bb61b2fcd None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:33.672971 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15416206-3a27-4be3-8086-950e3a8e7e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:33.673975 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15416206-3a27-4be3-8086-950e3a8e7e74 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:33.674441 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15416206-3a27-4be3-8086-950e3a8e7e74 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:33.674971 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15416206-3a27-4be3-8086-950e3a8e7e74 None admin] PATH_INFO: `/v3/domains` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:33.676106 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15416206-3a27-4be3-8086-950e3a8e7e74 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:33.676626 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15416206-3a27-4be3-8086-950e3a8e7e74 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:33.679334 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15416206-3a27-4be3-8086-950e3a8e7e74 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:33.688111 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 302/597] 10.222.0.59 () {56 vars in 1148 bytes} [Tue Oct 4 11:40:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:33.689309 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8289271-2088-420e-a49f-534bb61b2fcd None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:33.694507 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 296/598] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Oct 4 11:40:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:33.705206 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15416206-3a27-4be3-8086-950e3a8e7e74 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:33.779672 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:33.837980 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15416206-3a27-4be3-8086-950e3a8e7e74 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:33.841519 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8289271-2088-420e-a49f-534bb61b2fcd None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:33.855674 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:33.877791 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cfa254-e909-455c-8ea7-1f7f73388328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:33.878157 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76a0841-1aa1-4847-81d4-0ebc048d9bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:33.878631 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cfa254-e909-455c-8ea7-1f7f73388328 None admin] REQUEST_METHOD: `PUT` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:33.878715 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76a0841-1aa1-4847-81d4-0ebc048d9bb0 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:33.878970 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cfa254-e909-455c-8ea7-1f7f73388328 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:33.879066 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76a0841-1aa1-4847-81d4-0ebc048d9bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:33.879139 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cfa254-e909-455c-8ea7-1f7f73388328 None admin] PATH_INFO: `/v3/projects/39913dbe3e984f27a61493dd75381501/users/6e2a05b782424ab2928b5864f1bfd556/roles/01769bbdbd2e48f2bf8e855ba6a8507e` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:33.879221 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76a0841-1aa1-4847-81d4-0ebc048d9bb0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:33.890476 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76a0841-1aa1-4847-81d4-0ebc048d9bb0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:33.892284 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76a0841-1aa1-4847-81d4-0ebc048d9bb0 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:33.895515 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cfa254-e909-455c-8ea7-1f7f73388328 None admin] RBAC: Authorizing `identity:create_grant(project_id=39913dbe3e984f27a61493dd75381501, user_id=6e2a05b782424ab2928b5864f1bfd556, role_id=01769bbdbd2e48f2bf8e855ba6a8507e)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:33.897134 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cfa254-e909-455c-8ea7-1f7f73388328 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:33.907784 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-f76a0841-1aa1-4847-81d4-0ebc048d9bb0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:40:33.907784 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:33.907784 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:33.907784 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:33.907784 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:33.907784 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:33.907784 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:33.907784 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:33.907784 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:33.907784 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:33.907784 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:33.907784 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:33.907784 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 11:40:33.907784 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 11:40:33.907784 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 11:40:33.907784 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 11:40:33.909640 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:33.909640 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:33.909640 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:40:33.909640 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:40:33.909640 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:40:33.909640 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:40:33.909640 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:40:33.909640 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:40:33.909640 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:40:33.909640 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:40:33.909640 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:40:33.909640 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:40:33.909640 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:40:33.909640 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:40:33.909640 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:40:33.909640 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:40:33.909640 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 11:40:33.910725 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 11:40:33.910725 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:40:33.910725 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:40:33.912739 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 303/599] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Oct 4 11:40:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:40:33.913679 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76a0841-1aa1-4847-81d4-0ebc048d9bb0 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:34.009005 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 297/600] 10.222.0.59 () {58 vars in 1439 bytes} [Tue Oct 4 11:40:33 2022] PUT /identity/v3/projects/39913dbe3e984f27a61493dd75381501/users/6e2a05b782424ab2928b5864f1bfd556/roles/01769bbdbd2e48f2bf8e855ba6a8507e => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 11:40:34.010644 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c739b3c-dcf7-4449-aa0c-4595c00a20e6 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:34.011074 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:34.011791 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c739b3c-dcf7-4449-aa0c-4595c00a20e6 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:34.012070 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c739b3c-dcf7-4449-aa0c-4595c00a20e6 None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:34.014350 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76a0841-1aa1-4847-81d4-0ebc048d9bb0 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:34.020468 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 298/601] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:40:34 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:40:34.028989 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c739b3c-dcf7-4449-aa0c-4595c00a20e6 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:34.072460 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783ba836-9018-4fd6-80bb-bcc5a0e0ceb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:34.073768 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783ba836-9018-4fd6-80bb-bcc5a0e0ceb2 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:34.074333 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783ba836-9018-4fd6-80bb-bcc5a0e0ceb2 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:34.074963 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783ba836-9018-4fd6-80bb-bcc5a0e0ceb2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:34.087904 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783ba836-9018-4fd6-80bb-bcc5a0e0ceb2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:34.089645 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783ba836-9018-4fd6-80bb-bcc5a0e0ceb2 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:34.107610 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-783ba836-9018-4fd6-80bb-bcc5a0e0ceb2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 11:40:34.107610 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:34.107610 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:34.107610 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:34.107610 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:34.107610 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:34.107610 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:34.107610 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:34.107610 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:34.107610 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:34.107610 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:34.107610 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:34.107610 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 11:40:34.107610 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 11:40:34.107610 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 11:40:34.108809 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 11:40:34.108809 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:34.108809 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:34.108809 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:40:34.108809 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:40:34.108809 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:40:34.108809 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:40:34.108809 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:40:34.108809 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:40:34.108809 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:40:34.108809 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:40:34.108809 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:40:34.108809 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:40:34.108809 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:40:34.108809 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:40:34.108809 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:40:34.108809 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:40:34.109891 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 11:40:34.109891 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 11:40:34.109891 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 11:40:34.109891 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 11:40:34.109891 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 11:40:34.109891 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 11:40:34.109891 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 11:40:34.109891 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:40:34.111641 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 304/602] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Oct 4 11:40:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:40:34.113831 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b3d0d7-5fa6-40db-aa5a-6b3837ebc3df None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:34.114187 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b3d0d7-5fa6-40db-aa5a-6b3837ebc3df None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:34.114686 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b3d0d7-5fa6-40db-aa5a-6b3837ebc3df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:34.140558 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-03b3d0d7-5fa6-40db-aa5a-6b3837ebc3df None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:40:34.142349 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-03b3d0d7-5fa6-40db-aa5a-6b3837ebc3df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:40:34.172084 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c739b3c-dcf7-4449-aa0c-4595c00a20e6 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:34.222058 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e517ccb1-9cc6-4f0d-9a3c-72b03768603a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:34.222684 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e517ccb1-9cc6-4f0d-9a3c-72b03768603a None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:34.222964 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e517ccb1-9cc6-4f0d-9a3c-72b03768603a None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:34.223293 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e517ccb1-9cc6-4f0d-9a3c-72b03768603a None admin] PATH_INFO: `/v3/domains` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:34.224064 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e517ccb1-9cc6-4f0d-9a3c-72b03768603a None admin] RBAC: Adding query filter params (name=Default) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:34.224822 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e517ccb1-9cc6-4f0d-9a3c-72b03768603a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:34.226299 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e517ccb1-9cc6-4f0d-9a3c-72b03768603a None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:34.238823 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 299/603] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Oct 4 11:40:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:34.239653 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e517ccb1-9cc6-4f0d-9a3c-72b03768603a None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:34.240227 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 305/604] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:40:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 11:40:34.256014 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b3d0d7-5fa6-40db-aa5a-6b3837ebc3df None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:34.266876 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:34.376981 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:34.388255 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b3d0d7-5fa6-40db-aa5a-6b3837ebc3df None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:34.409824 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e517ccb1-9cc6-4f0d-9a3c-72b03768603a None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:34.430724 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8a694c-e5c5-46f9-b468-033b32b9dd48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:34.431795 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8a694c-e5c5-46f9-b468-033b32b9dd48 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:34.432318 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8a694c-e5c5-46f9-b468-033b32b9dd48 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:34.432867 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8a694c-e5c5-46f9-b468-033b32b9dd48 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:34.440235 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8a694c-e5c5-46f9-b468-033b32b9dd48 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:34.442633 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8a694c-e5c5-46f9-b468-033b32b9dd48 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:34.459306 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-ed8a694c-e5c5-46f9-b468-033b32b9dd48 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 11:40:34.459306 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:34.459306 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:34.459306 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:34.459306 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:34.459306 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:34.459306 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:34.459306 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:34.459306 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:34.459306 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:34.459306 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:34.459306 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:34.459306 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 11:40:34.459306 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 11:40:34.459306 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 11:40:34.460236 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 11:40:34.460236 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:34.460236 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:34.460236 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:40:34.460236 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:40:34.460236 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:40:34.460236 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:40:34.460236 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:40:34.460236 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:40:34.460236 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:40:34.460236 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:40:34.460236 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:40:34.460236 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:40:34.460236 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:40:34.460236 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:40:34.460236 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:40:34.460236 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:40:34.461199 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 11:40:34.461199 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 11:40:34.461199 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 11:40:34.461199 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 11:40:34.461199 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 11:40:34.461199 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 11:40:34.461199 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 11:40:34.461199 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:40:34.474738 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 306/605] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Oct 4 11:40:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:40:34.477646 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8a694c-e5c5-46f9-b468-033b32b9dd48 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:34.488289 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90e9c24-95cd-4b30-89f9-28caf2a772f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:34.489335 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90e9c24-95cd-4b30-89f9-28caf2a772f2 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:34.489985 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90e9c24-95cd-4b30-89f9-28caf2a772f2 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:34.490506 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90e9c24-95cd-4b30-89f9-28caf2a772f2 None admin] PATH_INFO: `/v3/projects` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:34.491561 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90e9c24-95cd-4b30-89f9-28caf2a772f2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:34.492144 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90e9c24-95cd-4b30-89f9-28caf2a772f2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:34.494060 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90e9c24-95cd-4b30-89f9-28caf2a772f2 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:34.510270 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 300/606] 10.222.0.59 () {56 vars in 1148 bytes} [Tue Oct 4 11:40:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:34.520763 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90e9c24-95cd-4b30-89f9-28caf2a772f2 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:34.642964 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8a694c-e5c5-46f9-b468-033b32b9dd48 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:34.643731 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:34.667873 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90e9c24-95cd-4b30-89f9-28caf2a772f2 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:34.680236 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03c9df0-ffe3-4bee-a3c7-af26881eaf4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:34.681060 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03c9df0-ffe3-4bee-a3c7-af26881eaf4e None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:34.681404 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03c9df0-ffe3-4bee-a3c7-af26881eaf4e None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:34.681739 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03c9df0-ffe3-4bee-a3c7-af26881eaf4e None admin] PATH_INFO: `/v3/projects` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:34.682494 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03c9df0-ffe3-4bee-a3c7-af26881eaf4e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:34.682859 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03c9df0-ffe3-4bee-a3c7-af26881eaf4e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:34.684343 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03c9df0-ffe3-4bee-a3c7-af26881eaf4e None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:34.697199 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 307/607] 10.222.0.59 () {56 vars in 1148 bytes} [Tue Oct 4 11:40:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:34.702014 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03c9df0-ffe3-4bee-a3c7-af26881eaf4e None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:34.710075 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:34.710452 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a52a934-18a7-4203-90ac-c3ac6ec53a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:34.711161 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a52a934-18a7-4203-90ac-c3ac6ec53a3e None admin] REQUEST_METHOD: `PUT` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:34.711546 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a52a934-18a7-4203-90ac-c3ac6ec53a3e None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:34.711654 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a52a934-18a7-4203-90ac-c3ac6ec53a3e None admin] PATH_INFO: `/v3/projects/39913dbe3e984f27a61493dd75381501/users/e7289515c5c44914a19daa439de98cb1/roles/01769bbdbd2e48f2bf8e855ba6a8507e` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:34.727660 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a52a934-18a7-4203-90ac-c3ac6ec53a3e None admin] RBAC: Authorizing `identity:create_grant(project_id=39913dbe3e984f27a61493dd75381501, user_id=e7289515c5c44914a19daa439de98cb1, role_id=01769bbdbd2e48f2bf8e855ba6a8507e)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:34.729165 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a52a934-18a7-4203-90ac-c3ac6ec53a3e None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:34.800887 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03c9df0-ffe3-4bee-a3c7-af26881eaf4e None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:34.806360 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 301/608] 10.222.0.59 () {58 vars in 1439 bytes} [Tue Oct 4 11:40:34 2022] PUT /identity/v3/projects/39913dbe3e984f27a61493dd75381501/users/e7289515c5c44914a19daa439de98cb1/roles/01769bbdbd2e48f2bf8e855ba6a8507e => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 11:40:34.807609 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b8176-2106-4482-9efa-b2b811b2ad06 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:34.807899 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b8176-2106-4482-9efa-b2b811b2ad06 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:34.808179 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b8176-2106-4482-9efa-b2b811b2ad06 None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:34.814162 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 302/609] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:40:34 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:40:34.815804 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94b8176-2106-4482-9efa-b2b811b2ad06 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:34.847206 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845d3706-c210-4a35-b6c6-42ef2d61f8c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:34.847923 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845d3706-c210-4a35-b6c6-42ef2d61f8c6 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:34.848209 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845d3706-c210-4a35-b6c6-42ef2d61f8c6 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:34.848541 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845d3706-c210-4a35-b6c6-42ef2d61f8c6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:34.861242 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845d3706-c210-4a35-b6c6-42ef2d61f8c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 11:40:34.866278 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-845d3706-c210-4a35-b6c6-42ef2d61f8c6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 11:40:34.866278 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:34.866278 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:34.866278 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:34.866278 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:34.866278 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:34.866278 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:34.866278 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:34.866278 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:34.866278 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:34.866278 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:34.866278 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:34.866278 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 11:40:34.866278 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 11:40:34.866278 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 11:40:34.866278 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 11:40:34.867285 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 11:40:34.867285 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 11:40:34.867285 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 11:40:34.867285 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 11:40:34.867285 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:34.867285 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:34.867285 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:40:34.867285 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:40:34.867285 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:40:34.867285 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:40:34.867285 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:40:34.867285 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:40:34.867285 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:40:34.867285 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:40:34.867285 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:40:34.867285 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:40:34.868127 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:40:34.868127 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:40:34.868127 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:40:34.868127 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:40:34.868127 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 11:40:34.868127 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 11:40:34.868127 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 11:40:34.868127 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 11:40:34.868127 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 11:40:34.868127 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 11:40:34.868127 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 11:40:34.868127 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:40:34.868127 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 308/610] 10.222.0.59 () {56 vars in 1102 bytes} [Tue Oct 4 11:40:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:40:34.868859 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5cc1a5-aa46-4d2b-a39c-1b7d3a9b005e None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:34.869073 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5cc1a5-aa46-4d2b-a39c-1b7d3a9b005e None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:34.869241 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5cc1a5-aa46-4d2b-a39c-1b7d3a9b005e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:34.889713 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-fb5cc1a5-aa46-4d2b-a39c-1b7d3a9b005e None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:40:34.890951 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-fb5cc1a5-aa46-4d2b-a39c-1b7d3a9b005e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:40:34.963899 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94b8176-2106-4482-9efa-b2b811b2ad06 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:34.965147 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:34.977011 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 309/611] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:40:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 11:40:34.977992 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5cc1a5-aa46-4d2b-a39c-1b7d3a9b005e None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:35.004672 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:35.010904 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2783773-195b-446f-a938-e2df8c2b4d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:35.012790 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2783773-195b-446f-a938-e2df8c2b4d24 None admin] REQUEST_METHOD: `PUT` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:35.013270 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2783773-195b-446f-a938-e2df8c2b4d24 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:35.014393 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2783773-195b-446f-a938-e2df8c2b4d24 None admin] PATH_INFO: `/v3/projects/39913dbe3e984f27a61493dd75381501/users/d516d0755be84b7293156625df1b13b3/roles/01769bbdbd2e48f2bf8e855ba6a8507e` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:35.034874 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2783773-195b-446f-a938-e2df8c2b4d24 None admin] RBAC: Authorizing `identity:create_grant(project_id=39913dbe3e984f27a61493dd75381501, user_id=d516d0755be84b7293156625df1b13b3, role_id=01769bbdbd2e48f2bf8e855ba6a8507e)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:35.037278 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2783773-195b-446f-a938-e2df8c2b4d24 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:35.138455 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 303/612] 10.222.0.59 () {58 vars in 1439 bytes} [Tue Oct 4 11:40:34 2022] PUT /identity/v3/projects/39913dbe3e984f27a61493dd75381501/users/d516d0755be84b7293156625df1b13b3/roles/01769bbdbd2e48f2bf8e855ba6a8507e => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 11:40:35.140124 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5cc1a5-aa46-4d2b-a39c-1b7d3a9b005e None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:35.179934 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5339606a-a37f-41dd-b244-37543133b642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:35.180934 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5339606a-a37f-41dd-b244-37543133b642 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:35.181474 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5339606a-a37f-41dd-b244-37543133b642 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:35.181940 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5339606a-a37f-41dd-b244-37543133b642 None admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:35.182804 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5339606a-a37f-41dd-b244-37543133b642 None admin] RBAC: Adding query filter params (name=service) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:35.183327 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5339606a-a37f-41dd-b244-37543133b642 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:35.184995 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5339606a-a37f-41dd-b244-37543133b642 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:35.195443 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 310/613] 10.222.0.59 () {56 vars in 1103 bytes} [Tue Oct 4 11:40:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:35.201158 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2783773-195b-446f-a938-e2df8c2b4d24 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:35.329832 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2783773-195b-446f-a938-e2df8c2b4d24 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:35.338604 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5339606a-a37f-41dd-b244-37543133b642 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:35.367523 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131c75ed-362a-4370-bfb5-98b1e200c12e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:35.368218 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131c75ed-362a-4370-bfb5-98b1e200c12e None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:35.368501 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131c75ed-362a-4370-bfb5-98b1e200c12e None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:35.368809 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131c75ed-362a-4370-bfb5-98b1e200c12e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:35.380258 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131c75ed-362a-4370-bfb5-98b1e200c12e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:35.381747 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131c75ed-362a-4370-bfb5-98b1e200c12e None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:35.411551 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-131c75ed-362a-4370-bfb5-98b1e200c12e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:40:35.411551 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:35.411551 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:35.411551 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:35.411551 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:35.411551 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:35.411551 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:35.411551 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:35.411551 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:35.411551 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:35.411551 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:35.411551 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:35.411551 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 11:40:35.411551 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 11:40:35.411551 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 11:40:35.411551 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 11:40:35.412522 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:35.412522 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:35.412522 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:40:35.412522 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:40:35.412522 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:40:35.412522 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:40:35.412522 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:40:35.412522 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:40:35.412522 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:40:35.412522 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:40:35.412522 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:40:35.412522 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:40:35.412522 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:40:35.412522 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:40:35.412522 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:40:35.412522 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:40:35.412522 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 11:40:35.413470 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 11:40:35.413470 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:40:35.413470 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:40:35.413470 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 304/614] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Oct 4 11:40:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:40:35.418875 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131c75ed-362a-4370-bfb5-98b1e200c12e None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:35.432454 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:35.485979 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:35.509997 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5339606a-a37f-41dd-b244-37543133b642 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:35.572290 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca86984-a3c6-47aa-aee3-43070d911e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:35.572952 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca86984-a3c6-47aa-aee3-43070d911e7a None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:35.573224 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca86984-a3c6-47aa-aee3-43070d911e7a None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:35.573491 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca86984-a3c6-47aa-aee3-43070d911e7a None admin] PATH_INFO: `/v3/roles/service` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:35.591080 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131c75ed-362a-4370-bfb5-98b1e200c12e None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:35.594065 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca86984-a3c6-47aa-aee3-43070d911e7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 11:40:35.600204 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-dca86984-a3c6-47aa-aee3-43070d911e7a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 11:40:35.600204 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:35.600204 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:35.600204 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:35.600204 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:35.600204 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:35.600204 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:35.600204 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:35.600204 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:35.600204 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:35.600204 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:35.600204 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:35.600204 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 11:40:35.600204 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 11:40:35.600204 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 11:40:35.600204 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 11:40:35.601198 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 11:40:35.601198 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 11:40:35.601198 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 11:40:35.601198 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 11:40:35.601198 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:35.601198 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:35.601198 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:40:35.601198 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:40:35.601198 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:40:35.601198 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:40:35.601198 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:40:35.601198 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:40:35.601198 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:40:35.601198 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:40:35.601198 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:40:35.601198 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:40:35.602038 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:40:35.602038 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:40:35.602038 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:40:35.602038 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:40:35.602038 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 11:40:35.602038 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 11:40:35.602038 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 11:40:35.602038 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 11:40:35.602038 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 11:40:35.602038 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 11:40:35.602038 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 11:40:35.602038 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:40:35.610177 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 311/615] 10.222.0.59 () {56 vars in 1102 bytes} [Tue Oct 4 11:40:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 11:40:35.613805 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca86984-a3c6-47aa-aee3-43070d911e7a None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:35.656046 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cd3140-21b3-424f-93a9-685d4d8bcced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:35.656670 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cd3140-21b3-424f-93a9-685d4d8bcced None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:35.656950 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cd3140-21b3-424f-93a9-685d4d8bcced None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:35.657220 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cd3140-21b3-424f-93a9-685d4d8bcced None admin] PATH_INFO: `/v3/domains` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:35.657857 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cd3140-21b3-424f-93a9-685d4d8bcced None admin] RBAC: Adding query filter params (name=Default) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:35.658157 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cd3140-21b3-424f-93a9-685d4d8bcced None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:35.660524 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cd3140-21b3-424f-93a9-685d4d8bcced None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:35.673074 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 305/616] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Oct 4 11:40:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 11:40:35.682114 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cd3140-21b3-424f-93a9-685d4d8bcced None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:35.813775 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca86984-a3c6-47aa-aee3-43070d911e7a None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:35.838912 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:35.844723 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:35.852479 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c864ee-b787-4f05-8c62-b8c8e1d12e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:35.854464 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c864ee-b787-4f05-8c62-b8c8e1d12e2d None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:35.854464 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c864ee-b787-4f05-8c62-b8c8e1d12e2d None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:35.854464 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c864ee-b787-4f05-8c62-b8c8e1d12e2d None admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:35.855200 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c864ee-b787-4f05-8c62-b8c8e1d12e2d None admin] RBAC: Adding query filter params (name=service) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:35.855686 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c864ee-b787-4f05-8c62-b8c8e1d12e2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:35.856461 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cd3140-21b3-424f-93a9-685d4d8bcced None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:35.857487 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c864ee-b787-4f05-8c62-b8c8e1d12e2d None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:35.868222 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 312/617] 10.222.0.59 () {56 vars in 1103 bytes} [Tue Oct 4 11:40:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:35.873595 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c864ee-b787-4f05-8c62-b8c8e1d12e2d None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:35.934017 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bb2d9a-c970-4a58-a0dd-5e6a4ea86018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:35.934512 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bb2d9a-c970-4a58-a0dd-5e6a4ea86018 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:35.934793 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bb2d9a-c970-4a58-a0dd-5e6a4ea86018 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:35.935057 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bb2d9a-c970-4a58-a0dd-5e6a4ea86018 None admin] PATH_INFO: `/v3/users/nova` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:35.957066 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bb2d9a-c970-4a58-a0dd-5e6a4ea86018 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:35.960627 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bb2d9a-c970-4a58-a0dd-5e6a4ea86018 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:35.985631 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-40bb2d9a-c970-4a58-a0dd-5e6a4ea86018 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 04 11:40:35.985631 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:35.985631 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:35.985631 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:35.985631 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:35.985631 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:35.985631 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:35.985631 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:35.985631 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:35.985631 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:35.985631 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:35.985631 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:35.985631 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 11:40:35.985631 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 11:40:35.985631 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 11:40:35.985631 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 11:40:35.986683 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:35.986683 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:35.986683 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 11:40:35.986683 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 11:40:35.986683 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 11:40:35.986683 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 11:40:35.986683 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:40:35.986683 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:40:35.986683 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:40:35.986683 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:40:35.986683 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:40:35.986683 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:40:35.986683 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:40:35.986683 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:40:35.986683 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:40:35.986683 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:40:35.986683 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:40:35.986683 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:40:35.988237 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:40:35.988237 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:40:35.988237 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 11:40:35.988237 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 11:40:35.988237 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 11:40:35.988237 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 11:40:35.988237 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 11:40:35.988237 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 11:40:35.988237 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 04 11:40:35.988237 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:40:35.995913 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 306/618] 10.222.0.59 () {56 vars in 1093 bytes} [Tue Oct 4 11:40:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:40:36.000055 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bb2d9a-c970-4a58-a0dd-5e6a4ea86018 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:36.027310 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c864ee-b787-4f05-8c62-b8c8e1d12e2d None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:36.100931 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b158309-b7f8-4591-94c7-85553bc6feeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:36.101965 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b158309-b7f8-4591-94c7-85553bc6feeb None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:36.102475 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b158309-b7f8-4591-94c7-85553bc6feeb None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:36.102946 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b158309-b7f8-4591-94c7-85553bc6feeb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:36.119812 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b158309-b7f8-4591-94c7-85553bc6feeb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:36.122950 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b158309-b7f8-4591-94c7-85553bc6feeb None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:36.144027 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-1b158309-b7f8-4591-94c7-85553bc6feeb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:40:36.144027 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:36.144027 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:36.144027 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:36.144027 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:36.144027 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:36.144027 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:36.144027 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:36.144027 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:36.144027 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:36.144027 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:36.144027 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:36.144027 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 11:40:36.144027 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 11:40:36.144027 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 11:40:36.144027 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 11:40:36.145152 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:36.145152 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:36.145152 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:40:36.145152 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:40:36.145152 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:40:36.145152 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:40:36.145152 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:40:36.145152 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:40:36.145152 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:40:36.145152 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:40:36.145152 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:40:36.145152 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:40:36.145152 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:40:36.145152 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:40:36.145152 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:40:36.145152 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:40:36.145152 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 11:40:36.146082 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 11:40:36.146082 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:40:36.146082 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:40:36.152200 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 313/619] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Oct 4 11:40:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:40:36.156477 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b158309-b7f8-4591-94c7-85553bc6feeb None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:36.194541 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bb2d9a-c970-4a58-a0dd-5e6a4ea86018 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:36.226577 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:36.243234 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba43796-29b1-493c-95fc-6ce4c13fa3e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:36.244228 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba43796-29b1-493c-95fc-6ce4c13fa3e5 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:36.244766 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba43796-29b1-493c-95fc-6ce4c13fa3e5 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:36.245275 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba43796-29b1-493c-95fc-6ce4c13fa3e5 None admin] PATH_INFO: `/v3/users` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:36.246226 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba43796-29b1-493c-95fc-6ce4c13fa3e5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:36.246754 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba43796-29b1-493c-95fc-6ce4c13fa3e5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:36.248380 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba43796-29b1-493c-95fc-6ce4c13fa3e5 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:36.285876 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 307/620] 10.222.0.59 () {56 vars in 1133 bytes} [Tue Oct 4 11:40:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:36.291653 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba43796-29b1-493c-95fc-6ce4c13fa3e5 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:36.320003 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:36.365136 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b158309-b7f8-4591-94c7-85553bc6feeb None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:36.414654 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9310b990-ec14-4ef5-9e59-2d6b05b8777e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:36.415416 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9310b990-ec14-4ef5-9e59-2d6b05b8777e None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:36.415796 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9310b990-ec14-4ef5-9e59-2d6b05b8777e None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:36.416191 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9310b990-ec14-4ef5-9e59-2d6b05b8777e None admin] PATH_INFO: `/v3/domains` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:36.420568 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9310b990-ec14-4ef5-9e59-2d6b05b8777e None admin] RBAC: Adding query filter params (name=Default) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:36.420568 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9310b990-ec14-4ef5-9e59-2d6b05b8777e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:36.420568 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9310b990-ec14-4ef5-9e59-2d6b05b8777e None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:36.431373 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 314/621] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Oct 4 11:40:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:36.436830 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9310b990-ec14-4ef5-9e59-2d6b05b8777e None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:36.488814 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba43796-29b1-493c-95fc-6ce4c13fa3e5 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:36.528395 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc920a24-0b50-409d-bdcb-f315e2397fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:36.531409 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc920a24-0b50-409d-bdcb-f315e2397fc6 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:36.531812 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc920a24-0b50-409d-bdcb-f315e2397fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:36.532244 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc920a24-0b50-409d-bdcb-f315e2397fc6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:36.576020 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:36.582852 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9310b990-ec14-4ef5-9e59-2d6b05b8777e None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:36.620448 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc920a24-0b50-409d-bdcb-f315e2397fc6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:36.621928 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc920a24-0b50-409d-bdcb-f315e2397fc6 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:36.623989 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23be7b0-fc1c-49fc-a63e-0c2a2c2de106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:36.624797 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23be7b0-fc1c-49fc-a63e-0c2a2c2de106 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:36.625231 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23be7b0-fc1c-49fc-a63e-0c2a2c2de106 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:36.625650 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23be7b0-fc1c-49fc-a63e-0c2a2c2de106 None admin] PATH_INFO: `/v3/users/swift` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:36.633335 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23be7b0-fc1c-49fc-a63e-0c2a2c2de106 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:36.635056 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23be7b0-fc1c-49fc-a63e-0c2a2c2de106 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:36.637666 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:36.648130 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-d23be7b0-fc1c-49fc-a63e-0c2a2c2de106 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 04 11:40:36.648130 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:36.648130 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:36.648130 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:36.648130 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:36.648130 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:36.648130 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:36.648130 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:36.648130 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:36.648130 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:36.648130 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:36.648130 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:36.648130 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 11:40:36.648130 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 11:40:36.648130 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 11:40:36.648130 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 11:40:36.652496 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:36.652496 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:36.652496 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 11:40:36.652496 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 11:40:36.652496 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 11:40:36.652496 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 11:40:36.652496 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:40:36.652496 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:40:36.652496 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:40:36.652496 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:40:36.652496 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:40:36.652496 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:40:36.652496 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:40:36.652496 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:40:36.652496 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:40:36.652496 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:40:36.652496 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:40:36.652496 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:40:36.653555 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:40:36.653555 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:40:36.653555 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 11:40:36.653555 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 11:40:36.653555 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 11:40:36.653555 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 11:40:36.653555 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 11:40:36.653555 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 11:40:36.653555 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 04 11:40:36.653555 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:40:36.653555 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 315/622] 10.222.0.59 () {56 vars in 1096 bytes} [Tue Oct 4 11:40:36 2022] GET /identity/v3/users/swift => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:40:36.653555 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f544a02f-b01e-4791-b930-72b98a1a83e3 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:36.653555 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f544a02f-b01e-4791-b930-72b98a1a83e3 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:36.654286 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f544a02f-b01e-4791-b930-72b98a1a83e3 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:36.655895 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 316/623] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:40:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:40:36.656799 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f544a02f-b01e-4791-b930-72b98a1a83e3 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:36.756775 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 308/624] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Oct 4 11:40:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 11:40:36.758331 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aab69a5-22f6-4c97-a67c-0ff2782b74af None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:36.758761 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aab69a5-22f6-4c97-a67c-0ff2782b74af None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:36.759183 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aab69a5-22f6-4c97-a67c-0ff2782b74af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:36.772535 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f544a02f-b01e-4791-b930-72b98a1a83e3 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:36.780512 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-4aab69a5-22f6-4c97-a67c-0ff2782b74af None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:40:36.781888 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-4aab69a5-22f6-4c97-a67c-0ff2782b74af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:40:36.818849 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129daaef-1125-46a3-9a39-407c244ee4f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:36.819638 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129daaef-1125-46a3-9a39-407c244ee4f0 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:36.819933 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129daaef-1125-46a3-9a39-407c244ee4f0 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:36.820192 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129daaef-1125-46a3-9a39-407c244ee4f0 None admin] PATH_INFO: `/v3/users` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:36.821354 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129daaef-1125-46a3-9a39-407c244ee4f0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:36.821907 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129daaef-1125-46a3-9a39-407c244ee4f0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:36.823375 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129daaef-1125-46a3-9a39-407c244ee4f0 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:36.846610 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 317/625] 10.222.0.59 () {56 vars in 1135 bytes} [Tue Oct 4 11:40:36 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:36.847832 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129daaef-1125-46a3-9a39-407c244ee4f0 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:36.865288 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:36.868103 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 309/626] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:40:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 11:40:36.869105 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aab69a5-22f6-4c97-a67c-0ff2782b74af None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:36.916980 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:36.980571 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aab69a5-22f6-4c97-a67c-0ff2782b74af None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:37.018758 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de01059-3893-4c67-acf5-8708fdddcd7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:37.019721 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de01059-3893-4c67-acf5-8708fdddcd7e None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:37.020139 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de01059-3893-4c67-acf5-8708fdddcd7e None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:37.020547 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de01059-3893-4c67-acf5-8708fdddcd7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:37.033036 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de01059-3893-4c67-acf5-8708fdddcd7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:37.035654 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de01059-3893-4c67-acf5-8708fdddcd7e None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:37.040667 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129daaef-1125-46a3-9a39-407c244ee4f0 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:37.052512 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-0de01059-3893-4c67-acf5-8708fdddcd7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:40:37.052512 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:37.052512 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:37.052512 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:37.052512 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:37.052512 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:37.052512 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:37.052512 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:37.052512 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:37.052512 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:37.052512 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:37.052512 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:37.052512 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 11:40:37.052512 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 11:40:37.052512 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 11:40:37.052512 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 11:40:37.053693 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:37.053693 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:37.053693 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:40:37.053693 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:40:37.053693 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:40:37.053693 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:40:37.053693 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:40:37.053693 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:40:37.053693 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:40:37.053693 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:40:37.053693 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:40:37.053693 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:40:37.053693 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:40:37.053693 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:40:37.053693 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:40:37.053693 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:40:37.053693 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 11:40:37.054770 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 11:40:37.054770 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:40:37.054770 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:40:37.056493 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 310/627] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Oct 4 11:40:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:40:37.061621 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de01059-3893-4c67-acf5-8708fdddcd7e None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:37.172834 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de01059-3893-4c67-acf5-8708fdddcd7e None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:37.176173 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a52ded-8448-4859-ac6f-79e01580503c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:37.176971 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a52ded-8448-4859-ac6f-79e01580503c None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:37.177354 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a52ded-8448-4859-ac6f-79e01580503c None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:37.177729 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a52ded-8448-4859-ac6f-79e01580503c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:37.207988 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a52ded-8448-4859-ac6f-79e01580503c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:37.209857 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a52ded-8448-4859-ac6f-79e01580503c None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:37.210913 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6b8754-e257-4d9f-9dc2-c4281f224916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:37.212155 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b8754-e257-4d9f-9dc2-c4281f224916 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:37.212564 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b8754-e257-4d9f-9dc2-c4281f224916 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:37.213181 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:37.213647 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b8754-e257-4d9f-9dc2-c4281f224916 None admin] PATH_INFO: `/v3/domains` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:37.214450 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6b8754-e257-4d9f-9dc2-c4281f224916 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:37.214896 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6b8754-e257-4d9f-9dc2-c4281f224916 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:37.216448 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6b8754-e257-4d9f-9dc2-c4281f224916 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:37.230046 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 311/628] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Oct 4 11:40:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:37.236690 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-16a52ded-8448-4859-ac6f-79e01580503c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:40:37.236690 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:37.236690 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:37.236690 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:37.236690 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:37.236690 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:37.236690 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:37.236690 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:37.236690 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:37.236690 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:37.236690 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:37.236690 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:37.236690 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 11:40:37.236690 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 11:40:37.236690 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 11:40:37.236690 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 11:40:37.238138 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:37.238138 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:37.238138 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:40:37.238138 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:40:37.238138 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:40:37.238138 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:40:37.238138 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:40:37.238138 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:40:37.238138 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:40:37.238138 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:40:37.238138 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:40:37.238138 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:40:37.238138 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:40:37.238138 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:40:37.238138 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:40:37.238138 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:40:37.238138 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 11:40:37.239165 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 11:40:37.239165 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:40:37.239165 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:40:37.240467 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6b8754-e257-4d9f-9dc2-c4281f224916 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:37.240730 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 318/629] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Oct 4 11:40:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 389 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:40:37.244649 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a52ded-8448-4859-ac6f-79e01580503c None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:37.328339 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:37.365973 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a52ded-8448-4859-ac6f-79e01580503c None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:37.387049 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6b8754-e257-4d9f-9dc2-c4281f224916 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:37.405721 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb3c756-3742-4eac-b575-7c0bd3721c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:37.406642 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb3c756-3742-4eac-b575-7c0bd3721c46 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:37.407065 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb3c756-3742-4eac-b575-7c0bd3721c46 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:37.407525 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb3c756-3742-4eac-b575-7c0bd3721c46 None admin] PATH_INFO: `/v3/domains` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:37.408446 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb3c756-3742-4eac-b575-7c0bd3721c46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:37.409233 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb3c756-3742-4eac-b575-7c0bd3721c46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:37.410836 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb3c756-3742-4eac-b575-7c0bd3721c46 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:37.431928 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 319/630] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Oct 4 11:40:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 11:40:37.433290 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb3c756-3742-4eac-b575-7c0bd3721c46 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:37.435793 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9587cf9-f3e8-4d58-a64e-1f03d9024bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:37.436494 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9587cf9-f3e8-4d58-a64e-1f03d9024bd9 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:37.437033 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9587cf9-f3e8-4d58-a64e-1f03d9024bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:37.437306 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9587cf9-f3e8-4d58-a64e-1f03d9024bd9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:37.446856 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9587cf9-f3e8-4d58-a64e-1f03d9024bd9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:37.449067 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9587cf9-f3e8-4d58-a64e-1f03d9024bd9 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:37.465212 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-f9587cf9-f3e8-4d58-a64e-1f03d9024bd9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 11:40:37.465212 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:37.465212 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:37.465212 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:37.465212 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:37.465212 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:37.465212 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:37.465212 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:37.465212 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:37.465212 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:37.465212 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:37.465212 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:37.465212 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 11:40:37.465212 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 11:40:37.465212 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 11:40:37.466264 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 11:40:37.466264 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:37.466264 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:37.466264 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:40:37.466264 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:40:37.466264 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:40:37.466264 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:40:37.466264 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:40:37.466264 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:40:37.466264 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:40:37.466264 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:40:37.466264 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:40:37.466264 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:40:37.466264 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:40:37.466264 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:40:37.466264 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:40:37.466264 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:40:37.467339 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 11:40:37.467339 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 11:40:37.467339 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 11:40:37.467339 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 11:40:37.467339 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 11:40:37.467339 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 11:40:37.467339 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 11:40:37.467339 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:40:37.467339 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 312/631] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Oct 4 11:40:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:40:37.467970 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9587cf9-f3e8-4d58-a64e-1f03d9024bd9 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:37.488510 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:37.554592 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb3c756-3742-4eac-b575-7c0bd3721c46 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:37.582032 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:37.591082 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35514788-8f55-456b-94a1-dd5e1639354f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:37.595439 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35514788-8f55-456b-94a1-dd5e1639354f None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:37.595439 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35514788-8f55-456b-94a1-dd5e1639354f None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:37.595633 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9587cf9-f3e8-4d58-a64e-1f03d9024bd9 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:37.595729 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35514788-8f55-456b-94a1-dd5e1639354f None admin] PATH_INFO: `/v3/roles/service` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:37.603919 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35514788-8f55-456b-94a1-dd5e1639354f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 11:40:37.608970 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-35514788-8f55-456b-94a1-dd5e1639354f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 11:40:37.608970 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:37.608970 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:37.608970 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:37.608970 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:37.608970 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:37.608970 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:37.608970 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:37.608970 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:37.608970 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:37.608970 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:37.608970 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:37.608970 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 11:40:37.608970 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 11:40:37.608970 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 11:40:37.608970 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 11:40:37.610141 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 11:40:37.610141 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 11:40:37.610141 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 11:40:37.610141 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 11:40:37.610141 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:37.610141 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:37.610141 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:40:37.610141 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:40:37.610141 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:40:37.610141 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:40:37.610141 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:40:37.610141 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:40:37.610141 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:40:37.610141 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:40:37.610141 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:40:37.610141 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:40:37.611024 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:40:37.611024 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:40:37.611024 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:40:37.611024 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:40:37.611024 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 11:40:37.611024 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 11:40:37.611024 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 11:40:37.611024 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 11:40:37.611024 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 11:40:37.611024 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 11:40:37.611024 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 11:40:37.611024 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:40:37.611024 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 320/632] 10.222.0.59 () {56 vars in 1102 bytes} [Tue Oct 4 11:40:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:40:37.611996 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35514788-8f55-456b-94a1-dd5e1639354f None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:37.639443 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d80983-3f1a-416e-910b-ccbf96da2ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:37.640101 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d80983-3f1a-416e-910b-ccbf96da2ebc None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:37.640363 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d80983-3f1a-416e-910b-ccbf96da2ebc None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:37.640652 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d80983-3f1a-416e-910b-ccbf96da2ebc None admin] PATH_INFO: `/v3/projects/service` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:37.648900 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d80983-3f1a-416e-910b-ccbf96da2ebc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:37.650349 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d80983-3f1a-416e-910b-ccbf96da2ebc None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:37.664337 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-82d80983-3f1a-416e-910b-ccbf96da2ebc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 11:40:37.664337 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:37.664337 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:37.664337 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:37.664337 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:37.664337 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:37.664337 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:37.664337 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:37.664337 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:37.664337 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:37.664337 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:37.664337 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:37.664337 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 11:40:37.664337 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 11:40:37.664337 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 11:40:37.665295 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 11:40:37.665295 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:37.665295 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:37.665295 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:40:37.665295 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:40:37.665295 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:40:37.665295 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:40:37.665295 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:40:37.665295 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:40:37.665295 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:40:37.665295 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:40:37.665295 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:40:37.665295 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:40:37.665295 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:40:37.665295 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:40:37.665295 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:40:37.665295 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:40:37.666203 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 11:40:37.666203 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 11:40:37.666203 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 11:40:37.666203 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 11:40:37.666203 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 11:40:37.666203 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 11:40:37.666203 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 11:40:37.666203 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:40:37.666203 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 313/633] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Oct 4 11:40:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:40:37.668285 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8fe02f-b409-4955-9016-3b7543fa73b7 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:37.668285 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8fe02f-b409-4955-9016-3b7543fa73b7 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:37.668285 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8fe02f-b409-4955-9016-3b7543fa73b7 None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:37.669071 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 314/634] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:40:37 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:40:37.670400 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8fe02f-b409-4955-9016-3b7543fa73b7 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:37.728121 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35514788-8f55-456b-94a1-dd5e1639354f None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:37.751338 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:37.763652 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd0be8d-6051-4534-b458-91c05db7f9bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:37.766918 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd0be8d-6051-4534-b458-91c05db7f9bf None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:37.766918 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd0be8d-6051-4534-b458-91c05db7f9bf None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:37.766918 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd0be8d-6051-4534-b458-91c05db7f9bf None admin] PATH_INFO: `/v3/projects` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:37.766918 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd0be8d-6051-4534-b458-91c05db7f9bf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:37.766918 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd0be8d-6051-4534-b458-91c05db7f9bf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:37.767369 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd0be8d-6051-4534-b458-91c05db7f9bf None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:37.777936 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8fe02f-b409-4955-9016-3b7543fa73b7 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:37.778870 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 321/635] 10.222.0.59 () {56 vars in 1148 bytes} [Tue Oct 4 11:40:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:37.780005 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02462e3-d520-4dda-9896-585288ca7a42 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:37.780326 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02462e3-d520-4dda-9896-585288ca7a42 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:37.780586 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02462e3-d520-4dda-9896-585288ca7a42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:37.798030 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-e02462e3-d520-4dda-9896-585288ca7a42 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:40:37.799240 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-e02462e3-d520-4dda-9896-585288ca7a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:40:37.812041 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da28f06b-66cb-4efb-b535-39a686b31bb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:37.812685 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da28f06b-66cb-4efb-b535-39a686b31bb7 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:37.812969 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da28f06b-66cb-4efb-b535-39a686b31bb7 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:37.813238 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da28f06b-66cb-4efb-b535-39a686b31bb7 None admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:37.813890 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da28f06b-66cb-4efb-b535-39a686b31bb7 None admin] RBAC: Adding query filter params (name=service) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:37.814192 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da28f06b-66cb-4efb-b535-39a686b31bb7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:37.816084 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da28f06b-66cb-4efb-b535-39a686b31bb7 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:37.824109 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 315/636] 10.222.0.59 () {56 vars in 1103 bytes} [Tue Oct 4 11:40:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:37.824901 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da28f06b-66cb-4efb-b535-39a686b31bb7 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:37.841653 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:37.865515 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 322/637] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:40:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 11:40:37.866861 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b4b410-92b4-4567-96aa-3cc15d8cf593 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:37.867153 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b4b410-92b4-4567-96aa-3cc15d8cf593 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:37.867428 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b4b410-92b4-4567-96aa-3cc15d8cf593 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:37.868677 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 323/638] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:40:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:40:37.873140 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b4b410-92b4-4567-96aa-3cc15d8cf593 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:37.936372 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da28f06b-66cb-4efb-b535-39a686b31bb7 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:37.976163 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a4798a-c4ff-4f2f-8985-40c16f37b1fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:37.976801 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a4798a-c4ff-4f2f-8985-40c16f37b1fc None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:37.977095 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a4798a-c4ff-4f2f-8985-40c16f37b1fc None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:37.977351 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a4798a-c4ff-4f2f-8985-40c16f37b1fc None admin] PATH_INFO: `/v3/projects` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:37.978031 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a4798a-c4ff-4f2f-8985-40c16f37b1fc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:37.978331 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a4798a-c4ff-4f2f-8985-40c16f37b1fc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:37.979756 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a4798a-c4ff-4f2f-8985-40c16f37b1fc None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:37.982238 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:37.985179 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b4b410-92b4-4567-96aa-3cc15d8cf593 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:37.993929 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 316/639] 10.222.0.59 () {56 vars in 1148 bytes} [Tue Oct 4 11:40:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:37.994745 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a4798a-c4ff-4f2f-8985-40c16f37b1fc None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:38.025716 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a0ff65-1220-47be-9203-fa5a2aff932b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:38.026371 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a0ff65-1220-47be-9203-fa5a2aff932b None admin] REQUEST_METHOD: `PUT` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:38.026652 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a0ff65-1220-47be-9203-fa5a2aff932b None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:38.026924 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a0ff65-1220-47be-9203-fa5a2aff932b None admin] PATH_INFO: `/v3/projects/39913dbe3e984f27a61493dd75381501/users/1605c3e03b7a4bcba4e19f0d92c671bc/roles/01769bbdbd2e48f2bf8e855ba6a8507e` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:38.044102 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a0ff65-1220-47be-9203-fa5a2aff932b None admin] RBAC: Authorizing `identity:create_grant(project_id=39913dbe3e984f27a61493dd75381501, user_id=1605c3e03b7a4bcba4e19f0d92c671bc, role_id=01769bbdbd2e48f2bf8e855ba6a8507e)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:38.045681 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a0ff65-1220-47be-9203-fa5a2aff932b None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:38.100231 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a4798a-c4ff-4f2f-8985-40c16f37b1fc None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:38.107604 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 324/640] 10.222.0.59 () {58 vars in 1439 bytes} [Tue Oct 4 11:40:37 2022] PUT /identity/v3/projects/39913dbe3e984f27a61493dd75381501/users/1605c3e03b7a4bcba4e19f0d92c671bc/roles/01769bbdbd2e48f2bf8e855ba6a8507e => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 11:40:38.109029 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c21024-6ea7-48ed-a0c5-5f637ee15069 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:38.113654 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c21024-6ea7-48ed-a0c5-5f637ee15069 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:38.113654 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c21024-6ea7-48ed-a0c5-5f637ee15069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:38.132298 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-60c21024-6ea7-48ed-a0c5-5f637ee15069 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:40:38.133626 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-60c21024-6ea7-48ed-a0c5-5f637ee15069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:40:38.154158 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bc9226-72f0-44b7-921c-6d8fdc3901bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:38.154825 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bc9226-72f0-44b7-921c-6d8fdc3901bb None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:38.155103 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bc9226-72f0-44b7-921c-6d8fdc3901bb None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:38.155372 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bc9226-72f0-44b7-921c-6d8fdc3901bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:38.163007 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:38.167706 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bc9226-72f0-44b7-921c-6d8fdc3901bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:38.169323 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bc9226-72f0-44b7-921c-6d8fdc3901bb None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:38.189141 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-26bc9226-72f0-44b7-921c-6d8fdc3901bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:40:38.189141 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:38.189141 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:38.189141 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:38.189141 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:38.189141 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:38.189141 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:38.189141 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:38.189141 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:38.189141 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:38.189141 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:38.189141 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:38.189141 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 11:40:38.189141 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 11:40:38.189141 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 11:40:38.189141 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 11:40:38.190395 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:38.190395 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:38.190395 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:40:38.190395 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:40:38.190395 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:40:38.190395 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:40:38.190395 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:40:38.190395 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:40:38.190395 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:40:38.190395 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:40:38.190395 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:40:38.190395 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:40:38.190395 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:40:38.190395 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:40:38.190395 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:40:38.190395 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:40:38.190395 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 11:40:38.196572 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 11:40:38.196572 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:40:38.196572 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:40:38.196572 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 317/641] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Oct 4 11:40:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:40:38.196572 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bc9226-72f0-44b7-921c-6d8fdc3901bb None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:38.224694 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 325/642] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:40:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 11:40:38.224694 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c21024-6ea7-48ed-a0c5-5f637ee15069 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:38.266997 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:38.333864 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bc9226-72f0-44b7-921c-6d8fdc3901bb None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:38.339504 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c21024-6ea7-48ed-a0c5-5f637ee15069 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:38.371155 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5140d8-6351-4984-bc9f-d8cd5e615d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:38.371798 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5140d8-6351-4984-bc9f-d8cd5e615d7f None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:38.372077 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5140d8-6351-4984-bc9f-d8cd5e615d7f None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:38.372349 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5140d8-6351-4984-bc9f-d8cd5e615d7f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:38.373163 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5140d8-6351-4984-bc9f-d8cd5e615d7f None admin] RBAC: Adding query filter params (role.id=01769bbdbd2e48f2bf8e855ba6a8507e, scope.project.id=39913dbe3e984f27a61493dd75381501, user.id=a8e23d1d2fe24bdf9552e7c2f0ae3424) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:38.373473 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5140d8-6351-4984-bc9f-d8cd5e615d7f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:38.375122 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5140d8-6351-4984-bc9f-d8cd5e615d7f None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:38.381195 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cb89e7-5a67-4e44-b0c0-cbfbd8c74af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:38.381830 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cb89e7-5a67-4e44-b0c0-cbfbd8c74af0 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:38.382111 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cb89e7-5a67-4e44-b0c0-cbfbd8c74af0 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:38.382447 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 318/643] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Oct 4 11:40:38 2022] GET /identity/v3/role_assignments?user.id=a8e23d1d2fe24bdf9552e7c2f0ae3424&scope.project.id=39913dbe3e984f27a61493dd75381501&role.id=01769bbdbd2e48f2bf8e855ba6a8507e => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:38.383302 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5140d8-6351-4984-bc9f-d8cd5e615d7f None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:38.388683 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cb89e7-5a67-4e44-b0c0-cbfbd8c74af0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:38.417995 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cb89e7-5a67-4e44-b0c0-cbfbd8c74af0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 11:40:38.426035 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-c7cb89e7-5a67-4e44-b0c0-cbfbd8c74af0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 11:40:38.426035 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:38.426035 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:38.426035 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:38.426035 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:38.426035 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:38.426035 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:38.426035 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:38.426035 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:38.426035 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:38.426035 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:38.426035 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:38.426035 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 11:40:38.426035 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 11:40:38.426035 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 11:40:38.426035 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 11:40:38.427114 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 11:40:38.427114 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 11:40:38.427114 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 11:40:38.427114 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 11:40:38.427114 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:38.427114 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:38.427114 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:40:38.427114 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:40:38.427114 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:40:38.427114 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:40:38.427114 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:40:38.427114 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:40:38.427114 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:40:38.427114 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:40:38.427114 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:40:38.427114 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:40:38.427977 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:40:38.427977 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:40:38.427977 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:40:38.427977 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:40:38.427977 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 11:40:38.427977 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 11:40:38.427977 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 11:40:38.427977 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 11:40:38.427977 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 11:40:38.427977 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 11:40:38.427977 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 11:40:38.427977 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:40:38.427977 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 326/644] 10.222.0.59 () {56 vars in 1102 bytes} [Tue Oct 4 11:40:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:40:38.434010 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cb89e7-5a67-4e44-b0c0-cbfbd8c74af0 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:38.474715 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:38.564999 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5140d8-6351-4984-bc9f-d8cd5e615d7f None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:38.588217 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:38.614424 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611d6ecd-b2c7-4f0a-8d62-b737842bd837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:38.615731 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cb89e7-5a67-4e44-b0c0-cbfbd8c74af0 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:38.616114 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611d6ecd-b2c7-4f0a-8d62-b737842bd837 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:38.616497 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611d6ecd-b2c7-4f0a-8d62-b737842bd837 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:38.616895 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611d6ecd-b2c7-4f0a-8d62-b737842bd837 None admin] PATH_INFO: `/v3/domains` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:38.617632 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611d6ecd-b2c7-4f0a-8d62-b737842bd837 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:38.617944 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611d6ecd-b2c7-4f0a-8d62-b737842bd837 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:38.619297 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611d6ecd-b2c7-4f0a-8d62-b737842bd837 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:38.636967 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 319/645] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Oct 4 11:40:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:38.637744 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611d6ecd-b2c7-4f0a-8d62-b737842bd837 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:38.662149 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8548e6-42fe-4cf8-8a3b-e10d94a9322f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:38.663183 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8548e6-42fe-4cf8-8a3b-e10d94a9322f None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:38.663475 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8548e6-42fe-4cf8-8a3b-e10d94a9322f None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:38.663748 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8548e6-42fe-4cf8-8a3b-e10d94a9322f None admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:38.665503 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8548e6-42fe-4cf8-8a3b-e10d94a9322f None admin] RBAC: Adding query filter params (name=service) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:38.665503 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8548e6-42fe-4cf8-8a3b-e10d94a9322f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:38.667738 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8548e6-42fe-4cf8-8a3b-e10d94a9322f None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:38.677462 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 327/646] 10.222.0.59 () {56 vars in 1103 bytes} [Tue Oct 4 11:40:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:38.678928 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8548e6-42fe-4cf8-8a3b-e10d94a9322f None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:38.762721 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611d6ecd-b2c7-4f0a-8d62-b737842bd837 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:38.784537 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:38.802011 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbb7a0a-0639-44f7-9f5a-2ecb0b085cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:38.803161 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbb7a0a-0639-44f7-9f5a-2ecb0b085cf5 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:38.803534 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbb7a0a-0639-44f7-9f5a-2ecb0b085cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:38.803900 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbb7a0a-0639-44f7-9f5a-2ecb0b085cf5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:38.811208 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8548e6-42fe-4cf8-8a3b-e10d94a9322f None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:38.816182 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbb7a0a-0639-44f7-9f5a-2ecb0b085cf5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 11:40:38.821214 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-ebbb7a0a-0639-44f7-9f5a-2ecb0b085cf5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 11:40:38.821214 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:38.821214 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:38.821214 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:38.821214 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:38.821214 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:38.821214 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:38.821214 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:38.821214 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:38.821214 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:38.821214 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:38.821214 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:38.821214 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 11:40:38.821214 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 11:40:38.821214 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 11:40:38.821214 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 11:40:38.822350 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 11:40:38.822350 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 11:40:38.822350 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 11:40:38.822350 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 11:40:38.822350 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:38.822350 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:38.822350 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:40:38.822350 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:40:38.822350 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:40:38.822350 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:40:38.822350 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:40:38.822350 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:40:38.822350 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:40:38.822350 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:40:38.822350 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:40:38.822350 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:40:38.823517 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:40:38.823517 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:40:38.823517 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:40:38.823517 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:40:38.823517 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 11:40:38.823517 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 11:40:38.823517 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 11:40:38.823517 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 11:40:38.823517 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 11:40:38.823517 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 11:40:38.823517 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 11:40:38.823517 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:40:38.825324 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 320/647] 10.222.0.59 () {56 vars in 1102 bytes} [Tue Oct 4 11:40:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:40:38.826336 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbb7a0a-0639-44f7-9f5a-2ecb0b085cf5 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:38.859204 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552f5554-2452-4c82-8e63-5c7e7a15b402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:38.860563 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552f5554-2452-4c82-8e63-5c7e7a15b402 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:38.861108 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552f5554-2452-4c82-8e63-5c7e7a15b402 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:38.861570 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552f5554-2452-4c82-8e63-5c7e7a15b402 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:38.871620 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552f5554-2452-4c82-8e63-5c7e7a15b402 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:38.873132 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552f5554-2452-4c82-8e63-5c7e7a15b402 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:38.873246 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:38.885578 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-552f5554-2452-4c82-8e63-5c7e7a15b402 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 04 11:40:38.885578 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:38.885578 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:38.885578 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:38.885578 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:38.885578 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:38.885578 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:38.885578 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:38.885578 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:38.885578 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:38.885578 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:38.885578 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:38.885578 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 11:40:38.885578 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 11:40:38.885578 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 11:40:38.885578 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 11:40:38.886596 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:38.886596 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:38.886596 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 11:40:38.886596 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 11:40:38.886596 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 11:40:38.886596 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 11:40:38.886596 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:40:38.886596 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:40:38.886596 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:40:38.886596 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:40:38.886596 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:40:38.886596 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:40:38.886596 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:40:38.886596 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:40:38.886596 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:40:38.886596 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:40:38.886596 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:40:38.886596 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:40:38.887597 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:40:38.887597 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:40:38.887597 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 11:40:38.887597 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 11:40:38.887597 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 11:40:38.887597 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 11:40:38.887597 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 11:40:38.887597 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 11:40:38.887597 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 04 11:40:38.887597 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:40:38.887597 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 328/648] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Oct 4 11:40:38 2022] GET /identity/v3/users/cinder => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:40:38.892614 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552f5554-2452-4c82-8e63-5c7e7a15b402 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:38.965667 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbb7a0a-0639-44f7-9f5a-2ecb0b085cf5 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:39.001700 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552f5554-2452-4c82-8e63-5c7e7a15b402 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:39.012036 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094ba64a-e59b-4a8c-b7e9-d882e044130f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:39.012992 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094ba64a-e59b-4a8c-b7e9-d882e044130f None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:39.013569 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094ba64a-e59b-4a8c-b7e9-d882e044130f None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:39.014051 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094ba64a-e59b-4a8c-b7e9-d882e044130f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:39.028251 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094ba64a-e59b-4a8c-b7e9-d882e044130f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:39.030464 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094ba64a-e59b-4a8c-b7e9-d882e044130f None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:39.041032 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ca62d3-1c3c-4f53-9bec-6040c62765f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:39.041743 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ca62d3-1c3c-4f53-9bec-6040c62765f9 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:39.042519 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ca62d3-1c3c-4f53-9bec-6040c62765f9 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:39.042519 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ca62d3-1c3c-4f53-9bec-6040c62765f9 None admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:39.043131 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ca62d3-1c3c-4f53-9bec-6040c62765f9 None admin] RBAC: Adding query filter params (name=service) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:39.043496 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ca62d3-1c3c-4f53-9bec-6040c62765f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:39.045063 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ca62d3-1c3c-4f53-9bec-6040c62765f9 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:39.051945 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:39.053200 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-094ba64a-e59b-4a8c-b7e9-d882e044130f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:40:39.053200 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:39.053200 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:39.053200 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:39.053200 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:39.053200 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:39.053200 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:39.053200 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:39.053200 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:39.053200 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:39.053200 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:39.053200 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:39.053200 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 11:40:39.053200 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 11:40:39.053200 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 11:40:39.053200 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 11:40:39.054159 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:39.054159 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:39.054159 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:40:39.054159 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:40:39.054159 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:40:39.054159 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:40:39.054159 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:40:39.054159 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:40:39.054159 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:40:39.054159 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:40:39.054159 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:40:39.054159 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:40:39.054159 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:40:39.054159 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:40:39.054159 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:40:39.054159 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:40:39.054159 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 11:40:39.055071 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 11:40:39.055071 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:40:39.055071 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:40:39.057104 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 321/649] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Oct 4 11:40:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:40:39.058213 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094ba64a-e59b-4a8c-b7e9-d882e044130f None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:39.060729 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 329/650] 10.222.0.59 () {56 vars in 1103 bytes} [Tue Oct 4 11:40:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:39.063006 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ca62d3-1c3c-4f53-9bec-6040c62765f9 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:39.175129 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:39.197737 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ca62d3-1c3c-4f53-9bec-6040c62765f9 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:39.198534 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094ba64a-e59b-4a8c-b7e9-d882e044130f None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:39.234751 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea3fe59-cf85-4f6e-ad53-5bfe7fb6cebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:39.235825 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea3fe59-cf85-4f6e-ad53-5bfe7fb6cebb None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:39.236327 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea3fe59-cf85-4f6e-ad53-5bfe7fb6cebb None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:39.236911 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea3fe59-cf85-4f6e-ad53-5bfe7fb6cebb None admin] PATH_INFO: `/v3/domains` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:39.237755 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea3fe59-cf85-4f6e-ad53-5bfe7fb6cebb None admin] RBAC: Adding query filter params (name=Default) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:39.238267 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea3fe59-cf85-4f6e-ad53-5bfe7fb6cebb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:39.239817 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea3fe59-cf85-4f6e-ad53-5bfe7fb6cebb None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:39.244527 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7843654c-962f-431e-8a83-19bc9da65da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:39.245169 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7843654c-962f-431e-8a83-19bc9da65da6 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:39.245458 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7843654c-962f-431e-8a83-19bc9da65da6 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:39.245720 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7843654c-962f-431e-8a83-19bc9da65da6 None admin] PATH_INFO: `/v3/users` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:39.246500 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7843654c-962f-431e-8a83-19bc9da65da6 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:39.246808 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7843654c-962f-431e-8a83-19bc9da65da6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:39.248217 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7843654c-962f-431e-8a83-19bc9da65da6 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:39.254989 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 330/651] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Oct 4 11:40:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:39.256076 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea3fe59-cf85-4f6e-ad53-5bfe7fb6cebb None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:39.278581 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 322/652] 10.222.0.59 () {56 vars in 1137 bytes} [Tue Oct 4 11:40:39 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:39.280181 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7843654c-962f-431e-8a83-19bc9da65da6 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:39.341545 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:39.393285 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea3fe59-cf85-4f6e-ad53-5bfe7fb6cebb None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:39.396225 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7843654c-962f-431e-8a83-19bc9da65da6 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:39.431146 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0092706e-ffed-4910-9554-3b1e05ca6449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:39.431693 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0092706e-ffed-4910-9554-3b1e05ca6449 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:39.431971 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0092706e-ffed-4910-9554-3b1e05ca6449 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:39.432245 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0092706e-ffed-4910-9554-3b1e05ca6449 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:39.434881 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93c2ed5-9acc-40b6-af95-bc1707d93dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:39.435586 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93c2ed5-9acc-40b6-af95-bc1707d93dfd None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:39.435936 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93c2ed5-9acc-40b6-af95-bc1707d93dfd None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:39.436279 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93c2ed5-9acc-40b6-af95-bc1707d93dfd None admin] PATH_INFO: `/v3/users/neutron` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:39.444249 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0092706e-ffed-4910-9554-3b1e05ca6449 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:39.445134 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93c2ed5-9acc-40b6-af95-bc1707d93dfd None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:39.445764 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0092706e-ffed-4910-9554-3b1e05ca6449 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:39.446997 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93c2ed5-9acc-40b6-af95-bc1707d93dfd None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:39.462008 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-0092706e-ffed-4910-9554-3b1e05ca6449 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:40:39.462008 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:39.462008 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:39.462008 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:39.462008 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:39.462008 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:39.462008 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:39.462008 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:39.462008 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:39.462008 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:39.462008 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:39.462008 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:39.462008 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 11:40:39.462008 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 11:40:39.462008 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 11:40:39.462008 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 11:40:39.463029 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:39.463029 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:39.463029 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:40:39.463029 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:40:39.463029 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:40:39.463029 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:40:39.463029 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:40:39.463029 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:40:39.463029 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:40:39.463029 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:40:39.463029 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:40:39.463029 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:40:39.463029 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:40:39.463029 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:40:39.463029 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:40:39.463029 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:40:39.463029 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 11:40:39.464028 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 11:40:39.464028 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:40:39.464028 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:40:39.464202 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-a93c2ed5-9acc-40b6-af95-bc1707d93dfd None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 04 11:40:39.464202 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:39.464202 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:39.464202 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:39.464202 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:39.464202 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:39.464202 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:39.464202 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:39.464202 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:39.464202 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:39.464202 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:39.464202 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:39.464202 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 11:40:39.464202 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 11:40:39.464202 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 11:40:39.464202 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 11:40:39.465085 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:39.465085 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:39.465085 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 11:40:39.465085 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 11:40:39.465085 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 11:40:39.465085 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 11:40:39.465085 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:40:39.465085 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:40:39.465085 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:40:39.465085 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:40:39.465085 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:40:39.465085 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:40:39.465085 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:40:39.465085 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:40:39.465085 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:40:39.465085 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:40:39.465085 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:40:39.465085 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:40:39.467809 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:40:39.467809 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:40:39.467809 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 11:40:39.467809 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 11:40:39.467809 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 11:40:39.467809 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 11:40:39.467809 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 11:40:39.467809 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 11:40:39.467809 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 04 11:40:39.467809 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:40:39.469503 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 331/653] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Oct 4 11:40:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:40:39.469686 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 323/654] 10.222.0.59 () {56 vars in 1102 bytes} [Tue Oct 4 11:40:39 2022] GET /identity/v3/users/neutron => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:40:39.469860 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0092706e-ffed-4910-9554-3b1e05ca6449 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:39.476092 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93c2ed5-9acc-40b6-af95-bc1707d93dfd None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:39.479410 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:39.601841 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93c2ed5-9acc-40b6-af95-bc1707d93dfd None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:39.624057 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0092706e-ffed-4910-9554-3b1e05ca6449 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:39.638831 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:39.648935 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7767d2a-875f-461b-9cec-391ef2cde0b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:39.649840 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7767d2a-875f-461b-9cec-391ef2cde0b9 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:39.650315 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7767d2a-875f-461b-9cec-391ef2cde0b9 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:39.650801 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7767d2a-875f-461b-9cec-391ef2cde0b9 None admin] PATH_INFO: `/v3/users` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:39.651887 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7767d2a-875f-461b-9cec-391ef2cde0b9 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:39.652698 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7767d2a-875f-461b-9cec-391ef2cde0b9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:39.654745 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7767d2a-875f-461b-9cec-391ef2cde0b9 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:39.660157 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f58e699-f4e1-46c5-9867-458066c322c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:39.660810 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f58e699-f4e1-46c5-9867-458066c322c6 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:39.661093 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f58e699-f4e1-46c5-9867-458066c322c6 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:39.661365 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f58e699-f4e1-46c5-9867-458066c322c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:39.678062 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 324/655] 10.222.0.59 () {56 vars in 1139 bytes} [Tue Oct 4 11:40:39 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:39.679234 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7767d2a-875f-461b-9cec-391ef2cde0b9 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:39.732734 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f58e699-f4e1-46c5-9867-458066c322c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:39.734410 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f58e699-f4e1-46c5-9867-458066c322c6 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:39.754191 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:39.802213 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7767d2a-875f-461b-9cec-391ef2cde0b9 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:39.841256 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 332/656] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Oct 4 11:40:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 11:40:39.846332 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f58e699-f4e1-46c5-9867-458066c322c6 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:39.849011 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33405f28-656a-4441-9cce-8c7df81ced86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:39.850127 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33405f28-656a-4441-9cce-8c7df81ced86 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:39.850600 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33405f28-656a-4441-9cce-8c7df81ced86 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:39.851090 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33405f28-656a-4441-9cce-8c7df81ced86 None admin] PATH_INFO: `/v3/domains` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:39.851923 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33405f28-656a-4441-9cce-8c7df81ced86 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:39.852938 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33405f28-656a-4441-9cce-8c7df81ced86 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:39.855066 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33405f28-656a-4441-9cce-8c7df81ced86 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:39.858986 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:39.875866 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 325/657] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Oct 4 11:40:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:39.875866 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33405f28-656a-4441-9cce-8c7df81ced86 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:39.954887 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f58e699-f4e1-46c5-9867-458066c322c6 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:39.985313 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33405f28-656a-4441-9cce-8c7df81ced86 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:39.996483 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600383eb-beed-4211-8b10-0e1bbd866c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:39.997137 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600383eb-beed-4211-8b10-0e1bbd866c02 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:39.997417 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600383eb-beed-4211-8b10-0e1bbd866c02 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:39.997690 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600383eb-beed-4211-8b10-0e1bbd866c02 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:40.009704 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:40.027798 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caf623a-cda5-4d94-9c1f-1fd62e841009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:40.029521 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caf623a-cda5-4d94-9c1f-1fd62e841009 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:40.029994 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caf623a-cda5-4d94-9c1f-1fd62e841009 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:40.030664 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caf623a-cda5-4d94-9c1f-1fd62e841009 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:40.045562 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caf623a-cda5-4d94-9c1f-1fd62e841009 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:40.047911 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caf623a-cda5-4d94-9c1f-1fd62e841009 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:40.068693 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-2caf623a-cda5-4d94-9c1f-1fd62e841009 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:40:40.068693 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:40.068693 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:40.068693 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:40.068693 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:40.068693 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:40.068693 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:40.068693 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:40.068693 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:40.068693 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:40.068693 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:40.068693 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:40.068693 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 11:40:40.068693 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 11:40:40.068693 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 11:40:40.068693 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 11:40:40.069664 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:40.069664 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:40.069664 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:40:40.069664 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:40:40.069664 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:40:40.069664 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:40:40.069664 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:40:40.069664 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:40:40.069664 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:40:40.069664 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:40:40.069664 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:40:40.069664 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:40:40.069664 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:40:40.069664 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:40:40.069664 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:40:40.069664 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:40:40.069664 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 11:40:40.070570 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 11:40:40.070570 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:40:40.070570 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:40:40.077981 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 326/658] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Oct 4 11:40:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:40:40.077981 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caf623a-cda5-4d94-9c1f-1fd62e841009 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:40.079165 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600383eb-beed-4211-8b10-0e1bbd866c02 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:40.081383 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600383eb-beed-4211-8b10-0e1bbd866c02 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:40.095924 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:40.198483 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 333/659] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Oct 4 11:40:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 11:40:40.199418 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600383eb-beed-4211-8b10-0e1bbd866c02 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:40.199531 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caf623a-cda5-4d94-9c1f-1fd62e841009 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:40.237426 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69cdefe-fda5-40dc-8455-b347e81a4f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:40.238149 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69cdefe-fda5-40dc-8455-b347e81a4f2e None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:40.238429 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69cdefe-fda5-40dc-8455-b347e81a4f2e None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:40.238700 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69cdefe-fda5-40dc-8455-b347e81a4f2e None admin] PATH_INFO: `/v3/users/glance` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:40.246480 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69cdefe-fda5-40dc-8455-b347e81a4f2e None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:40.247908 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69cdefe-fda5-40dc-8455-b347e81a4f2e None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:40.262535 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-c69cdefe-fda5-40dc-8455-b347e81a4f2e None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 04 11:40:40.262535 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:40.262535 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:40.262535 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:40.262535 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:40.262535 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:40.262535 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:40.262535 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:40.262535 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:40.262535 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:40.262535 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:40.262535 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:40.262535 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 11:40:40.262535 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 11:40:40.262535 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 11:40:40.262535 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 11:40:40.263552 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:40.263552 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:40.263552 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 11:40:40.263552 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 11:40:40.263552 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 11:40:40.263552 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 11:40:40.263552 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:40:40.263552 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:40:40.263552 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:40:40.263552 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:40:40.263552 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:40:40.263552 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:40:40.263552 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:40:40.263552 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:40:40.263552 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:40:40.263552 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:40:40.263552 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:40:40.263552 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:40:40.264524 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:40:40.264524 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:40:40.264524 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 11:40:40.264524 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 11:40:40.264524 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 11:40:40.264524 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 11:40:40.264524 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 11:40:40.264524 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 11:40:40.264524 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 04 11:40:40.264524 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:40:40.267251 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 327/660] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Oct 4 11:40:40 2022] GET /identity/v3/users/glance => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:40:40.269313 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69cdefe-fda5-40dc-8455-b347e81a4f2e None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:40.306045 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:40.319912 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600383eb-beed-4211-8b10-0e1bbd866c02 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:40.333447 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:40.356186 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c644286-fe66-4db4-a7bd-ec3c93392e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:40.357151 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c644286-fe66-4db4-a7bd-ec3c93392e2f None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:40.357644 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c644286-fe66-4db4-a7bd-ec3c93392e2f None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:40.358113 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c644286-fe66-4db4-a7bd-ec3c93392e2f None admin] PATH_INFO: `/v3/domains` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:40.358972 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c644286-fe66-4db4-a7bd-ec3c93392e2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:40.359470 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c644286-fe66-4db4-a7bd-ec3c93392e2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:40.361247 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c644286-fe66-4db4-a7bd-ec3c93392e2f None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:40.375716 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 334/661] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Oct 4 11:40:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:40.376891 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c644286-fe66-4db4-a7bd-ec3c93392e2f None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:40.382402 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69cdefe-fda5-40dc-8455-b347e81a4f2e None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:40.420057 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdda699-3a4d-4546-8f6f-3f004b488f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:40.420718 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdda699-3a4d-4546-8f6f-3f004b488f87 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:40.421002 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdda699-3a4d-4546-8f6f-3f004b488f87 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:40.421275 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdda699-3a4d-4546-8f6f-3f004b488f87 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:40.433686 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdda699-3a4d-4546-8f6f-3f004b488f87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:40.435134 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdda699-3a4d-4546-8f6f-3f004b488f87 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:40.450261 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-9bdda699-3a4d-4546-8f6f-3f004b488f87 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:40:40.450261 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:40.450261 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:40.450261 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:40.450261 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:40.450261 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:40.450261 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:40.450261 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:40.450261 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:40.450261 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:40.450261 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:40.450261 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:40.450261 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 11:40:40.450261 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 11:40:40.450261 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 11:40:40.450261 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 11:40:40.451349 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:40.451349 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:40.451349 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:40:40.451349 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:40:40.451349 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:40:40.451349 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:40:40.451349 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:40:40.451349 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:40:40.451349 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:40:40.451349 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:40:40.451349 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:40:40.451349 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:40:40.451349 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:40:40.451349 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:40:40.451349 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:40:40.451349 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:40:40.451349 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 11:40:40.452253 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 11:40:40.452253 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:40:40.452253 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:40:40.452253 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 328/662] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Oct 4 11:40:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:40:40.452253 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdda699-3a4d-4546-8f6f-3f004b488f87 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:40.492103 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c644286-fe66-4db4-a7bd-ec3c93392e2f None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:40.533080 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d3647a-e9a1-4021-82b3-ac8d60019a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:40.534552 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d3647a-e9a1-4021-82b3-ac8d60019a49 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:40.535040 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d3647a-e9a1-4021-82b3-ac8d60019a49 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:40.535482 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d3647a-e9a1-4021-82b3-ac8d60019a49 None admin] PATH_INFO: `/v3/users` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:40.536376 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d3647a-e9a1-4021-82b3-ac8d60019a49 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:40.536877 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d3647a-e9a1-4021-82b3-ac8d60019a49 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:40.538566 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d3647a-e9a1-4021-82b3-ac8d60019a49 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:40.563299 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:40.563484 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 335/663] 10.222.0.59 () {56 vars in 1137 bytes} [Tue Oct 4 11:40:40 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:40.563484 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4190cbb6-15bf-42d1-a7b6-3bc7e28c691b None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:40.563484 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4190cbb6-15bf-42d1-a7b6-3bc7e28c691b None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:40.563484 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4190cbb6-15bf-42d1-a7b6-3bc7e28c691b None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:40.564759 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 336/664] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:40:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:40:40.566563 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4190cbb6-15bf-42d1-a7b6-3bc7e28c691b None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:40.580296 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdda699-3a4d-4546-8f6f-3f004b488f87 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:40.597224 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:40.621343 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d386ed72-4ab2-4580-b27b-9f68ae1eacc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:40.621983 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d386ed72-4ab2-4580-b27b-9f68ae1eacc4 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:40.622265 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d386ed72-4ab2-4580-b27b-9f68ae1eacc4 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:40.622542 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d386ed72-4ab2-4580-b27b-9f68ae1eacc4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:40.630374 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d386ed72-4ab2-4580-b27b-9f68ae1eacc4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:40.631998 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d386ed72-4ab2-4580-b27b-9f68ae1eacc4 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:40.646115 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-d386ed72-4ab2-4580-b27b-9f68ae1eacc4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 11:40:40.646115 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:40.646115 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:40.646115 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:40.646115 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:40.646115 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:40.646115 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:40.646115 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:40.646115 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:40.646115 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:40.646115 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:40.646115 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:40.646115 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 11:40:40.646115 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 11:40:40.646115 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 11:40:40.647049 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 11:40:40.647049 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:40.647049 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:40.647049 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:40:40.647049 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:40:40.647049 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:40:40.647049 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:40:40.647049 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:40:40.647049 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:40:40.647049 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:40:40.647049 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:40:40.647049 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:40:40.647049 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:40:40.647049 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:40:40.647049 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:40:40.647049 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:40:40.647049 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:40:40.647951 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 11:40:40.647951 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 11:40:40.647951 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 11:40:40.647951 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 11:40:40.647951 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 11:40:40.647951 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 11:40:40.647951 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 11:40:40.647951 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:40:40.652127 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 329/665] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Oct 4 11:40:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:40:40.652905 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d386ed72-4ab2-4580-b27b-9f68ae1eacc4 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:40.674025 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4190cbb6-15bf-42d1-a7b6-3bc7e28c691b None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:40.712586 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbd5bb5-167f-4bf2-92fd-6899343a5782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:40.713238 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd5bb5-167f-4bf2-92fd-6899343a5782 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:40.713519 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd5bb5-167f-4bf2-92fd-6899343a5782 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:40.713787 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd5bb5-167f-4bf2-92fd-6899343a5782 None admin] PATH_INFO: `/v3/domains` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:40.714581 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbd5bb5-167f-4bf2-92fd-6899343a5782 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:40.714742 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbd5bb5-167f-4bf2-92fd-6899343a5782 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:40.716189 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbd5bb5-167f-4bf2-92fd-6899343a5782 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:40.736439 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 337/666] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Oct 4 11:40:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:40.736439 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162de405-9d3b-4c5d-b845-0d4a7416cfe8 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:40.736439 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162de405-9d3b-4c5d-b845-0d4a7416cfe8 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:40.736439 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162de405-9d3b-4c5d-b845-0d4a7416cfe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:40.754869 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-162de405-9d3b-4c5d-b845-0d4a7416cfe8 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:40:40.755973 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-162de405-9d3b-4c5d-b845-0d4a7416cfe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:40:40.763215 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d386ed72-4ab2-4580-b27b-9f68ae1eacc4 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:40.798633 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269fcdd1-be2c-4112-8a1c-c1ccc5abb3d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:40.799328 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269fcdd1-be2c-4112-8a1c-c1ccc5abb3d2 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:40.799671 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269fcdd1-be2c-4112-8a1c-c1ccc5abb3d2 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:40.800097 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269fcdd1-be2c-4112-8a1c-c1ccc5abb3d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:40.817632 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:40.826040 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 338/667] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:40:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 11:40:40.832843 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162de405-9d3b-4c5d-b845-0d4a7416cfe8 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:40.854466 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:40.882795 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269fcdd1-be2c-4112-8a1c-c1ccc5abb3d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:40.884243 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269fcdd1-be2c-4112-8a1c-c1ccc5abb3d2 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:40.939159 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162de405-9d3b-4c5d-b845-0d4a7416cfe8 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:40.976359 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5e9441-62e9-421b-a976-c05f9e8b6f1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:40.977279 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5e9441-62e9-421b-a976-c05f9e8b6f1d None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:40.977561 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5e9441-62e9-421b-a976-c05f9e8b6f1d None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:40.977836 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5e9441-62e9-421b-a976-c05f9e8b6f1d None admin] PATH_INFO: `/v3/projects` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:40.978521 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5e9441-62e9-421b-a976-c05f9e8b6f1d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:40.978826 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5e9441-62e9-421b-a976-c05f9e8b6f1d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:40.980757 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5e9441-62e9-421b-a976-c05f9e8b6f1d None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:40.992978 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 330/668] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Oct 4 11:40:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 11:40:40.993216 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 339/669] 10.222.0.59 () {56 vars in 1148 bytes} [Tue Oct 4 11:40:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:40.994107 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5e9441-62e9-421b-a976-c05f9e8b6f1d None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:40.994982 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cd2b2b-27f1-46e8-9a67-198411694582 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:40.995462 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cd2b2b-27f1-46e8-9a67-198411694582 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:40.995927 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cd2b2b-27f1-46e8-9a67-198411694582 None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:40.997719 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 331/670] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:40:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:40:41.001652 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cd2b2b-27f1-46e8-9a67-198411694582 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:41.049784 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:41.094525 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:41.109201 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cd2b2b-27f1-46e8-9a67-198411694582 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:41.113807 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5e9441-62e9-421b-a976-c05f9e8b6f1d None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:41.144510 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3ee16f-0736-4b11-9784-9251e11e747d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:41.145176 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3ee16f-0736-4b11-9784-9251e11e747d None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:41.145447 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3ee16f-0736-4b11-9784-9251e11e747d None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:41.145713 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3ee16f-0736-4b11-9784-9251e11e747d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:41.148046 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311e02cf-4121-41af-964a-95a949a7e802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:41.148680 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311e02cf-4121-41af-964a-95a949a7e802 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:41.148955 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311e02cf-4121-41af-964a-95a949a7e802 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:41.149222 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311e02cf-4121-41af-964a-95a949a7e802 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:41.155557 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3ee16f-0736-4b11-9784-9251e11e747d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:41.155726 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311e02cf-4121-41af-964a-95a949a7e802 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:41.157076 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3ee16f-0736-4b11-9784-9251e11e747d None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:41.157184 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311e02cf-4121-41af-964a-95a949a7e802 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:41.170395 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-311e02cf-4121-41af-964a-95a949a7e802 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 11:40:41.170395 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:41.170395 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:41.170395 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:41.170395 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:41.170395 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:41.170395 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:41.170395 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:41.170395 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:41.170395 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:41.170395 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:41.170395 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:41.170395 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 11:40:41.170395 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 11:40:41.170395 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 11:40:41.171333 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 11:40:41.171333 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:41.171333 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:41.171333 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:40:41.171333 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:40:41.171333 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:40:41.171333 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:40:41.171333 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:40:41.171333 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:40:41.171333 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:40:41.171333 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:40:41.171333 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:40:41.171333 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:40:41.171333 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:40:41.171333 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:40:41.171333 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:40:41.171333 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:40:41.172247 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 11:40:41.172247 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 11:40:41.172247 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 11:40:41.172247 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 11:40:41.172247 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 11:40:41.172247 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 11:40:41.172247 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 11:40:41.172247 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:40:41.172247 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 340/671] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Oct 4 11:40:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:40:41.173208 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e9327e-dd51-44b1-9c91-b0211dce6bfe None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:41.173368 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e9327e-dd51-44b1-9c91-b0211dce6bfe None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:41.173643 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e9327e-dd51-44b1-9c91-b0211dce6bfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:41.177819 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-bc3ee16f-0736-4b11-9784-9251e11e747d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:40:41.177819 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:41.177819 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:41.177819 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:41.177819 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:41.177819 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:41.177819 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:41.177819 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:41.177819 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:41.177819 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:41.177819 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:41.177819 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:41.177819 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 11:40:41.177819 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 11:40:41.177819 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 11:40:41.177819 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 11:40:41.179081 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:41.179081 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:41.179081 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:40:41.179081 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:40:41.179081 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:40:41.179081 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:40:41.179081 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:40:41.179081 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:40:41.179081 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:40:41.179081 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:40:41.179081 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:40:41.179081 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:40:41.179081 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:40:41.179081 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:40:41.179081 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:40:41.179081 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:40:41.179081 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 11:40:41.180183 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 11:40:41.180183 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:40:41.180183 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:40:41.180183 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 332/672] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Oct 4 11:40:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 11:40:41.181349 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3ee16f-0736-4b11-9784-9251e11e747d None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:41.193430 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-16e9327e-dd51-44b1-9c91-b0211dce6bfe None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:40:41.194616 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-16e9327e-dd51-44b1-9c91-b0211dce6bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:40:41.261798 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 341/673] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:40:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 11:40:41.262623 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e9327e-dd51-44b1-9c91-b0211dce6bfe None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:41.285153 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:41.292157 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3ee16f-0736-4b11-9784-9251e11e747d None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:41.333273 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:41.336734 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19f10f9-fe8d-45a4-98ba-83cdd0b83ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:41.337346 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19f10f9-fe8d-45a4-98ba-83cdd0b83ab6 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:41.337690 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19f10f9-fe8d-45a4-98ba-83cdd0b83ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:41.337914 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19f10f9-fe8d-45a4-98ba-83cdd0b83ab6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:41.342226 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19f10f9-fe8d-45a4-98ba-83cdd0b83ab6 None admin] RBAC: Adding query filter params (role.id=01769bbdbd2e48f2bf8e855ba6a8507e, scope.project.id=39913dbe3e984f27a61493dd75381501, user.id=6e2a05b782424ab2928b5864f1bfd556) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:41.342226 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19f10f9-fe8d-45a4-98ba-83cdd0b83ab6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:41.342226 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19f10f9-fe8d-45a4-98ba-83cdd0b83ab6 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:41.357894 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 333/674] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Oct 4 11:40:41 2022] GET /identity/v3/role_assignments?user.id=6e2a05b782424ab2928b5864f1bfd556&scope.project.id=39913dbe3e984f27a61493dd75381501&role.id=01769bbdbd2e48f2bf8e855ba6a8507e => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:41.357894 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19f10f9-fe8d-45a4-98ba-83cdd0b83ab6 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:41.366751 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e9327e-dd51-44b1-9c91-b0211dce6bfe None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:41.416391 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edc478d-55d1-44ee-8824-0b244376a21c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:41.417092 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edc478d-55d1-44ee-8824-0b244376a21c None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:41.417369 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edc478d-55d1-44ee-8824-0b244376a21c None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:41.418058 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edc478d-55d1-44ee-8824-0b244376a21c None admin] PATH_INFO: `/v3/roles/service` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:41.434125 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edc478d-55d1-44ee-8824-0b244376a21c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 11:40:41.442398 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-0edc478d-55d1-44ee-8824-0b244376a21c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 11:40:41.442398 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:41.442398 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:41.442398 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:41.442398 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:41.442398 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:41.442398 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:41.442398 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:41.442398 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:41.442398 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:41.442398 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:41.442398 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:41.442398 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 11:40:41.442398 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 11:40:41.442398 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 11:40:41.442398 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 11:40:41.443411 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 11:40:41.443411 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 11:40:41.443411 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 11:40:41.443411 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 11:40:41.443411 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:41.443411 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:41.443411 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:40:41.443411 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:40:41.443411 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:40:41.443411 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:40:41.443411 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:40:41.443411 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:40:41.443411 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:40:41.443411 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:40:41.443411 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:40:41.443411 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:40:41.444301 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:40:41.444301 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:40:41.444301 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:40:41.444301 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:40:41.444301 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 11:40:41.444301 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 11:40:41.444301 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 11:40:41.444301 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 11:40:41.444301 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 11:40:41.444301 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 11:40:41.444301 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 11:40:41.444301 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:40:41.444301 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 342/675] 10.222.0.59 () {56 vars in 1102 bytes} [Tue Oct 4 11:40:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:40:41.445028 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edc478d-55d1-44ee-8824-0b244376a21c None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:41.494438 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19f10f9-fe8d-45a4-98ba-83cdd0b83ab6 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:41.542681 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77fca3f-29c3-4239-b010-23c460cb94fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:41.543340 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77fca3f-29c3-4239-b010-23c460cb94fd None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:41.543622 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77fca3f-29c3-4239-b010-23c460cb94fd None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:41.544489 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77fca3f-29c3-4239-b010-23c460cb94fd None admin] PATH_INFO: `/v3/projects` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:41.545220 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77fca3f-29c3-4239-b010-23c460cb94fd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:41.545678 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77fca3f-29c3-4239-b010-23c460cb94fd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:41.547219 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77fca3f-29c3-4239-b010-23c460cb94fd None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:41.561151 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 334/676] 10.222.0.59 () {56 vars in 1148 bytes} [Tue Oct 4 11:40:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:41.562314 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77fca3f-29c3-4239-b010-23c460cb94fd None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:41.585258 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edc478d-55d1-44ee-8824-0b244376a21c None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:41.585726 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:41.616349 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:41.622375 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7aae32-4193-48cf-af00-64cfe5ff3c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:41.622989 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7aae32-4193-48cf-af00-64cfe5ff3c82 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:41.623276 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7aae32-4193-48cf-af00-64cfe5ff3c82 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:41.623981 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7aae32-4193-48cf-af00-64cfe5ff3c82 None admin] PATH_INFO: `/v3/domains` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:41.624653 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7aae32-4193-48cf-af00-64cfe5ff3c82 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:41.625143 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7aae32-4193-48cf-af00-64cfe5ff3c82 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:41.628492 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7aae32-4193-48cf-af00-64cfe5ff3c82 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:41.640391 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 343/677] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Oct 4 11:40:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:41.641245 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7aae32-4193-48cf-af00-64cfe5ff3c82 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:41.683052 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77fca3f-29c3-4239-b010-23c460cb94fd None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:41.719630 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a1cbcf-e6ae-47a7-b2ad-796ee820c6ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:41.720246 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a1cbcf-e6ae-47a7-b2ad-796ee820c6ee None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:41.720522 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a1cbcf-e6ae-47a7-b2ad-796ee820c6ee None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:41.720823 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a1cbcf-e6ae-47a7-b2ad-796ee820c6ee None admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:41.721517 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a1cbcf-e6ae-47a7-b2ad-796ee820c6ee None admin] RBAC: Adding query filter params (name=service) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:41.721931 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a1cbcf-e6ae-47a7-b2ad-796ee820c6ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:41.723315 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a1cbcf-e6ae-47a7-b2ad-796ee820c6ee None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:41.732351 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 335/678] 10.222.0.59 () {56 vars in 1103 bytes} [Tue Oct 4 11:40:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:41.733446 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a1cbcf-e6ae-47a7-b2ad-796ee820c6ee None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:41.748238 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7aae32-4193-48cf-af00-64cfe5ff3c82 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:41.788501 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2066a166-bb4e-47b3-b221-89d44b5688cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:41.789176 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2066a166-bb4e-47b3-b221-89d44b5688cc None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:41.789455 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2066a166-bb4e-47b3-b221-89d44b5688cc None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:41.789727 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2066a166-bb4e-47b3-b221-89d44b5688cc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:41.800803 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2066a166-bb4e-47b3-b221-89d44b5688cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 11:40:41.805557 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-2066a166-bb4e-47b3-b221-89d44b5688cc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 11:40:41.805557 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:41.805557 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:41.805557 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:41.805557 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:41.805557 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:41.805557 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:41.805557 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:41.805557 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:41.805557 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:41.805557 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:41.805557 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:41.805557 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 11:40:41.805557 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 11:40:41.805557 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 11:40:41.805557 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 11:40:41.806502 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 11:40:41.806502 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 11:40:41.806502 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 11:40:41.806502 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 11:40:41.806502 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:41.806502 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:41.806502 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:40:41.806502 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:40:41.806502 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:40:41.806502 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:40:41.806502 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:40:41.806502 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:40:41.806502 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:40:41.806502 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:40:41.806502 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:40:41.806502 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:40:41.807374 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:40:41.807374 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:40:41.807374 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:40:41.807374 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:40:41.807374 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 11:40:41.807374 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 11:40:41.807374 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 11:40:41.807374 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 11:40:41.807374 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 11:40:41.807374 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 11:40:41.807374 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 11:40:41.807374 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:40:41.811611 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 344/679] 10.222.0.59 () {56 vars in 1096 bytes} [Tue Oct 4 11:40:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:40:41.812445 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2066a166-bb4e-47b3-b221-89d44b5688cc None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:41.827022 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:41.847857 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a1cbcf-e6ae-47a7-b2ad-796ee820c6ee None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:41.865962 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:41.886632 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b7ac37-a926-476e-87e7-00ae4b005028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:41.887343 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b7ac37-a926-476e-87e7-00ae4b005028 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:41.887686 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b7ac37-a926-476e-87e7-00ae4b005028 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:41.888027 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b7ac37-a926-476e-87e7-00ae4b005028 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:41.888848 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b7ac37-a926-476e-87e7-00ae4b005028 None admin] RBAC: Adding query filter params (role.id=01769bbdbd2e48f2bf8e855ba6a8507e, scope.project.id=39913dbe3e984f27a61493dd75381501, user.id=e7289515c5c44914a19daa439de98cb1) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:41.889226 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b7ac37-a926-476e-87e7-00ae4b005028 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:41.890751 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b7ac37-a926-476e-87e7-00ae4b005028 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:41.908713 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 336/680] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Oct 4 11:40:41 2022] GET /identity/v3/role_assignments?user.id=e7289515c5c44914a19daa439de98cb1&scope.project.id=39913dbe3e984f27a61493dd75381501&role.id=01769bbdbd2e48f2bf8e855ba6a8507e => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:41.908713 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b7ac37-a926-476e-87e7-00ae4b005028 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:41.933301 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2066a166-bb4e-47b3-b221-89d44b5688cc None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:41.975813 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95f75c0-3b57-465f-9788-e3704b3a0d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:41.977055 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95f75c0-3b57-465f-9788-e3704b3a0d2e None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:41.977055 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95f75c0-3b57-465f-9788-e3704b3a0d2e None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:41.977480 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95f75c0-3b57-465f-9788-e3704b3a0d2e None admin] PATH_INFO: `/v3/projects/service` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:41.985371 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95f75c0-3b57-465f-9788-e3704b3a0d2e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:41.987601 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95f75c0-3b57-465f-9788-e3704b3a0d2e None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:42.000159 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-f95f75c0-3b57-465f-9788-e3704b3a0d2e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 11:40:42.000159 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:42.000159 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:42.000159 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:42.000159 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:42.000159 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:42.000159 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:42.000159 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:42.000159 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:42.000159 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:42.000159 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:42.000159 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:42.000159 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 11:40:42.000159 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 11:40:42.000159 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 11:40:42.001415 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 11:40:42.001415 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:42.001415 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:42.001415 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:40:42.001415 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:40:42.001415 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:40:42.001415 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:40:42.001415 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:40:42.001415 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:40:42.001415 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:40:42.001415 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:40:42.001415 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:40:42.001415 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:40:42.001415 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:40:42.001415 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:40:42.001415 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:40:42.001415 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:40:42.003210 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 11:40:42.003210 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 11:40:42.003210 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 11:40:42.003210 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 11:40:42.003210 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 11:40:42.003210 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 11:40:42.003210 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 11:40:42.003210 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:40:42.008983 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 345/681] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Oct 4 11:40:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:40:42.010090 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95f75c0-3b57-465f-9788-e3704b3a0d2e None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:42.065649 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b7ac37-a926-476e-87e7-00ae4b005028 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:42.117253 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42107bc8-134f-48ef-b587-750bd27f0d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:42.118136 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42107bc8-134f-48ef-b587-750bd27f0d06 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:42.118897 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42107bc8-134f-48ef-b587-750bd27f0d06 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:42.119181 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42107bc8-134f-48ef-b587-750bd27f0d06 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:42.132525 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42107bc8-134f-48ef-b587-750bd27f0d06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:42.133401 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95f75c0-3b57-465f-9788-e3704b3a0d2e None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:42.134727 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42107bc8-134f-48ef-b587-750bd27f0d06 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:42.144437 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:42.145031 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:42.155017 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-42107bc8-134f-48ef-b587-750bd27f0d06 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:40:42.155017 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:42.155017 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:42.155017 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:42.155017 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:42.155017 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:42.155017 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:42.155017 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:42.155017 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:42.155017 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:42.155017 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:42.155017 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:42.155017 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 11:40:42.155017 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 11:40:42.155017 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 11:40:42.155017 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 11:40:42.162393 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:42.162393 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:42.162393 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:40:42.162393 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:40:42.162393 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:40:42.162393 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:40:42.162393 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:40:42.162393 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:40:42.162393 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:40:42.162393 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:40:42.162393 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:40:42.162393 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:40:42.162393 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:40:42.162393 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:40:42.162393 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:40:42.162393 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:40:42.162393 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 11:40:42.163514 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 11:40:42.163514 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:40:42.163514 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:40:42.163514 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 337/682] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Oct 4 11:40:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:40:42.163514 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42107bc8-134f-48ef-b587-750bd27f0d06 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:42.179585 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f870e7-22f5-4518-9f20-f815c3732f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:42.180205 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f870e7-22f5-4518-9f20-f815c3732f54 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:42.180486 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f870e7-22f5-4518-9f20-f815c3732f54 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:42.180783 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f870e7-22f5-4518-9f20-f815c3732f54 None admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:42.181450 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f870e7-22f5-4518-9f20-f815c3732f54 None admin] RBAC: Adding query filter params (name=admin) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:42.181755 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f870e7-22f5-4518-9f20-f815c3732f54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:42.183140 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f870e7-22f5-4518-9f20-f815c3732f54 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:42.202549 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 346/683] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Oct 4 11:40:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:42.203456 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f870e7-22f5-4518-9f20-f815c3732f54 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:42.281156 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42107bc8-134f-48ef-b587-750bd27f0d06 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:42.307778 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f870e7-22f5-4518-9f20-f815c3732f54 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:42.325655 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5755dd76-6541-49a2-bbea-131386bde7a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:42.326608 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5755dd76-6541-49a2-bbea-131386bde7a2 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:42.327092 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5755dd76-6541-49a2-bbea-131386bde7a2 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:42.327594 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5755dd76-6541-49a2-bbea-131386bde7a2 None admin] PATH_INFO: `/v3/projects` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:42.328689 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5755dd76-6541-49a2-bbea-131386bde7a2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:42.329468 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5755dd76-6541-49a2-bbea-131386bde7a2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:42.331255 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5755dd76-6541-49a2-bbea-131386bde7a2 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:42.346453 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 338/684] 10.222.0.59 () {56 vars in 1148 bytes} [Tue Oct 4 11:40:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:42.347991 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5755dd76-6541-49a2-bbea-131386bde7a2 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:42.352673 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921713e0-c800-4034-a841-4a51983c68ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:42.353531 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921713e0-c800-4034-a841-4a51983c68ef None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:42.354110 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921713e0-c800-4034-a841-4a51983c68ef None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:42.354585 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921713e0-c800-4034-a841-4a51983c68ef None admin] PATH_INFO: `/v3/domains` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:42.355522 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921713e0-c800-4034-a841-4a51983c68ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:42.356038 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921713e0-c800-4034-a841-4a51983c68ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:42.357640 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921713e0-c800-4034-a841-4a51983c68ef None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:42.375321 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 347/685] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Oct 4 11:40:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:42.376593 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921713e0-c800-4034-a841-4a51983c68ef None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:42.419031 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:42.420993 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:42.466421 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5755dd76-6541-49a2-bbea-131386bde7a2 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:42.487285 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921713e0-c800-4034-a841-4a51983c68ef None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:42.509696 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc17ff3-dc88-4809-9088-fd58778077fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:42.509696 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc17ff3-dc88-4809-9088-fd58778077fa None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:42.509991 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc17ff3-dc88-4809-9088-fd58778077fa None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:42.510068 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc17ff3-dc88-4809-9088-fd58778077fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:42.523120 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc17ff3-dc88-4809-9088-fd58778077fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:42.526177 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc17ff3-dc88-4809-9088-fd58778077fa None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:42.536459 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ceb4c1-9114-4689-b426-b0ad2f137f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:42.537549 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ceb4c1-9114-4689-b426-b0ad2f137f3f None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:42.538029 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ceb4c1-9114-4689-b426-b0ad2f137f3f None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:42.538515 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ceb4c1-9114-4689-b426-b0ad2f137f3f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:42.539433 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ceb4c1-9114-4689-b426-b0ad2f137f3f None admin] RBAC: Adding query filter params (role.id=01769bbdbd2e48f2bf8e855ba6a8507e, scope.project.id=39913dbe3e984f27a61493dd75381501, user.id=d516d0755be84b7293156625df1b13b3) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:42.539954 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ceb4c1-9114-4689-b426-b0ad2f137f3f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:42.541600 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ceb4c1-9114-4689-b426-b0ad2f137f3f None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:42.543436 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-9bc17ff3-dc88-4809-9088-fd58778077fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:40:42.543436 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:42.543436 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:42.543436 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:42.543436 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:42.543436 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:42.543436 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:42.543436 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:42.543436 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:42.543436 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:42.543436 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:42.543436 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:42.543436 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 11:40:42.543436 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 11:40:42.543436 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 11:40:42.543436 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 11:40:42.544359 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:42.544359 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:42.544359 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:40:42.544359 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:40:42.544359 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:40:42.544359 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:40:42.544359 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:40:42.544359 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:40:42.544359 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:40:42.544359 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:40:42.544359 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:40:42.544359 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:40:42.544359 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:40:42.544359 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:40:42.544359 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:40:42.544359 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:40:42.544359 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 11:40:42.545313 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 11:40:42.545313 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:40:42.545313 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:40:42.549374 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 339/686] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Oct 4 11:40:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:40:42.550251 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc17ff3-dc88-4809-9088-fd58778077fa None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:42.551857 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 348/687] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Oct 4 11:40:42 2022] GET /identity/v3/role_assignments?user.id=d516d0755be84b7293156625df1b13b3&scope.project.id=39913dbe3e984f27a61493dd75381501&role.id=01769bbdbd2e48f2bf8e855ba6a8507e => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:42.557926 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ceb4c1-9114-4689-b426-b0ad2f137f3f None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:42.716545 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc17ff3-dc88-4809-9088-fd58778077fa None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:42.728359 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:42.754390 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615eafd2-813e-4772-96a2-59c2d22d88e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:42.755200 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615eafd2-813e-4772-96a2-59c2d22d88e7 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:42.755312 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615eafd2-813e-4772-96a2-59c2d22d88e7 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:42.755579 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615eafd2-813e-4772-96a2-59c2d22d88e7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:42.765287 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615eafd2-813e-4772-96a2-59c2d22d88e7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:42.766776 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615eafd2-813e-4772-96a2-59c2d22d88e7 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:42.780339 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-615eafd2-813e-4772-96a2-59c2d22d88e7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 04 11:40:42.780339 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:42.780339 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:42.780339 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:42.780339 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:42.780339 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:42.780339 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:42.780339 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:42.780339 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:42.780339 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:42.780339 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:42.780339 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:42.780339 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 11:40:42.780339 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 11:40:42.780339 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 11:40:42.780339 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 11:40:42.781413 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:42.781413 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:42.781413 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 11:40:42.781413 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 11:40:42.781413 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 11:40:42.781413 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 11:40:42.781413 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:40:42.781413 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:40:42.781413 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:40:42.781413 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:40:42.781413 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:40:42.781413 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:40:42.781413 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:40:42.781413 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:40:42.781413 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:40:42.781413 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:40:42.781413 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:40:42.781413 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:40:42.782371 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:40:42.782371 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:40:42.782371 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 11:40:42.782371 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 11:40:42.782371 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 11:40:42.782371 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 11:40:42.782371 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 11:40:42.782371 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 11:40:42.782371 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 04 11:40:42.782371 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:40:42.786335 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 340/688] 10.222.0.59 () {56 vars in 1096 bytes} [Tue Oct 4 11:40:42 2022] GET /identity/v3/users/swift => generated 83 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:40:42.792708 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615eafd2-813e-4772-96a2-59c2d22d88e7 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:42.811794 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:42.820550 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ceb4c1-9114-4689-b426-b0ad2f137f3f None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:42.864666 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d392820-3f71-4df1-82f0-fd2313655923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:42.865331 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d392820-3f71-4df1-82f0-fd2313655923 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:42.865610 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d392820-3f71-4df1-82f0-fd2313655923 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:42.865879 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d392820-3f71-4df1-82f0-fd2313655923 None admin] PATH_INFO: `/v3/domains` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:42.866519 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d392820-3f71-4df1-82f0-fd2313655923 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:42.866822 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d392820-3f71-4df1-82f0-fd2313655923 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:42.868196 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d392820-3f71-4df1-82f0-fd2313655923 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:42.883401 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 349/689] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Oct 4 11:40:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:42.897357 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d392820-3f71-4df1-82f0-fd2313655923 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:42.935195 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615eafd2-813e-4772-96a2-59c2d22d88e7 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:42.978911 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d620c54a-3d3c-43cd-8636-989366626db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:42.979863 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d620c54a-3d3c-43cd-8636-989366626db3 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:42.980324 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d620c54a-3d3c-43cd-8636-989366626db3 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:42.980812 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d620c54a-3d3c-43cd-8636-989366626db3 None admin] PATH_INFO: `/v3/users` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:42.981715 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d620c54a-3d3c-43cd-8636-989366626db3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:42.982213 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d620c54a-3d3c-43cd-8636-989366626db3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:42.983973 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d620c54a-3d3c-43cd-8636-989366626db3 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:43.005669 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 341/690] 10.222.0.59 () {56 vars in 1135 bytes} [Tue Oct 4 11:40:42 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 11:40:43.013354 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d620c54a-3d3c-43cd-8636-989366626db3 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:43.034994 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d392820-3f71-4df1-82f0-fd2313655923 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:43.046068 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:43.075062 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a09600-5180-46b7-9cc9-db9c2655ab1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:43.076036 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a09600-5180-46b7-9cc9-db9c2655ab1a None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:43.076539 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a09600-5180-46b7-9cc9-db9c2655ab1a None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:43.077406 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a09600-5180-46b7-9cc9-db9c2655ab1a None admin] PATH_INFO: `/v3/users/nova` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:43.087132 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a09600-5180-46b7-9cc9-db9c2655ab1a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:43.088984 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a09600-5180-46b7-9cc9-db9c2655ab1a None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:43.104120 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-29a09600-5180-46b7-9cc9-db9c2655ab1a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 04 11:40:43.104120 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:43.104120 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:43.104120 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:43.104120 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:43.104120 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:43.104120 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:43.104120 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:43.104120 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:43.104120 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:43.104120 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:43.104120 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:43.104120 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 11:40:43.104120 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 11:40:43.104120 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 11:40:43.104120 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 11:40:43.105141 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:43.105141 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:43.105141 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 11:40:43.105141 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 11:40:43.105141 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 11:40:43.105141 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 11:40:43.105141 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:40:43.105141 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:40:43.105141 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:40:43.105141 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:40:43.105141 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:40:43.105141 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:40:43.105141 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:40:43.105141 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:40:43.105141 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:40:43.105141 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:40:43.105141 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:40:43.105141 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:40:43.106224 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:40:43.106224 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:40:43.106224 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 11:40:43.106224 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 11:40:43.106224 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 11:40:43.106224 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 11:40:43.106224 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 11:40:43.106224 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 11:40:43.106224 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 04 11:40:43.106224 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:40:43.108903 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 350/691] 10.222.0.59 () {56 vars in 1093 bytes} [Tue Oct 4 11:40:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:40:43.115655 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a09600-5180-46b7-9cc9-db9c2655ab1a None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:43.146286 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d620c54a-3d3c-43cd-8636-989366626db3 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:43.163523 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:43.207235 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ce5872-85fe-4f82-9fe8-9089c331918d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:43.207892 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ce5872-85fe-4f82-9fe8-9089c331918d None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:43.208170 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ce5872-85fe-4f82-9fe8-9089c331918d None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:43.208441 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ce5872-85fe-4f82-9fe8-9089c331918d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:43.306886 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ce5872-85fe-4f82-9fe8-9089c331918d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:43.308381 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ce5872-85fe-4f82-9fe8-9089c331918d None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:43.311921 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a09600-5180-46b7-9cc9-db9c2655ab1a None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:43.363674 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:43.385822 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2343e32c-9769-4eff-9188-5e8ef6eef53d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:43.386602 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2343e32c-9769-4eff-9188-5e8ef6eef53d None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:43.386996 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2343e32c-9769-4eff-9188-5e8ef6eef53d None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:43.387372 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2343e32c-9769-4eff-9188-5e8ef6eef53d None admin] PATH_INFO: `/v3/users` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:43.388237 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2343e32c-9769-4eff-9188-5e8ef6eef53d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:43.388641 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2343e32c-9769-4eff-9188-5e8ef6eef53d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:43.390187 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2343e32c-9769-4eff-9188-5e8ef6eef53d None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:43.434928 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 351/692] 10.222.0.59 () {56 vars in 1133 bytes} [Tue Oct 4 11:40:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 11:40:43.435729 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2343e32c-9769-4eff-9188-5e8ef6eef53d None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:43.495577 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 342/693] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Oct 4 11:40:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 11:40:43.501236 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ce5872-85fe-4f82-9fe8-9089c331918d None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:43.591330 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:43.633612 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ce5872-85fe-4f82-9fe8-9089c331918d None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:43.649793 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2343e32c-9769-4eff-9188-5e8ef6eef53d None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:43.665159 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:43.675777 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7768bad8-daf0-464a-a3c8-6e4c399bbe4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:43.676869 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7768bad8-daf0-464a-a3c8-6e4c399bbe4f None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:43.677381 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7768bad8-daf0-464a-a3c8-6e4c399bbe4f None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:43.678121 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7768bad8-daf0-464a-a3c8-6e4c399bbe4f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:43.689185 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7768bad8-daf0-464a-a3c8-6e4c399bbe4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:43.691107 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7768bad8-daf0-464a-a3c8-6e4c399bbe4f None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:43.707915 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-7768bad8-daf0-464a-a3c8-6e4c399bbe4f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:40:43.707915 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:43.707915 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:43.707915 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:43.707915 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:43.707915 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:43.707915 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:43.707915 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:43.707915 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:43.707915 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:43.707915 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:43.707915 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:43.707915 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 11:40:43.707915 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 11:40:43.707915 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 11:40:43.707915 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 11:40:43.708948 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:43.708948 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:43.708948 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:40:43.708948 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:40:43.708948 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:40:43.708948 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:40:43.708948 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:40:43.708948 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:40:43.708948 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:40:43.708948 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:40:43.708948 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:40:43.708948 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:40:43.708948 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:40:43.708948 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:40:43.708948 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:40:43.708948 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:40:43.708948 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 11:40:43.709837 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 11:40:43.709837 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:40:43.709837 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:40:43.712077 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 343/694] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Oct 4 11:40:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:40:43.718877 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b697810e-7626-4cd2-ab25-89d8f13bdd6e None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:43.719422 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b697810e-7626-4cd2-ab25-89d8f13bdd6e None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:43.719897 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b697810e-7626-4cd2-ab25-89d8f13bdd6e None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:43.722730 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 344/695] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:40:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 11:40:43.723960 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b697810e-7626-4cd2-ab25-89d8f13bdd6e None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:43.731820 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ced55f3-e529-49ec-8a7d-a356413464e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:43.732944 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ced55f3-e529-49ec-8a7d-a356413464e8 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:43.732944 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ced55f3-e529-49ec-8a7d-a356413464e8 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:43.733135 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ced55f3-e529-49ec-8a7d-a356413464e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:43.815576 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ced55f3-e529-49ec-8a7d-a356413464e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:43.817907 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ced55f3-e529-49ec-8a7d-a356413464e8 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:43.852384 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b697810e-7626-4cd2-ab25-89d8f13bdd6e None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:43.891467 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95323ca3-95a8-4503-aa77-301b1d9773c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:43.892085 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95323ca3-95a8-4503-aa77-301b1d9773c4 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:43.892364 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95323ca3-95a8-4503-aa77-301b1d9773c4 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:43.892699 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95323ca3-95a8-4503-aa77-301b1d9773c4 None admin] PATH_INFO: `/v3/domains` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:43.894464 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95323ca3-95a8-4503-aa77-301b1d9773c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:43.894770 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95323ca3-95a8-4503-aa77-301b1d9773c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:43.896140 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95323ca3-95a8-4503-aa77-301b1d9773c4 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:43.908382 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 345/696] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Oct 4 11:40:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:43.914706 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9720d838-c8b7-4792-9400-7e9cbb295d7c None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:43.914993 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9720d838-c8b7-4792-9400-7e9cbb295d7c None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:43.915272 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9720d838-c8b7-4792-9400-7e9cbb295d7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:43.916761 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:43.934601 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-9720d838-c8b7-4792-9400-7e9cbb295d7c None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:40:43.935841 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-9720d838-c8b7-4792-9400-7e9cbb295d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:40:43.953012 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 352/697] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Oct 4 11:40:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 04 11:40:43.954323 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ced55f3-e529-49ec-8a7d-a356413464e8 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:43.974889 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:44.015184 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 346/698] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:40:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 11:40:44.015184 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9720d838-c8b7-4792-9400-7e9cbb295d7c None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:44.075756 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ced55f3-e529-49ec-8a7d-a356413464e8 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:44.116873 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc32cfe5-3b4b-4fbf-b8a6-6e896b452f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:44.117928 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc32cfe5-3b4b-4fbf-b8a6-6e896b452f80 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:44.118490 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc32cfe5-3b4b-4fbf-b8a6-6e896b452f80 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:44.119006 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc32cfe5-3b4b-4fbf-b8a6-6e896b452f80 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:44.126550 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc32cfe5-3b4b-4fbf-b8a6-6e896b452f80 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:44.128395 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc32cfe5-3b4b-4fbf-b8a6-6e896b452f80 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:44.132562 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9720d838-c8b7-4792-9400-7e9cbb295d7c None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:44.141106 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-bc32cfe5-3b4b-4fbf-b8a6-6e896b452f80 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 11:40:44.141106 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:44.141106 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:44.141106 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:44.141106 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:44.141106 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:44.141106 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:44.141106 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:44.141106 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:44.141106 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:44.141106 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:44.141106 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:44.141106 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 11:40:44.141106 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 11:40:44.141106 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 11:40:44.142022 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 11:40:44.142022 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:44.142022 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:44.142022 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:40:44.142022 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:40:44.142022 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:40:44.142022 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:40:44.142022 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:40:44.142022 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:40:44.142022 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:40:44.142022 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:40:44.142022 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:40:44.142022 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:40:44.142022 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:40:44.142022 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:40:44.142022 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:40:44.142022 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:40:44.143512 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 11:40:44.143512 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 11:40:44.143512 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 11:40:44.143512 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 11:40:44.143512 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 11:40:44.143512 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 11:40:44.143512 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 11:40:44.143512 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:40:44.145855 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 353/699] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Oct 4 11:40:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:40:44.154159 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc32cfe5-3b4b-4fbf-b8a6-6e896b452f80 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:44.173729 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a5f86c-da78-49ee-9eaa-f9f754e325fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:44.175561 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a5f86c-da78-49ee-9eaa-f9f754e325fe None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:44.175843 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a5f86c-da78-49ee-9eaa-f9f754e325fe None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:44.176113 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a5f86c-da78-49ee-9eaa-f9f754e325fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:44.187141 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a5f86c-da78-49ee-9eaa-f9f754e325fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:44.188654 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a5f86c-da78-49ee-9eaa-f9f754e325fe None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:44.197788 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:44.205859 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-15a5f86c-da78-49ee-9eaa-f9f754e325fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:40:44.205859 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:44.205859 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:44.205859 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:44.205859 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:44.205859 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:44.205859 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:44.205859 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:44.205859 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:44.205859 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:44.205859 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:44.205859 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:44.205859 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 11:40:44.205859 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 11:40:44.205859 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 11:40:44.205859 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 11:40:44.206994 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:44.206994 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:44.206994 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:40:44.206994 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:40:44.206994 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:40:44.206994 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:40:44.206994 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:40:44.206994 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:40:44.206994 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:40:44.206994 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:40:44.206994 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:40:44.206994 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:40:44.206994 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:40:44.206994 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:40:44.206994 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:40:44.206994 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:40:44.206994 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 11:40:44.207947 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 11:40:44.207947 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:40:44.207947 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:40:44.211621 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 347/700] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Oct 4 11:40:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:40:44.212865 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a5f86c-da78-49ee-9eaa-f9f754e325fe None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:44.239926 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:44.279327 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc32cfe5-3b4b-4fbf-b8a6-6e896b452f80 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:44.318606 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6543020c-6529-4aa1-a96d-f3297b13f823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:44.319625 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6543020c-6529-4aa1-a96d-f3297b13f823 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:44.320113 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6543020c-6529-4aa1-a96d-f3297b13f823 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:44.320500 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a5f86c-da78-49ee-9eaa-f9f754e325fe None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:44.320847 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6543020c-6529-4aa1-a96d-f3297b13f823 None admin] PATH_INFO: `/v3/projects` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:44.321914 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6543020c-6529-4aa1-a96d-f3297b13f823 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:44.322461 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6543020c-6529-4aa1-a96d-f3297b13f823 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:44.324210 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6543020c-6529-4aa1-a96d-f3297b13f823 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:44.337918 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 354/701] 10.222.0.59 () {56 vars in 1148 bytes} [Tue Oct 4 11:40:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:44.344009 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6543020c-6529-4aa1-a96d-f3297b13f823 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:44.356835 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280800a8-14ed-4f69-b85b-9112919756d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:44.357450 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280800a8-14ed-4f69-b85b-9112919756d2 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:44.357728 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280800a8-14ed-4f69-b85b-9112919756d2 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:44.357999 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280800a8-14ed-4f69-b85b-9112919756d2 None admin] PATH_INFO: `/v3/domains` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:44.358639 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280800a8-14ed-4f69-b85b-9112919756d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:44.358941 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280800a8-14ed-4f69-b85b-9112919756d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:44.360302 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280800a8-14ed-4f69-b85b-9112919756d2 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:44.378712 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 348/702] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Oct 4 11:40:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:44.379531 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280800a8-14ed-4f69-b85b-9112919756d2 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:44.455294 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:44.465077 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6543020c-6529-4aa1-a96d-f3297b13f823 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:44.491883 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:44.506083 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad47211-df1d-4efc-aa47-51dd34172464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:44.512548 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad47211-df1d-4efc-aa47-51dd34172464 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:44.512973 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad47211-df1d-4efc-aa47-51dd34172464 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:44.513385 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad47211-df1d-4efc-aa47-51dd34172464 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:44.514271 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280800a8-14ed-4f69-b85b-9112919756d2 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:44.514485 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad47211-df1d-4efc-aa47-51dd34172464 None admin] RBAC: Adding query filter params (role.id=01769bbdbd2e48f2bf8e855ba6a8507e, scope.project.id=39913dbe3e984f27a61493dd75381501, user.id=1605c3e03b7a4bcba4e19f0d92c671bc) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:44.514910 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad47211-df1d-4efc-aa47-51dd34172464 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:44.516628 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad47211-df1d-4efc-aa47-51dd34172464 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:44.534128 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 355/703] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Oct 4 11:40:44 2022] GET /identity/v3/role_assignments?user.id=1605c3e03b7a4bcba4e19f0d92c671bc&scope.project.id=39913dbe3e984f27a61493dd75381501&role.id=01769bbdbd2e48f2bf8e855ba6a8507e => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 11:40:44.535579 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad47211-df1d-4efc-aa47-51dd34172464 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:44.565156 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd88ddb-1d27-4267-8a17-9a784034d0f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:44.568224 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd88ddb-1d27-4267-8a17-9a784034d0f4 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:44.568503 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd88ddb-1d27-4267-8a17-9a784034d0f4 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:44.569463 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd88ddb-1d27-4267-8a17-9a784034d0f4 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:44.570830 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd88ddb-1d27-4267-8a17-9a784034d0f4 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:44.575831 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd88ddb-1d27-4267-8a17-9a784034d0f4 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:44.590812 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-1cd88ddb-1d27-4267-8a17-9a784034d0f4 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 04 11:40:44.590812 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:44.590812 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 11:40:44.590812 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 11:40:44.590812 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 11:40:44.590812 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 11:40:44.590812 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 11:40:44.590812 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 11:40:44.590812 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 04 11:40:44.590812 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:40:44.590812 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 11:40:44.590812 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:40:44.590812 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:44.590812 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:44.590812 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:44.590812 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:44.590812 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:44.592186 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:44.592186 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:44.592186 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:44.592186 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:44.592186 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:44.592186 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:44.592186 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 11:40:44.592186 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 11:40:44.592186 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 11:40:44.592186 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 11:40:44.592186 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:44.592186 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:44.592186 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:40:44.592186 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:40:44.592186 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:40:44.592186 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:40:44.593351 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:40:44.593351 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:40:44.593351 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:40:44.593351 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:40:44.593351 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:40:44.593351 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:40:44.593351 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:40:44.593351 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:40:44.593351 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:40:44.593351 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:40:44.593351 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 11:40:44.593351 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 11:40:44.593351 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 04 11:40:44.593351 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:40:44.593351 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 349/704] 10.222.0.59 () {56 vars in 1129 bytes} [Tue Oct 4 11:40:44 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:40:44.596417 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2f0519-a007-40e9-9806-6586920c5add None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:44.596417 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2f0519-a007-40e9-9806-6586920c5add None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:44.599775 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2f0519-a007-40e9-9806-6586920c5add None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:44.599775 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 350/705] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:40:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:40:44.600542 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2f0519-a007-40e9-9806-6586920c5add None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:44.701046 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad47211-df1d-4efc-aa47-51dd34172464 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:44.739641 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2f0519-a007-40e9-9806-6586920c5add None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:44.749017 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713e049a-fb01-4b92-aa2d-fe828db66c7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:44.750163 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713e049a-fb01-4b92-aa2d-fe828db66c7f None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:44.750434 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713e049a-fb01-4b92-aa2d-fe828db66c7f None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:44.751103 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713e049a-fb01-4b92-aa2d-fe828db66c7f None admin] PATH_INFO: `/v3/projects/service` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:44.761596 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713e049a-fb01-4b92-aa2d-fe828db66c7f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:44.763090 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713e049a-fb01-4b92-aa2d-fe828db66c7f None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:44.778330 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-713e049a-fb01-4b92-aa2d-fe828db66c7f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 11:40:44.778330 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:44.778330 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:44.778330 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:44.778330 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:44.778330 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:44.778330 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:44.778330 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:44.778330 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:44.778330 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:44.778330 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:44.778330 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:44.778330 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 11:40:44.778330 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 11:40:44.778330 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 11:40:44.779336 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 11:40:44.779336 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:44.779336 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:44.779336 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:40:44.779336 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:40:44.779336 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:40:44.779336 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:40:44.779336 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:40:44.779336 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:40:44.779336 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:40:44.779336 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:40:44.779336 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:40:44.779336 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:40:44.779336 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:40:44.779336 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:40:44.779336 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:40:44.779336 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:40:44.780258 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 11:40:44.780258 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 11:40:44.780258 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 11:40:44.780258 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 11:40:44.780258 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 11:40:44.780258 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 11:40:44.780258 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 11:40:44.780258 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:40:44.784712 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 356/706] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Oct 4 11:40:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:40:44.786034 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201bd1dc-a1e6-48c5-8481-41c97c4e6d37 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:44.786325 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201bd1dc-a1e6-48c5-8481-41c97c4e6d37 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:44.786606 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201bd1dc-a1e6-48c5-8481-41c97c4e6d37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:44.787180 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ec2096-e340-4ff8-a71b-763011dd5b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:44.787940 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ec2096-e340-4ff8-a71b-763011dd5b66 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:44.788363 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ec2096-e340-4ff8-a71b-763011dd5b66 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:44.788804 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ec2096-e340-4ff8-a71b-763011dd5b66 None admin] PATH_INFO: `/v3/services` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:44.789539 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ec2096-e340-4ff8-a71b-763011dd5b66 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:44.789997 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ec2096-e340-4ff8-a71b-763011dd5b66 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:44.791454 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ec2096-e340-4ff8-a71b-763011dd5b66 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:44.796391 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 351/707] 10.222.0.59 () {56 vars in 1124 bytes} [Tue Oct 4 11:40:44 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:44.797277 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ec2096-e340-4ff8-a71b-763011dd5b66 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:44.807229 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-201bd1dc-a1e6-48c5-8481-41c97c4e6d37 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:40:44.808636 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-201bd1dc-a1e6-48c5-8481-41c97c4e6d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:40:44.815020 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:44.824512 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:44.893727 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 357/708] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:40:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 11:40:44.894603 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201bd1dc-a1e6-48c5-8481-41c97c4e6d37 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:44.937042 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ec2096-e340-4ff8-a71b-763011dd5b66 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:44.980628 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f92b8ba-5e52-413a-835d-9cd19da4a1a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:44.981486 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f92b8ba-5e52-413a-835d-9cd19da4a1a0 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:44.981866 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f92b8ba-5e52-413a-835d-9cd19da4a1a0 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:44.982290 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f92b8ba-5e52-413a-835d-9cd19da4a1a0 None admin] PATH_INFO: `/v3/projects` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:44.983390 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f92b8ba-5e52-413a-835d-9cd19da4a1a0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:44.983566 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f92b8ba-5e52-413a-835d-9cd19da4a1a0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:44.985192 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f92b8ba-5e52-413a-835d-9cd19da4a1a0 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:45.005027 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 352/709] 10.222.0.59 () {56 vars in 1148 bytes} [Tue Oct 4 11:40:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:45.011022 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f92b8ba-5e52-413a-835d-9cd19da4a1a0 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:45.019052 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201bd1dc-a1e6-48c5-8481-41c97c4e6d37 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:45.069213 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3bcb55-2b68-4e44-ab74-9f22b612c251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:45.069978 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3bcb55-2b68-4e44-ab74-9f22b612c251 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:45.070312 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3bcb55-2b68-4e44-ab74-9f22b612c251 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:45.070586 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3bcb55-2b68-4e44-ab74-9f22b612c251 None admin] PATH_INFO: `/v3/services` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:45.071221 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3bcb55-2b68-4e44-ab74-9f22b612c251 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:45.071519 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3bcb55-2b68-4e44-ab74-9f22b612c251 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:45.072918 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3bcb55-2b68-4e44-ab74-9f22b612c251 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:45.084170 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 358/710] 10.222.0.59 () {56 vars in 1124 bytes} [Tue Oct 4 11:40:44 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:45.129881 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:45.176123 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f92b8ba-5e52-413a-835d-9cd19da4a1a0 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:45.235900 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98deb686-bc32-4eaa-bfa7-7ef1ff43599b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:45.236483 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98deb686-bc32-4eaa-bfa7-7ef1ff43599b None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:45.237382 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98deb686-bc32-4eaa-bfa7-7ef1ff43599b None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:45.237846 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98deb686-bc32-4eaa-bfa7-7ef1ff43599b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:45.238708 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98deb686-bc32-4eaa-bfa7-7ef1ff43599b None admin] RBAC: Adding query filter params (role.id=d6e7421d1ff9451c808004b818354550, scope.project.id=39913dbe3e984f27a61493dd75381501, user.id=a8e23d1d2fe24bdf9552e7c2f0ae3424) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:45.239013 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98deb686-bc32-4eaa-bfa7-7ef1ff43599b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:45.240479 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98deb686-bc32-4eaa-bfa7-7ef1ff43599b None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:45.254055 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 353/711] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Oct 4 11:40:45 2022] GET /identity/v3/role_assignments?user.id=a8e23d1d2fe24bdf9552e7c2f0ae3424&scope.project.id=39913dbe3e984f27a61493dd75381501&role.id=d6e7421d1ff9451c808004b818354550 => generated 259 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:45.294048 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3bcb55-2b68-4e44-ab74-9f22b612c251 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:45.324336 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:45.344700 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0877c9aa-1a33-4f8d-8dab-b8c1d3fcda2b None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:45.345013 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0877c9aa-1a33-4f8d-8dab-b8c1d3fcda2b None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:45.345260 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0877c9aa-1a33-4f8d-8dab-b8c1d3fcda2b None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:45.347335 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 354/712] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:40:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 11:40:45.354514 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ae1548-0653-4b49-9480-383ed424eae7 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:45.354866 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ae1548-0653-4b49-9480-383ed424eae7 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:45.355105 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ae1548-0653-4b49-9480-383ed424eae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:45.381643 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-85ae1548-0653-4b49-9480-383ed424eae7 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:40:45.382866 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-85ae1548-0653-4b49-9480-383ed424eae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:40:45.471954 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 355/713] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:40:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 11:40:45.475678 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3bcb55-2b68-4e44-ab74-9f22b612c251 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:45.516706 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203d0849-79b3-4888-99f6-a63f5c5ad8db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:45.518232 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203d0849-79b3-4888-99f6-a63f5c5ad8db None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:45.518736 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203d0849-79b3-4888-99f6-a63f5c5ad8db None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:45.519213 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203d0849-79b3-4888-99f6-a63f5c5ad8db None admin] PATH_INFO: `/v3/services/network` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:45.520143 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203d0849-79b3-4888-99f6-a63f5c5ad8db None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:45.521779 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203d0849-79b3-4888-99f6-a63f5c5ad8db None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:45.536003 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-203d0849-79b3-4888-99f6-a63f5c5ad8db None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 04 11:40:45.536003 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:45.536003 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 11:40:45.536003 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 11:40:45.536003 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 11:40:45.536003 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 11:40:45.536003 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 11:40:45.536003 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 11:40:45.536003 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 04 11:40:45.536003 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:40:45.536003 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 11:40:45.536003 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:40:45.536003 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:45.536003 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:45.536003 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:45.536003 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:45.536003 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:45.537176 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:45.537176 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:45.537176 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:45.537176 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:45.537176 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:45.537176 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:45.537176 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 11:40:45.537176 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 11:40:45.537176 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 11:40:45.537176 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 11:40:45.537176 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:45.537176 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:45.537176 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:40:45.537176 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:40:45.537176 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:40:45.537176 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:40:45.538063 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:40:45.538063 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:40:45.538063 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:40:45.538063 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:40:45.538063 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:40:45.538063 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:40:45.538063 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:40:45.538063 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:40:45.538063 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:40:45.538063 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:40:45.538063 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 11:40:45.538063 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 11:40:45.538063 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 04 11:40:45.538063 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:40:45.546626 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 359/714] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Oct 4 11:40:45 2022] GET /identity/v3/services/network => generated 88 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:40:45.557763 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ae1548-0653-4b49-9480-383ed424eae7 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:45.650388 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:45.697173 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ae1548-0653-4b49-9480-383ed424eae7 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:45.754130 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd49f865-3c34-45b5-a307-801e22d47db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:45.755479 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd49f865-3c34-45b5-a307-801e22d47db2 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:45.755479 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd49f865-3c34-45b5-a307-801e22d47db2 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:45.755479 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd49f865-3c34-45b5-a307-801e22d47db2 None admin] PATH_INFO: `/v3/services` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:45.755994 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd49f865-3c34-45b5-a307-801e22d47db2 None admin] RBAC: Adding query filter params (name=network) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:45.756292 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd49f865-3c34-45b5-a307-801e22d47db2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:45.760175 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd49f865-3c34-45b5-a307-801e22d47db2 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:45.763381 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 356/715] 10.222.0.59 () {56 vars in 1112 bytes} [Tue Oct 4 11:40:45 2022] GET /identity/v3/services?name=network => generated 124 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:45.770055 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203d0849-79b3-4888-99f6-a63f5c5ad8db None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:45.815140 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd49f865-3c34-45b5-a307-801e22d47db2 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:45.989928 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd49f865-3c34-45b5-a307-801e22d47db2 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:46.060420 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:46.079160 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e48ccac-6e10-45f6-af2c-0972e969ddb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:46.080274 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e48ccac-6e10-45f6-af2c-0972e969ddb0 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:46.080756 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e48ccac-6e10-45f6-af2c-0972e969ddb0 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:46.081217 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e48ccac-6e10-45f6-af2c-0972e969ddb0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:46.088161 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:46.113561 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e48ccac-6e10-45f6-af2c-0972e969ddb0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:46.117220 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e48ccac-6e10-45f6-af2c-0972e969ddb0 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:46.144289 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203d0849-79b3-4888-99f6-a63f5c5ad8db None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:46.155489 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-0e48ccac-6e10-45f6-af2c-0972e969ddb0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:40:46.155489 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:46.155489 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:46.155489 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:46.155489 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:46.155489 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:46.155489 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:46.155489 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:46.155489 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:46.155489 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:46.155489 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:46.155489 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:46.155489 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 11:40:46.155489 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 11:40:46.155489 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 11:40:46.155489 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 11:40:46.156528 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:46.156528 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:46.156528 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:40:46.156528 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:40:46.156528 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:40:46.156528 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:40:46.156528 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:40:46.156528 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:40:46.156528 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:40:46.156528 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:40:46.156528 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:40:46.156528 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:40:46.156528 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:40:46.156528 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:40:46.156528 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:40:46.156528 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:40:46.156528 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 11:40:46.157479 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 11:40:46.157479 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:40:46.157479 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:40:46.158616 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 357/716] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Oct 4 11:40:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:40:46.166323 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e48ccac-6e10-45f6-af2c-0972e969ddb0 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:46.232522 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6fabe2-23d1-41ea-a9ee-2aac49a6b793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:46.233169 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6fabe2-23d1-41ea-a9ee-2aac49a6b793 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:46.233447 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6fabe2-23d1-41ea-a9ee-2aac49a6b793 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:46.233899 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6fabe2-23d1-41ea-a9ee-2aac49a6b793 None admin] PATH_INFO: `/v3/services` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:46.235647 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6fabe2-23d1-41ea-a9ee-2aac49a6b793 None admin] RBAC: Adding query filter params (type=network) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:46.235962 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6fabe2-23d1-41ea-a9ee-2aac49a6b793 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:46.239487 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6fabe2-23d1-41ea-a9ee-2aac49a6b793 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:46.261132 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 360/717] 10.222.0.59 () {56 vars in 1112 bytes} [Tue Oct 4 11:40:45 2022] GET /identity/v3/services?type=network => generated 124 bytes in 491 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:46.375240 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e48ccac-6e10-45f6-af2c-0972e969ddb0 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:46.441618 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33519636-dbef-4bd7-aaf8-535f86b3a2d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:46.443177 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33519636-dbef-4bd7-aaf8-535f86b3a2d2 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:46.443668 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33519636-dbef-4bd7-aaf8-535f86b3a2d2 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:46.444142 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33519636-dbef-4bd7-aaf8-535f86b3a2d2 None admin] PATH_INFO: `/v3/domains` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:46.445085 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33519636-dbef-4bd7-aaf8-535f86b3a2d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:46.445616 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33519636-dbef-4bd7-aaf8-535f86b3a2d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:46.447298 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33519636-dbef-4bd7-aaf8-535f86b3a2d2 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:46.467951 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 358/718] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Oct 4 11:40:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:46.478402 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6fabe2-23d1-41ea-a9ee-2aac49a6b793 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:46.606951 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6fabe2-23d1-41ea-a9ee-2aac49a6b793 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:46.649893 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027fd514-c738-4917-8649-cf2e3766558a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:46.650419 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027fd514-c738-4917-8649-cf2e3766558a None admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:46.650693 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027fd514-c738-4917-8649-cf2e3766558a None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:46.650967 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027fd514-c738-4917-8649-cf2e3766558a None admin] PATH_INFO: `/v3/users` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:46.651671 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027fd514-c738-4917-8649-cf2e3766558a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:46.653138 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027fd514-c738-4917-8649-cf2e3766558a None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:46.665507 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:46.789206 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 361/719] 10.222.0.59 () {60 vars in 1132 bytes} [Tue Oct 4 11:40:46 2022] POST /identity/v3/users => generated 254 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 11:40:47.359560 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69a3549-36b0-4cd9-9598-805316af8a8d None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:47.360825 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69a3549-36b0-4cd9-9598-805316af8a8d None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:47.361840 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69a3549-36b0-4cd9-9598-805316af8a8d None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:47.365431 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 359/720] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:40:47 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:40:47.370888 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca12a48-5e56-4272-8cdd-6b7fbb4aed2e None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:47.371166 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca12a48-5e56-4272-8cdd-6b7fbb4aed2e None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:47.371437 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca12a48-5e56-4272-8cdd-6b7fbb4aed2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:47.403935 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-1ca12a48-5e56-4272-8cdd-6b7fbb4aed2e None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:40:47.405502 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-1ca12a48-5e56-4272-8cdd-6b7fbb4aed2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:40:47.488381 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 362/721] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:40:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 11:40:47.911191 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ee221a-5595-4b6a-9891-9c22a39fa7fc None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:47.911716 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ee221a-5595-4b6a-9891-9c22a39fa7fc None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:47.911716 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ee221a-5595-4b6a-9891-9c22a39fa7fc None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:47.913355 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 360/722] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:40:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:40:47.918761 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9970acca-cb49-4b11-8556-fe5788ea8213 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:47.919052 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9970acca-cb49-4b11-8556-fe5788ea8213 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:47.919328 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9970acca-cb49-4b11-8556-fe5788ea8213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:47.943291 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ee221a-5595-4b6a-9891-9c22a39fa7fc None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:47.945073 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-9970acca-cb49-4b11-8556-fe5788ea8213 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:40:47.946392 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-9970acca-cb49-4b11-8556-fe5788ea8213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:40:47.999761 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:48.030040 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 363/723] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:40:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 11:40:48.031668 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e870d34-6598-42ff-b12d-8b4e4ed575d5 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:48.032150 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e870d34-6598-42ff-b12d-8b4e4ed575d5 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:48.032664 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e870d34-6598-42ff-b12d-8b4e4ed575d5 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:48.034399 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 364/724] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:40:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:40:48.039966 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8ca3bd-c311-42dd-829f-ced461155fa4 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:48.040507 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8ca3bd-c311-42dd-829f-ced461155fa4 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:48.041028 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8ca3bd-c311-42dd-829f-ced461155fa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:48.059821 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-da8ca3bd-c311-42dd-829f-ced461155fa4 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:40:48.061333 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-da8ca3bd-c311-42dd-829f-ced461155fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:40:48.077627 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ee221a-5595-4b6a-9891-9c22a39fa7fc None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:48.115843 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:48.122866 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dc1416-802d-4e4f-8515-1cf9205bbf66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:48.123507 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dc1416-802d-4e4f-8515-1cf9205bbf66 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:48.124078 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dc1416-802d-4e4f-8515-1cf9205bbf66 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:48.124078 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dc1416-802d-4e4f-8515-1cf9205bbf66 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:48.135607 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 365/725] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:40:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 11:40:48.140158 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dc1416-802d-4e4f-8515-1cf9205bbf66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 11:40:48.141780 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-97dc1416-802d-4e4f-8515-1cf9205bbf66 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 11:40:48.141780 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:48.141780 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:48.141780 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:48.141780 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:48.141780 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:48.141780 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:48.141780 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:48.141780 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:48.141780 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:48.141780 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:48.141780 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:48.141780 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 11:40:48.141780 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 11:40:48.141780 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 11:40:48.141780 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 11:40:48.143257 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 11:40:48.143257 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 11:40:48.143257 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 11:40:48.143257 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 11:40:48.143257 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:48.143257 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:48.143257 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:40:48.143257 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:40:48.143257 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:40:48.143257 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:40:48.143257 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:40:48.143257 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:40:48.143257 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:40:48.143257 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:40:48.143257 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:40:48.143257 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:40:48.144398 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:40:48.144398 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:40:48.144398 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:40:48.144398 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:40:48.144398 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 11:40:48.144398 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 11:40:48.144398 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 11:40:48.144398 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 11:40:48.144398 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 11:40:48.144398 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 11:40:48.144398 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 11:40:48.144398 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:40:48.144398 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 361/726] 10.222.0.59 () {56 vars in 1096 bytes} [Tue Oct 4 11:40:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:40:48.153875 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8ca3bd-c311-42dd-829f-ced461155fa4 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:48.259372 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8ca3bd-c311-42dd-829f-ced461155fa4 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:48.294882 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f08c875-fdb4-49f9-a0e7-15a98a102e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:48.295491 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f08c875-fdb4-49f9-a0e7-15a98a102e67 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:48.295766 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f08c875-fdb4-49f9-a0e7-15a98a102e67 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:48.296036 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f08c875-fdb4-49f9-a0e7-15a98a102e67 None admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:48.296864 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f08c875-fdb4-49f9-a0e7-15a98a102e67 None admin] RBAC: Adding query filter params (name=admin) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:48.297167 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f08c875-fdb4-49f9-a0e7-15a98a102e67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:48.298534 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f08c875-fdb4-49f9-a0e7-15a98a102e67 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:48.307407 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 366/727] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Oct 4 11:40:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 11:40:48.313209 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dc1416-802d-4e4f-8515-1cf9205bbf66 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:48.411323 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f08c875-fdb4-49f9-a0e7-15a98a102e67 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:48.417530 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:48.420775 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dc1416-802d-4e4f-8515-1cf9205bbf66 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:48.459278 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aed1ad-d11f-44e5-9565-41777a567c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:48.460313 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aed1ad-d11f-44e5-9565-41777a567c7e None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:48.460834 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aed1ad-d11f-44e5-9565-41777a567c7e None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:48.461402 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aed1ad-d11f-44e5-9565-41777a567c7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:48.473893 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0aed1ad-d11f-44e5-9565-41777a567c7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:48.476038 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0aed1ad-d11f-44e5-9565-41777a567c7e None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:48.478263 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:48.493108 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-b0aed1ad-d11f-44e5-9565-41777a567c7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:40:48.493108 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:48.493108 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:48.493108 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:48.493108 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:48.493108 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:48.493108 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:48.493108 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:48.493108 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:48.493108 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:48.493108 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:48.493108 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:48.493108 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 11:40:48.493108 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 11:40:48.493108 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 11:40:48.493108 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 11:40:48.494106 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:48.494106 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:48.494106 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:40:48.494106 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:40:48.494106 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:40:48.494106 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:40:48.494106 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:40:48.494106 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:40:48.494106 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:40:48.494106 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:40:48.494106 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:40:48.494106 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:40:48.494106 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:40:48.494106 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:40:48.494106 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:40:48.494106 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:40:48.494106 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 11:40:48.495541 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 11:40:48.495541 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:40:48.495541 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:40:48.497527 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 362/728] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Oct 4 11:40:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:40:48.498699 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aed1ad-d11f-44e5-9565-41777a567c7e None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:48.548770 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f08c875-fdb4-49f9-a0e7-15a98a102e67 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:48.585574 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257860b2-5dff-40a0-bdbc-0e3b2f5c0424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:48.586450 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257860b2-5dff-40a0-bdbc-0e3b2f5c0424 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:48.586884 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257860b2-5dff-40a0-bdbc-0e3b2f5c0424 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:48.587368 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257860b2-5dff-40a0-bdbc-0e3b2f5c0424 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:48.598548 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257860b2-5dff-40a0-bdbc-0e3b2f5c0424 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 11:40:48.604201 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-257860b2-5dff-40a0-bdbc-0e3b2f5c0424 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 11:40:48.604201 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:48.604201 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:48.604201 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:48.604201 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:48.604201 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:48.604201 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:48.604201 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:48.604201 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:48.604201 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:48.604201 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:48.604201 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:48.604201 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 11:40:48.604201 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 11:40:48.604201 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 11:40:48.604201 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 11:40:48.605221 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 11:40:48.605221 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 11:40:48.605221 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 11:40:48.605221 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 11:40:48.605221 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:48.605221 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:48.605221 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:40:48.605221 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:40:48.605221 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:40:48.605221 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:40:48.605221 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:40:48.605221 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:40:48.605221 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:40:48.605221 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:40:48.605221 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:40:48.605221 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:40:48.606116 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:40:48.606116 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:40:48.606116 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:40:48.606116 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:40:48.606116 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 11:40:48.606116 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 11:40:48.606116 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 11:40:48.606116 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 11:40:48.606116 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 11:40:48.606116 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 11:40:48.606116 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 11:40:48.606116 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:40:48.613708 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 367/729] 10.222.0.59 () {56 vars in 1096 bytes} [Tue Oct 4 11:40:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:40:48.614578 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aed1ad-d11f-44e5-9565-41777a567c7e None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:48.615108 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257860b2-5dff-40a0-bdbc-0e3b2f5c0424 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:48.657604 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cddb50-3631-463a-8328-0678de562976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:48.658538 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cddb50-3631-463a-8328-0678de562976 None admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:48.658968 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cddb50-3631-463a-8328-0678de562976 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:48.659773 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cddb50-3631-463a-8328-0678de562976 None admin] PATH_INFO: `/v3/services` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:48.660663 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cddb50-3631-463a-8328-0678de562976 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:48.662850 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cddb50-3631-463a-8328-0678de562976 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:48.732137 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257860b2-5dff-40a0-bdbc-0e3b2f5c0424 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:48.744097 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:48.780702 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 363/730] 10.222.0.59 () {60 vars in 1141 bytes} [Tue Oct 4 11:40:48 2022] POST /identity/v3/services => generated 251 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 11:40:48.780702 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cddb50-3631-463a-8328-0678de562976 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:48.780958 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4eb024-75b0-430d-8414-530f0ed6bbe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:48.780958 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4eb024-75b0-430d-8414-530f0ed6bbe4 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:48.780958 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4eb024-75b0-430d-8414-530f0ed6bbe4 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:48.780958 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4eb024-75b0-430d-8414-530f0ed6bbe4 None admin] PATH_INFO: `/v3/domains` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:48.781250 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4eb024-75b0-430d-8414-530f0ed6bbe4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:48.781250 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4eb024-75b0-430d-8414-530f0ed6bbe4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:48.781701 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4eb024-75b0-430d-8414-530f0ed6bbe4 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:48.807338 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:48.817125 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 368/731] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Oct 4 11:40:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:48.820004 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4eb024-75b0-430d-8414-530f0ed6bbe4 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:49.021238 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cddb50-3631-463a-8328-0678de562976 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:49.040674 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4eb024-75b0-430d-8414-530f0ed6bbe4 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:49.062971 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9439255e-69d2-4fb9-b713-90d4cd977d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:49.063585 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9439255e-69d2-4fb9-b713-90d4cd977d92 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:49.063866 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9439255e-69d2-4fb9-b713-90d4cd977d92 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:49.064139 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9439255e-69d2-4fb9-b713-90d4cd977d92 None admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:49.064938 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9439255e-69d2-4fb9-b713-90d4cd977d92 None admin] RBAC: Adding query filter params (name=admin) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:49.065238 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9439255e-69d2-4fb9-b713-90d4cd977d92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:49.066892 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9439255e-69d2-4fb9-b713-90d4cd977d92 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:49.076895 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 364/732] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Oct 4 11:40:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:49.082084 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad0a66d-185c-4dba-a26f-2f9384ef68ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:49.082318 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9439255e-69d2-4fb9-b713-90d4cd977d92 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:49.083084 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad0a66d-185c-4dba-a26f-2f9384ef68ad None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:49.083629 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad0a66d-185c-4dba-a26f-2f9384ef68ad None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:49.084051 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad0a66d-185c-4dba-a26f-2f9384ef68ad None admin] PATH_INFO: `/v3/users/swift` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:49.092125 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad0a66d-185c-4dba-a26f-2f9384ef68ad None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:49.093897 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad0a66d-185c-4dba-a26f-2f9384ef68ad None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:49.108301 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-cad0a66d-185c-4dba-a26f-2f9384ef68ad None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 04 11:40:49.108301 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:49.108301 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:49.108301 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:49.108301 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:49.108301 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:49.108301 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:49.108301 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:49.108301 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:49.108301 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:49.108301 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:49.108301 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:49.108301 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 11:40:49.108301 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 11:40:49.108301 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 11:40:49.108301 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 11:40:49.109376 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:49.109376 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:49.109376 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 11:40:49.109376 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 11:40:49.109376 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 11:40:49.109376 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 11:40:49.109376 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:40:49.109376 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:40:49.109376 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:40:49.109376 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:40:49.109376 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:40:49.109376 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:40:49.109376 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:40:49.109376 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:40:49.109376 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:40:49.109376 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:40:49.109376 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:40:49.109376 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:40:49.110381 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:40:49.110381 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:40:49.110381 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 11:40:49.110381 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 11:40:49.110381 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 11:40:49.110381 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 11:40:49.110381 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 11:40:49.110381 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 11:40:49.110381 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 04 11:40:49.110381 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:40:49.112856 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 369/733] 10.222.0.59 () {56 vars in 1096 bytes} [Tue Oct 4 11:40:48 2022] GET /identity/v3/users/swift => generated 83 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:40:49.116688 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e10d55-4d2b-4254-bde5-eb3a16a413c2 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:49.116688 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e10d55-4d2b-4254-bde5-eb3a16a413c2 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:49.116688 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e10d55-4d2b-4254-bde5-eb3a16a413c2 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:49.117448 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 370/734] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:40:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:40:49.121410 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e10d55-4d2b-4254-bde5-eb3a16a413c2 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:49.158774 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:49.167750 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:49.201322 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9439255e-69d2-4fb9-b713-90d4cd977d92 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:49.238367 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e10d55-4d2b-4254-bde5-eb3a16a413c2 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:49.241751 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086a4bf7-e4fa-459a-8b67-4f486c350749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:49.242622 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086a4bf7-e4fa-459a-8b67-4f486c350749 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:49.243075 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086a4bf7-e4fa-459a-8b67-4f486c350749 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:49.243520 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086a4bf7-e4fa-459a-8b67-4f486c350749 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:49.255861 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086a4bf7-e4fa-459a-8b67-4f486c350749 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:49.257735 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086a4bf7-e4fa-459a-8b67-4f486c350749 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:49.274369 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-086a4bf7-e4fa-459a-8b67-4f486c350749 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:40:49.274369 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:49.274369 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:49.274369 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:49.274369 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:49.274369 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:49.274369 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:49.274369 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:49.274369 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:49.274369 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:49.274369 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:49.274369 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:49.274369 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 11:40:49.274369 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 11:40:49.274369 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 11:40:49.274369 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 11:40:49.275374 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:49.275374 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:49.275374 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:40:49.275374 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:40:49.275374 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:40:49.275374 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:40:49.275374 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:40:49.275374 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:40:49.275374 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:40:49.275374 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:40:49.275374 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:40:49.275374 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:40:49.275374 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:40:49.275374 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:40:49.275374 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:40:49.275374 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:40:49.275374 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 11:40:49.276276 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 11:40:49.276276 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:40:49.276276 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:40:49.278272 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 365/735] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Oct 4 11:40:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:40:49.279725 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671ffb6d-e10a-4d4c-85e6-1dad6b385e10 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:49.280239 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db8d0d0-3b03-40dd-8076-fbc03ad26c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:49.280411 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671ffb6d-e10a-4d4c-85e6-1dad6b385e10 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:49.280842 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671ffb6d-e10a-4d4c-85e6-1dad6b385e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:49.281157 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db8d0d0-3b03-40dd-8076-fbc03ad26c61 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:49.281535 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db8d0d0-3b03-40dd-8076-fbc03ad26c61 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:49.281903 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db8d0d0-3b03-40dd-8076-fbc03ad26c61 None admin] PATH_INFO: `/v3/users` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:49.282810 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db8d0d0-3b03-40dd-8076-fbc03ad26c61 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:49.283246 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db8d0d0-3b03-40dd-8076-fbc03ad26c61 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:49.284935 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db8d0d0-3b03-40dd-8076-fbc03ad26c61 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:49.301871 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-671ffb6d-e10a-4d4c-85e6-1dad6b385e10 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:40:49.303287 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-671ffb6d-e10a-4d4c-85e6-1dad6b385e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:40:49.308813 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 371/736] 10.222.0.59 () {56 vars in 1135 bytes} [Tue Oct 4 11:40:49 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:49.309815 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db8d0d0-3b03-40dd-8076-fbc03ad26c61 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:49.388779 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 366/737] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:40:49 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 11:40:49.390872 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671ffb6d-e10a-4d4c-85e6-1dad6b385e10 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:49.426332 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:49.450363 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db8d0d0-3b03-40dd-8076-fbc03ad26c61 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:49.492189 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:49.518886 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9315498-ed71-4631-bbd5-c064b4b730e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:49.519502 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9315498-ed71-4631-bbd5-c064b4b730e6 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:49.519782 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9315498-ed71-4631-bbd5-c064b4b730e6 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:49.520054 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9315498-ed71-4631-bbd5-c064b4b730e6 None admin] PATH_INFO: `/v3/domains` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:49.520728 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9315498-ed71-4631-bbd5-c064b4b730e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:49.521033 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9315498-ed71-4631-bbd5-c064b4b730e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:49.523674 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9315498-ed71-4631-bbd5-c064b4b730e6 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:49.546453 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 372/738] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Oct 4 11:40:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:49.551288 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9315498-ed71-4631-bbd5-c064b4b730e6 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:49.588761 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671ffb6d-e10a-4d4c-85e6-1dad6b385e10 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:49.636783 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f822280-b04b-4296-89ae-92bd9018f5b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:49.637397 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f822280-b04b-4296-89ae-92bd9018f5b9 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:49.637682 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f822280-b04b-4296-89ae-92bd9018f5b9 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:49.637958 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f822280-b04b-4296-89ae-92bd9018f5b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:49.740935 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9315498-ed71-4631-bbd5-c064b4b730e6 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:49.757789 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f822280-b04b-4296-89ae-92bd9018f5b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:49.759617 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f822280-b04b-4296-89ae-92bd9018f5b9 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:49.790038 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d83f93-8bed-437c-92b4-2ba61e37b7d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:49.790674 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d83f93-8bed-437c-92b4-2ba61e37b7d4 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:49.790954 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d83f93-8bed-437c-92b4-2ba61e37b7d4 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:49.791225 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d83f93-8bed-437c-92b4-2ba61e37b7d4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:49.803298 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d83f93-8bed-437c-92b4-2ba61e37b7d4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:49.805280 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d83f93-8bed-437c-92b4-2ba61e37b7d4 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:49.820802 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-82d83f93-8bed-437c-92b4-2ba61e37b7d4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 04 11:40:49.820802 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:49.820802 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:49.820802 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:49.820802 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:49.820802 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:49.820802 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:49.820802 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:49.820802 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:49.820802 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:49.820802 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:49.820802 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:49.820802 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 11:40:49.820802 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 11:40:49.820802 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 11:40:49.820802 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 11:40:49.821806 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:49.821806 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:49.821806 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 11:40:49.821806 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 11:40:49.821806 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 11:40:49.821806 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 11:40:49.821806 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:40:49.821806 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:40:49.821806 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:40:49.821806 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:40:49.821806 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:40:49.821806 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:40:49.821806 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:40:49.821806 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:40:49.821806 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:40:49.821806 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:40:49.821806 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:40:49.821806 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:40:49.822755 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:40:49.822755 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:40:49.822755 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 11:40:49.822755 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 11:40:49.822755 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 11:40:49.822755 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 11:40:49.822755 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 11:40:49.822755 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 11:40:49.822755 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 04 11:40:49.822755 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:40:49.825912 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 373/739] 10.222.0.59 () {56 vars in 1093 bytes} [Tue Oct 4 11:40:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:40:49.827030 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d83f93-8bed-437c-92b4-2ba61e37b7d4 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:49.828477 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:49.842883 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:49.896472 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 367/740] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Oct 4 11:40:49 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 11:40:49.897780 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f822280-b04b-4296-89ae-92bd9018f5b9 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:49.968388 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d83f93-8bed-437c-92b4-2ba61e37b7d4 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:50.004138 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f77d1e-5b78-4a0d-a94c-99a6cad6ff21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:50.004771 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f77d1e-5b78-4a0d-a94c-99a6cad6ff21 None admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:50.005046 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f77d1e-5b78-4a0d-a94c-99a6cad6ff21 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:50.005312 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f77d1e-5b78-4a0d-a94c-99a6cad6ff21 None admin] PATH_INFO: `/v3/services` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:50.005943 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f77d1e-5b78-4a0d-a94c-99a6cad6ff21 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:50.007299 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f77d1e-5b78-4a0d-a94c-99a6cad6ff21 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:50.061206 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f822280-b04b-4296-89ae-92bd9018f5b9 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:50.097276 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 374/741] 10.222.0.59 () {60 vars in 1141 bytes} [Tue Oct 4 11:40:49 2022] POST /identity/v3/services => generated 240 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 11:40:50.098453 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f77d1e-5b78-4a0d-a94c-99a6cad6ff21 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:50.115166 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba617d9-826a-435e-a0cc-ab763420a4cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:50.115873 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba617d9-826a-435e-a0cc-ab763420a4cc None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:50.116159 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba617d9-826a-435e-a0cc-ab763420a4cc None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:50.116434 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba617d9-826a-435e-a0cc-ab763420a4cc None admin] PATH_INFO: `/v3/users` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:50.117338 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba617d9-826a-435e-a0cc-ab763420a4cc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:50.117649 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba617d9-826a-435e-a0cc-ab763420a4cc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:50.119353 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba617d9-826a-435e-a0cc-ab763420a4cc None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:50.150056 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 368/742] 10.222.0.59 () {56 vars in 1133 bytes} [Tue Oct 4 11:40:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:50.150056 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec57909f-988a-4af6-a9a3-136e19519d9d None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:50.150056 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec57909f-988a-4af6-a9a3-136e19519d9d None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:50.150056 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec57909f-988a-4af6-a9a3-136e19519d9d None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:50.150056 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 369/743] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:40:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:40:50.154085 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec57909f-988a-4af6-a9a3-136e19519d9d None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:50.167413 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:50.203786 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:50.254955 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f77d1e-5b78-4a0d-a94c-99a6cad6ff21 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:50.295745 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec57909f-988a-4af6-a9a3-136e19519d9d None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:50.303804 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d98e623-dd44-4007-9698-db5f24b7a54f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:50.303804 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d98e623-dd44-4007-9698-db5f24b7a54f None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:50.304063 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d98e623-dd44-4007-9698-db5f24b7a54f None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:50.304259 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d98e623-dd44-4007-9698-db5f24b7a54f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:50.319656 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d98e623-dd44-4007-9698-db5f24b7a54f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:50.320806 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d98e623-dd44-4007-9698-db5f24b7a54f None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:50.336611 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d103598-2c1d-420e-9d05-bf0739158b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:50.336821 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-2d98e623-dd44-4007-9698-db5f24b7a54f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:40:50.336821 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:50.336821 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:50.336821 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:50.336821 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:50.336821 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:50.336821 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:50.336821 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:50.336821 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:50.336821 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:50.336821 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:50.336821 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:50.336821 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 11:40:50.336821 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 11:40:50.336821 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 11:40:50.336821 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 11:40:50.337731 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:50.337731 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:50.337731 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:40:50.337731 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:40:50.337731 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:40:50.337731 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:40:50.337731 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:40:50.337731 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:40:50.337731 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:40:50.337731 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:40:50.337731 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:40:50.337731 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:40:50.337731 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:40:50.337731 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:40:50.337731 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:40:50.337731 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:40:50.337731 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 11:40:50.338646 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 11:40:50.338646 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:40:50.338646 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:40:50.338826 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d103598-2c1d-420e-9d05-bf0739158b4b None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:50.338826 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d103598-2c1d-420e-9d05-bf0739158b4b None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:50.338826 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d103598-2c1d-420e-9d05-bf0739158b4b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:50.339029 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 375/744] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Oct 4 11:40:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:40:50.339425 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fcb481-3926-49d5-9b6d-cd15a05eb6e5 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:50.339725 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fcb481-3926-49d5-9b6d-cd15a05eb6e5 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:50.339978 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fcb481-3926-49d5-9b6d-cd15a05eb6e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:50.358031 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d103598-2c1d-420e-9d05-bf0739158b4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:50.359318 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-94fcb481-3926-49d5-9b6d-cd15a05eb6e5 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:40:50.359967 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d103598-2c1d-420e-9d05-bf0739158b4b None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:50.360519 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-94fcb481-3926-49d5-9b6d-cd15a05eb6e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:40:50.376842 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-2d103598-2c1d-420e-9d05-bf0739158b4b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:40:50.376842 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:50.376842 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:50.376842 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:50.376842 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:50.376842 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:50.376842 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:50.376842 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:50.376842 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:50.376842 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:50.376842 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:50.376842 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:50.376842 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 11:40:50.376842 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 11:40:50.376842 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 11:40:50.376842 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 11:40:50.377953 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:50.377953 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:50.377953 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:40:50.377953 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:40:50.377953 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:40:50.377953 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:40:50.377953 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:40:50.377953 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:40:50.377953 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:40:50.377953 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:40:50.377953 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:40:50.377953 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:40:50.377953 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:40:50.377953 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:40:50.377953 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:40:50.377953 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:40:50.377953 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 11:40:50.379057 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 11:40:50.379057 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:40:50.379057 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:40:50.380499 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 370/745] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Oct 4 11:40:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:40:50.381424 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d103598-2c1d-420e-9d05-bf0739158b4b None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:50.447352 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 376/746] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:40:50 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 11:40:50.448358 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fcb481-3926-49d5-9b6d-cd15a05eb6e5 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:50.464048 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:50.505421 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:50.534421 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d103598-2c1d-420e-9d05-bf0739158b4b None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:50.600551 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61781cd-46b3-457d-b096-a68b6693a5c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:50.601441 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61781cd-46b3-457d-b096-a68b6693a5c2 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:50.604166 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fcb481-3926-49d5-9b6d-cd15a05eb6e5 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:50.604947 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61781cd-46b3-457d-b096-a68b6693a5c2 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:50.605367 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61781cd-46b3-457d-b096-a68b6693a5c2 None admin] PATH_INFO: `/v3/domains` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:50.606245 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61781cd-46b3-457d-b096-a68b6693a5c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:50.606688 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61781cd-46b3-457d-b096-a68b6693a5c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:50.609368 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61781cd-46b3-457d-b096-a68b6693a5c2 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:50.636154 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 371/747] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Oct 4 11:40:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:50.641309 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61781cd-46b3-457d-b096-a68b6693a5c2 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:50.676425 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab0fbb0-6c85-42c0-8611-2fa74dcbe29f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:50.677313 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab0fbb0-6c85-42c0-8611-2fa74dcbe29f None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:50.677588 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab0fbb0-6c85-42c0-8611-2fa74dcbe29f None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:50.677853 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab0fbb0-6c85-42c0-8611-2fa74dcbe29f None admin] PATH_INFO: `/v3/domains` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:50.678492 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab0fbb0-6c85-42c0-8611-2fa74dcbe29f None admin] RBAC: Adding query filter params (name=Default) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:50.678791 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab0fbb0-6c85-42c0-8611-2fa74dcbe29f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:50.680150 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab0fbb0-6c85-42c0-8611-2fa74dcbe29f None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:50.700832 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 377/748] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Oct 4 11:40:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:50.705857 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab0fbb0-6c85-42c0-8611-2fa74dcbe29f None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:50.754019 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61781cd-46b3-457d-b096-a68b6693a5c2 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:50.772840 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:50.789891 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c7f000-28e1-4c74-990e-bf680e64c5e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:50.790529 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c7f000-28e1-4c74-990e-bf680e64c5e7 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:50.790807 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c7f000-28e1-4c74-990e-bf680e64c5e7 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:50.791078 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c7f000-28e1-4c74-990e-bf680e64c5e7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:50.798113 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c7f000-28e1-4c74-990e-bf680e64c5e7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:50.800349 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c7f000-28e1-4c74-990e-bf680e64c5e7 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:50.824386 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-20c7f000-28e1-4c74-990e-bf680e64c5e7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 11:40:50.824386 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:50.824386 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:50.824386 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:50.824386 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:50.824386 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:50.824386 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:50.824386 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:50.824386 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:50.824386 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:50.824386 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:50.824386 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:50.824386 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 11:40:50.824386 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 11:40:50.824386 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 11:40:50.825333 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 11:40:50.825333 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:50.825333 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:50.825333 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:40:50.825333 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:40:50.825333 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:40:50.825333 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:40:50.825333 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:40:50.825333 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:40:50.825333 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:40:50.825333 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:40:50.825333 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:40:50.825333 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:40:50.825333 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:40:50.825333 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:40:50.825333 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:40:50.825333 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:40:50.826251 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 11:40:50.826251 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 11:40:50.826251 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 11:40:50.826251 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 11:40:50.826251 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 11:40:50.826251 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 11:40:50.826251 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 11:40:50.826251 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:40:50.831800 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 372/749] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Oct 4 11:40:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:40:50.841545 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c7f000-28e1-4c74-990e-bf680e64c5e7 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:50.871318 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab0fbb0-6c85-42c0-8611-2fa74dcbe29f None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:50.897005 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:50.912089 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e397404b-e299-4c5c-aa98-52d8a978552f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:50.913200 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e397404b-e299-4c5c-aa98-52d8a978552f None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:50.913573 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e397404b-e299-4c5c-aa98-52d8a978552f None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:50.913942 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e397404b-e299-4c5c-aa98-52d8a978552f None admin] PATH_INFO: `/v3/projects/service` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:50.923368 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e397404b-e299-4c5c-aa98-52d8a978552f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:50.926263 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e397404b-e299-4c5c-aa98-52d8a978552f None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:50.943497 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-e397404b-e299-4c5c-aa98-52d8a978552f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 11:40:50.943497 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:50.943497 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:50.943497 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:50.943497 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:50.943497 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:50.943497 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:50.943497 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:50.943497 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:50.943497 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:50.943497 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:50.943497 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:50.943497 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 11:40:50.943497 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 11:40:50.943497 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 11:40:50.944472 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 11:40:50.944472 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:50.944472 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:50.944472 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:40:50.944472 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:40:50.944472 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:40:50.944472 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:40:50.944472 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:40:50.944472 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:40:50.944472 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:40:50.944472 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:40:50.944472 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:40:50.944472 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:40:50.944472 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:40:50.944472 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:40:50.944472 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:40:50.944472 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:40:50.945428 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 11:40:50.945428 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 11:40:50.945428 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 11:40:50.945428 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 11:40:50.945428 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 11:40:50.945428 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 11:40:50.945428 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 11:40:50.945428 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:40:50.945428 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 378/750] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Oct 4 11:40:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 11:40:50.949106 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e397404b-e299-4c5c-aa98-52d8a978552f None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:51.009708 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c7f000-28e1-4c74-990e-bf680e64c5e7 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:51.051078 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dcda05-3b06-424c-9117-dc5e18ecb193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:51.052088 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dcda05-3b06-424c-9117-dc5e18ecb193 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:51.052572 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dcda05-3b06-424c-9117-dc5e18ecb193 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:51.053243 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dcda05-3b06-424c-9117-dc5e18ecb193 None admin] PATH_INFO: `/v3/projects` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:51.054522 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dcda05-3b06-424c-9117-dc5e18ecb193 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:51.055340 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dcda05-3b06-424c-9117-dc5e18ecb193 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:51.057074 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dcda05-3b06-424c-9117-dc5e18ecb193 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:51.073392 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 373/751] 10.222.0.59 () {56 vars in 1148 bytes} [Tue Oct 4 11:40:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:51.074576 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e397404b-e299-4c5c-aa98-52d8a978552f None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:51.075127 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dcda05-3b06-424c-9117-dc5e18ecb193 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:51.130382 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236a6763-49e2-40d1-83f5-ffedc145fe03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:51.130969 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236a6763-49e2-40d1-83f5-ffedc145fe03 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:51.131243 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236a6763-49e2-40d1-83f5-ffedc145fe03 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:51.131512 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236a6763-49e2-40d1-83f5-ffedc145fe03 None admin] PATH_INFO: `/v3/roles/service` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:51.136049 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:51.146316 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236a6763-49e2-40d1-83f5-ffedc145fe03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 11:40:51.152737 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-236a6763-49e2-40d1-83f5-ffedc145fe03 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 11:40:51.152737 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:51.152737 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:51.152737 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:51.152737 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:51.152737 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:51.152737 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:51.152737 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:51.152737 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:51.152737 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:51.152737 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:51.152737 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:51.152737 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 11:40:51.152737 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 11:40:51.152737 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 11:40:51.152737 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 11:40:51.153692 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 11:40:51.153692 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 11:40:51.153692 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 11:40:51.153692 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 11:40:51.153692 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:51.153692 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:51.153692 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:40:51.153692 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:40:51.153692 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:40:51.153692 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:40:51.153692 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:40:51.153692 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:40:51.153692 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:40:51.153692 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:40:51.153692 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:40:51.153692 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:40:51.154588 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:40:51.154588 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:40:51.154588 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:40:51.154588 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:40:51.154588 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 11:40:51.154588 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 11:40:51.154588 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 11:40:51.154588 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 11:40:51.154588 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 11:40:51.154588 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 11:40:51.154588 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 11:40:51.154588 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:40:51.154588 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 379/752] 10.222.0.59 () {56 vars in 1102 bytes} [Tue Oct 4 11:40:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:40:51.155317 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236a6763-49e2-40d1-83f5-ffedc145fe03 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:51.198461 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:51.217914 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dcda05-3b06-424c-9117-dc5e18ecb193 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:51.264891 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89601e0e-4326-4cc0-b10e-9ddc90d2b7c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:51.265577 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89601e0e-4326-4cc0-b10e-9ddc90d2b7c0 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:51.265882 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89601e0e-4326-4cc0-b10e-9ddc90d2b7c0 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:51.266475 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89601e0e-4326-4cc0-b10e-9ddc90d2b7c0 None admin] PATH_INFO: `/v3/projects` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:51.266896 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89601e0e-4326-4cc0-b10e-9ddc90d2b7c0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:51.267285 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89601e0e-4326-4cc0-b10e-9ddc90d2b7c0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:51.269205 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89601e0e-4326-4cc0-b10e-9ddc90d2b7c0 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:51.284762 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 374/753] 10.222.0.59 () {56 vars in 1148 bytes} [Tue Oct 4 11:40:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:51.285944 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89601e0e-4326-4cc0-b10e-9ddc90d2b7c0 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:51.304731 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236a6763-49e2-40d1-83f5-ffedc145fe03 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:51.342888 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc06eb7-4fc4-4426-9ba6-b4ca8c32e9a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:51.343552 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc06eb7-4fc4-4426-9ba6-b4ca8c32e9a9 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:51.343834 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc06eb7-4fc4-4426-9ba6-b4ca8c32e9a9 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:51.344110 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc06eb7-4fc4-4426-9ba6-b4ca8c32e9a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:51.344926 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc06eb7-4fc4-4426-9ba6-b4ca8c32e9a9 None admin] RBAC: Adding query filter params (role.id=d6e7421d1ff9451c808004b818354550, scope.project.id=39913dbe3e984f27a61493dd75381501, user.id=1605c3e03b7a4bcba4e19f0d92c671bc) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:51.345233 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc06eb7-4fc4-4426-9ba6-b4ca8c32e9a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:51.346697 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc06eb7-4fc4-4426-9ba6-b4ca8c32e9a9 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:51.352847 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 380/754] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Oct 4 11:40:51 2022] GET /identity/v3/role_assignments?user.id=1605c3e03b7a4bcba4e19f0d92c671bc&scope.project.id=39913dbe3e984f27a61493dd75381501&role.id=d6e7421d1ff9451c808004b818354550 => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:51.353458 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc06eb7-4fc4-4426-9ba6-b4ca8c32e9a9 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:51.423520 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:51.429839 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89601e0e-4326-4cc0-b10e-9ddc90d2b7c0 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:51.476338 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:51.481310 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12421e4b-3861-406c-bbd2-e70dd9d3bf7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:51.481937 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12421e4b-3861-406c-bbd2-e70dd9d3bf7f None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:51.482219 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12421e4b-3861-406c-bbd2-e70dd9d3bf7f None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:51.482495 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12421e4b-3861-406c-bbd2-e70dd9d3bf7f None admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:51.483174 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12421e4b-3861-406c-bbd2-e70dd9d3bf7f None admin] RBAC: Adding query filter params (name=service) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:51.484333 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12421e4b-3861-406c-bbd2-e70dd9d3bf7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:51.485807 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12421e4b-3861-406c-bbd2-e70dd9d3bf7f None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:51.491063 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc06eb7-4fc4-4426-9ba6-b4ca8c32e9a9 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:51.499626 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 375/755] 10.222.0.59 () {56 vars in 1103 bytes} [Tue Oct 4 11:40:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:51.499626 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6311a2-a34a-4bea-a6a5-df7292b0d6db None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:51.499626 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6311a2-a34a-4bea-a6a5-df7292b0d6db None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:51.499626 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6311a2-a34a-4bea-a6a5-df7292b0d6db None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:51.499626 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 376/756] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:40:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:40:51.510881 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6311a2-a34a-4bea-a6a5-df7292b0d6db None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:51.549677 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ff6f68-b46b-480c-886f-4cf1c58c0823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:51.550334 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ff6f68-b46b-480c-886f-4cf1c58c0823 None admin] REQUEST_METHOD: `PUT` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:51.550615 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ff6f68-b46b-480c-886f-4cf1c58c0823 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:51.550890 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ff6f68-b46b-480c-886f-4cf1c58c0823 None admin] PATH_INFO: `/v3/projects/39913dbe3e984f27a61493dd75381501/users/a8e23d1d2fe24bdf9552e7c2f0ae3424/roles/d6e7421d1ff9451c808004b818354550` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:51.552906 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ff6f68-b46b-480c-886f-4cf1c58c0823 None admin] RBAC: Authorizing `identity:create_grant(project_id=39913dbe3e984f27a61493dd75381501, user_id=a8e23d1d2fe24bdf9552e7c2f0ae3424, role_id=d6e7421d1ff9451c808004b818354550)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:51.555098 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ff6f68-b46b-480c-886f-4cf1c58c0823 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:51.632010 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6311a2-a34a-4bea-a6a5-df7292b0d6db None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:51.645417 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 381/757] 10.222.0.59 () {58 vars in 1439 bytes} [Tue Oct 4 11:40:51 2022] PUT /identity/v3/projects/39913dbe3e984f27a61493dd75381501/users/a8e23d1d2fe24bdf9552e7c2f0ae3424/roles/d6e7421d1ff9451c808004b818354550 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 11:40:51.648232 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3cf705-6cac-41a7-8491-59088915edea None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:51.648775 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3cf705-6cac-41a7-8491-59088915edea None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:51.649685 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3cf705-6cac-41a7-8491-59088915edea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:51.693044 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-9c3cf705-6cac-41a7-8491-59088915edea None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:40:51.694162 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-9c3cf705-6cac-41a7-8491-59088915edea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:40:51.699511 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40cb32b-24ef-458e-bbe8-3975c46d2d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:51.700223 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40cb32b-24ef-458e-bbe8-3975c46d2d84 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:51.700550 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40cb32b-24ef-458e-bbe8-3975c46d2d84 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:51.700843 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40cb32b-24ef-458e-bbe8-3975c46d2d84 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:51.730280 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40cb32b-24ef-458e-bbe8-3975c46d2d84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:51.731934 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40cb32b-24ef-458e-bbe8-3975c46d2d84 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:51.770650 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-f40cb32b-24ef-458e-bbe8-3975c46d2d84 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:40:51.770650 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:51.770650 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:51.770650 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:51.770650 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:51.770650 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:51.770650 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:51.770650 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:51.770650 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:51.770650 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:51.770650 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:51.770650 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:51.770650 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 11:40:51.770650 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 11:40:51.770650 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 11:40:51.770650 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 11:40:51.771678 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:51.771678 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:51.771678 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:40:51.771678 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:40:51.771678 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:40:51.771678 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:40:51.771678 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:40:51.771678 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:40:51.771678 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:40:51.771678 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:40:51.771678 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:40:51.771678 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:40:51.771678 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:40:51.771678 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:40:51.771678 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:40:51.771678 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:40:51.771678 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 11:40:51.772610 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 11:40:51.772610 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:40:51.772610 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:40:51.772610 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 377/758] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Oct 4 11:40:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:40:51.794221 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40cb32b-24ef-458e-bbe8-3975c46d2d84 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:51.821047 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:51.854731 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 382/759] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:40:51 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 11:40:51.931634 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40cb32b-24ef-458e-bbe8-3975c46d2d84 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:51.978349 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f76c1ac-9b35-47b3-ab0f-76b660cf0912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:51.979422 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f76c1ac-9b35-47b3-ab0f-76b660cf0912 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:51.979957 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f76c1ac-9b35-47b3-ab0f-76b660cf0912 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:51.980469 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f76c1ac-9b35-47b3-ab0f-76b660cf0912 None admin] PATH_INFO: `/v3/domains` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:51.981396 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f76c1ac-9b35-47b3-ab0f-76b660cf0912 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:51.981948 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f76c1ac-9b35-47b3-ab0f-76b660cf0912 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:51.983532 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f76c1ac-9b35-47b3-ab0f-76b660cf0912 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:52.002448 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 378/760] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Oct 4 11:40:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 11:40:52.007265 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3cf705-6cac-41a7-8491-59088915edea None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:52.126154 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:52.149955 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3cf705-6cac-41a7-8491-59088915edea None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:52.192735 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945892ff-54b1-4dba-8dc6-e65870b2428e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:52.193746 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945892ff-54b1-4dba-8dc6-e65870b2428e None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:52.194231 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945892ff-54b1-4dba-8dc6-e65870b2428e None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:52.194705 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945892ff-54b1-4dba-8dc6-e65870b2428e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:52.206209 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945892ff-54b1-4dba-8dc6-e65870b2428e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:52.207957 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945892ff-54b1-4dba-8dc6-e65870b2428e None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:52.225325 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-945892ff-54b1-4dba-8dc6-e65870b2428e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 04 11:40:52.225325 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:52.225325 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:52.225325 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:52.225325 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:52.225325 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:52.225325 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:52.225325 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:52.225325 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:52.225325 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:52.225325 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:52.225325 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:52.225325 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 11:40:52.225325 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 11:40:52.225325 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 11:40:52.225325 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 11:40:52.226383 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:52.226383 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:52.226383 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 11:40:52.226383 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 11:40:52.226383 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 11:40:52.226383 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 11:40:52.226383 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:40:52.226383 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:40:52.226383 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:40:52.226383 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:40:52.226383 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:40:52.226383 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:40:52.226383 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:40:52.226383 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:40:52.226383 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:40:52.226383 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:40:52.226383 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:40:52.226383 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:40:52.227406 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:40:52.227406 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:40:52.227406 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 11:40:52.227406 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 11:40:52.227406 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 11:40:52.227406 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 11:40:52.227406 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 11:40:52.227406 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 11:40:52.227406 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 04 11:40:52.227406 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:40:52.230089 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 383/761] 10.222.0.59 () {56 vars in 1117 bytes} [Tue Oct 4 11:40:52 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:40:52.236125 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f76c1ac-9b35-47b3-ab0f-76b660cf0912 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:52.268674 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945892ff-54b1-4dba-8dc6-e65870b2428e None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:52.332230 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:52.365031 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f76c1ac-9b35-47b3-ab0f-76b660cf0912 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:52.437748 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401baf68-4cc6-40b7-967d-903d354da6a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:52.438365 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401baf68-4cc6-40b7-967d-903d354da6a3 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:52.438639 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401baf68-4cc6-40b7-967d-903d354da6a3 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:52.439114 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401baf68-4cc6-40b7-967d-903d354da6a3 None admin] PATH_INFO: `/v3/users` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:52.440430 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401baf68-4cc6-40b7-967d-903d354da6a3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:52.440763 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401baf68-4cc6-40b7-967d-903d354da6a3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:52.442901 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401baf68-4cc6-40b7-967d-903d354da6a3 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:52.473319 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 379/762] 10.222.0.59 () {56 vars in 1149 bytes} [Tue Oct 4 11:40:52 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:52.478545 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401baf68-4cc6-40b7-967d-903d354da6a3 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:52.480455 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945892ff-54b1-4dba-8dc6-e65870b2428e None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:52.547790 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a465cf0a-4752-48cc-bd55-7adbdc3ecd59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:52.548608 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a465cf0a-4752-48cc-bd55-7adbdc3ecd59 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:52.549084 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a465cf0a-4752-48cc-bd55-7adbdc3ecd59 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:52.549537 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a465cf0a-4752-48cc-bd55-7adbdc3ecd59 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:52.550195 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a465cf0a-4752-48cc-bd55-7adbdc3ecd59 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:52.551577 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a465cf0a-4752-48cc-bd55-7adbdc3ecd59 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:52.561312 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-a465cf0a-4752-48cc-bd55-7adbdc3ecd59 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 04 11:40:52.561312 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:52.561312 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 11:40:52.561312 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 11:40:52.561312 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 11:40:52.561312 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 11:40:52.561312 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 11:40:52.561312 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 11:40:52.561312 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 04 11:40:52.561312 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:40:52.561312 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 11:40:52.561312 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:40:52.561312 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:52.561312 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:52.561312 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:52.561312 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:52.561312 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:52.562399 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:52.562399 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:52.562399 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:52.562399 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:52.562399 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:52.562399 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:52.562399 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 11:40:52.562399 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 11:40:52.562399 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 11:40:52.562399 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 11:40:52.562399 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:52.562399 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:52.562399 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:40:52.562399 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:40:52.562399 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:40:52.562399 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:40:52.563276 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:40:52.563276 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:40:52.563276 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:40:52.563276 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:40:52.563276 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:40:52.563276 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:40:52.563276 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:40:52.563276 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:40:52.563276 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:40:52.563276 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:40:52.563276 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 11:40:52.563276 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 11:40:52.563276 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 04 11:40:52.563276 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:40:52.567484 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 384/763] 10.222.0.59 () {56 vars in 1129 bytes} [Tue Oct 4 11:40:52 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:40:52.568639 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1628dd5d-0375-42df-9f16-6c927e34309d None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:52.568932 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1628dd5d-0375-42df-9f16-6c927e34309d None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:52.569213 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1628dd5d-0375-42df-9f16-6c927e34309d None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:52.574925 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 385/764] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:40:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:40:52.577082 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1628dd5d-0375-42df-9f16-6c927e34309d None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:52.600943 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:52.625355 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401baf68-4cc6-40b7-967d-903d354da6a3 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:52.663679 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:52.668872 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c99ba8-a73c-477c-993c-4bdce26768ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:52.681746 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c99ba8-a73c-477c-993c-4bdce26768ee None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:52.681746 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c99ba8-a73c-477c-993c-4bdce26768ee None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:52.681746 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c99ba8-a73c-477c-993c-4bdce26768ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:52.716768 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1628dd5d-0375-42df-9f16-6c927e34309d None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:52.753507 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c99ba8-a73c-477c-993c-4bdce26768ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:52.755648 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c99ba8-a73c-477c-993c-4bdce26768ee None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:52.759789 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffbd73b-09df-4008-95b4-6ffe491cb05d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:52.760628 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffbd73b-09df-4008-95b4-6ffe491cb05d None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:52.761068 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffbd73b-09df-4008-95b4-6ffe491cb05d None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:52.761511 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffbd73b-09df-4008-95b4-6ffe491cb05d None admin] PATH_INFO: `/v3/services` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:52.762378 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffbd73b-09df-4008-95b4-6ffe491cb05d None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:52.762878 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffbd73b-09df-4008-95b4-6ffe491cb05d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:52.764516 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffbd73b-09df-4008-95b4-6ffe491cb05d None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:52.771388 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 386/765] 10.222.0.59 () {56 vars in 1124 bytes} [Tue Oct 4 11:40:52 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 11:40:52.772778 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3080fea-7639-4c5c-9352-73812f180beb None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:52.773272 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3080fea-7639-4c5c-9352-73812f180beb None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:52.773701 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3080fea-7639-4c5c-9352-73812f180beb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:52.793348 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-d3080fea-7639-4c5c-9352-73812f180beb None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:40:52.794902 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-d3080fea-7639-4c5c-9352-73812f180beb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:40:52.870637 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:52.874753 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 380/766] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Oct 4 11:40:52 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 11:40:52.881739 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c99ba8-a73c-477c-993c-4bdce26768ee None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:52.881885 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 387/767] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:40:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 11:40:52.883032 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3080fea-7639-4c5c-9352-73812f180beb None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:52.910686 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:52.980374 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c99ba8-a73c-477c-993c-4bdce26768ee None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:53.017020 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b0d5f6-991a-4dee-bfc3-773cceb8c785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:53.018086 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b0d5f6-991a-4dee-bfc3-773cceb8c785 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:53.018648 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b0d5f6-991a-4dee-bfc3-773cceb8c785 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:53.018936 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b0d5f6-991a-4dee-bfc3-773cceb8c785 None admin] PATH_INFO: `/v3/services` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:53.019576 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b0d5f6-991a-4dee-bfc3-773cceb8c785 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:53.019887 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b0d5f6-991a-4dee-bfc3-773cceb8c785 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:53.021419 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b0d5f6-991a-4dee-bfc3-773cceb8c785 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:53.032116 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 381/768] 10.222.0.59 () {56 vars in 1124 bytes} [Tue Oct 4 11:40:52 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:53.033998 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b0d5f6-991a-4dee-bfc3-773cceb8c785 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:53.139707 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:53.143088 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3080fea-7639-4c5c-9352-73812f180beb None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:53.144314 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b0d5f6-991a-4dee-bfc3-773cceb8c785 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:53.181383 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd72f28-c86f-4e8b-9812-afaccbc20c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:53.182602 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd72f28-c86f-4e8b-9812-afaccbc20c70 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:53.183027 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd72f28-c86f-4e8b-9812-afaccbc20c70 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:53.183313 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd72f28-c86f-4e8b-9812-afaccbc20c70 None admin] PATH_INFO: `/v3/endpoints` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:53.184023 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd72f28-c86f-4e8b-9812-afaccbc20c70 None admin] RBAC: Adding query filter params (interface=public, service_id=443604c5a259451eb615d28e5bbd9b53, region_id=RegionOne) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:53.184333 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd72f28-c86f-4e8b-9812-afaccbc20c70 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:53.186061 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd72f28-c86f-4e8b-9812-afaccbc20c70 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:53.200404 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 382/769] 10.222.0.59 () {56 vars in 1251 bytes} [Tue Oct 4 11:40:53 2022] GET /identity/v3/endpoints?service_id=443604c5a259451eb615d28e5bbd9b53&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 11:40:53.202008 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd72f28-c86f-4e8b-9812-afaccbc20c70 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:53.238639 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1b2d70-b4b1-4081-9221-0e17ee1658f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:53.239264 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1b2d70-b4b1-4081-9221-0e17ee1658f3 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:53.239643 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1b2d70-b4b1-4081-9221-0e17ee1658f3 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:53.239918 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1b2d70-b4b1-4081-9221-0e17ee1658f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:53.250812 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1b2d70-b4b1-4081-9221-0e17ee1658f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:53.252430 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1b2d70-b4b1-4081-9221-0e17ee1658f3 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:53.269367 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-5e1b2d70-b4b1-4081-9221-0e17ee1658f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:40:53.269367 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:53.269367 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:53.269367 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:53.269367 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:53.269367 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:53.269367 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:53.269367 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:53.269367 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:53.269367 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:53.269367 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:53.269367 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:53.269367 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 11:40:53.269367 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 11:40:53.269367 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 11:40:53.269367 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 11:40:53.270402 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:53.270402 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:53.270402 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:40:53.270402 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:40:53.270402 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:40:53.270402 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:40:53.270402 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:40:53.270402 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:40:53.270402 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:40:53.270402 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:40:53.270402 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:40:53.270402 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:40:53.270402 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:40:53.270402 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:40:53.270402 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:40:53.270402 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:40:53.270402 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 11:40:53.271309 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 11:40:53.271309 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:40:53.271309 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:40:53.271309 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 388/770] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Oct 4 11:40:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 388 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:40:53.271309 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1b2d70-b4b1-4081-9221-0e17ee1658f3 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:53.323299 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd72f28-c86f-4e8b-9812-afaccbc20c70 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:53.334056 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:53.361171 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34bbd4f-2823-4db0-aab2-00aa1ce60787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:53.361795 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34bbd4f-2823-4db0-aab2-00aa1ce60787 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:53.362171 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34bbd4f-2823-4db0-aab2-00aa1ce60787 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:53.362444 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34bbd4f-2823-4db0-aab2-00aa1ce60787 None admin] PATH_INFO: `/v3/services` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:53.363053 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34bbd4f-2823-4db0-aab2-00aa1ce60787 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:53.364488 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34bbd4f-2823-4db0-aab2-00aa1ce60787 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:53.376641 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 383/771] 10.222.0.59 () {56 vars in 1087 bytes} [Tue Oct 4 11:40:53 2022] GET /identity/v3/services => generated 772 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 11:40:53.378095 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34bbd4f-2823-4db0-aab2-00aa1ce60787 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:53.393201 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1b2d70-b4b1-4081-9221-0e17ee1658f3 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:53.432772 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:53.449687 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7abf48-ee32-4d53-b61c-7535d79582a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:53.450335 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7abf48-ee32-4d53-b61c-7535d79582a0 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:53.450613 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7abf48-ee32-4d53-b61c-7535d79582a0 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:53.450881 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7abf48-ee32-4d53-b61c-7535d79582a0 None admin] PATH_INFO: `/v3/services/network` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:53.451545 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7abf48-ee32-4d53-b61c-7535d79582a0 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:53.453367 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7abf48-ee32-4d53-b61c-7535d79582a0 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:53.467673 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-8f7abf48-ee32-4d53-b61c-7535d79582a0 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 04 11:40:53.467673 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:53.467673 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 11:40:53.467673 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 11:40:53.467673 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 11:40:53.467673 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 11:40:53.467673 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 11:40:53.467673 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 11:40:53.467673 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 04 11:40:53.467673 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:40:53.467673 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 11:40:53.467673 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:40:53.467673 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:53.467673 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:53.467673 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:53.467673 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:53.467673 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:53.468794 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:53.468794 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:53.468794 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:53.468794 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:53.468794 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:53.468794 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:53.468794 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 11:40:53.468794 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 11:40:53.468794 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 11:40:53.468794 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 11:40:53.468794 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:53.468794 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:53.468794 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:40:53.468794 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:40:53.468794 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:40:53.468794 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:40:53.469678 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:40:53.469678 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:40:53.469678 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:40:53.469678 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:40:53.469678 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:40:53.469678 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:40:53.469678 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:40:53.469678 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:40:53.469678 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:40:53.469678 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:40:53.469678 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 11:40:53.469678 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 11:40:53.469678 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 04 11:40:53.469678 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:40:53.469678 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 389/772] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Oct 4 11:40:53 2022] GET /identity/v3/services/network => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:40:53.478864 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7abf48-ee32-4d53-b61c-7535d79582a0 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:53.602918 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34bbd4f-2823-4db0-aab2-00aa1ce60787 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:53.651288 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b24e69-347f-4c74-bc74-97642e4d21f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:53.652330 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b24e69-347f-4c74-bc74-97642e4d21f8 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:53.652917 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b24e69-347f-4c74-bc74-97642e4d21f8 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:53.653195 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b24e69-347f-4c74-bc74-97642e4d21f8 None admin] PATH_INFO: `/v3/domains` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:53.653938 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b24e69-347f-4c74-bc74-97642e4d21f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:53.654247 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b24e69-347f-4c74-bc74-97642e4d21f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:53.655742 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b24e69-347f-4c74-bc74-97642e4d21f8 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:53.661885 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7abf48-ee32-4d53-b61c-7535d79582a0 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:53.674775 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 384/773] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Oct 4 11:40:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:53.676296 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108b2767-ac0a-4047-b325-250b68fbaaef None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:53.676582 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108b2767-ac0a-4047-b325-250b68fbaaef None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:53.676898 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108b2767-ac0a-4047-b325-250b68fbaaef None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:53.678743 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 385/774] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:40:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:40:53.680181 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108b2767-ac0a-4047-b325-250b68fbaaef None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:53.681857 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:53.710967 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5d0e70-9639-4e5e-ab2a-d4c984c3c97f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:53.711579 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5d0e70-9639-4e5e-ab2a-d4c984c3c97f None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:53.711866 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5d0e70-9639-4e5e-ab2a-d4c984c3c97f None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:53.712140 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5d0e70-9639-4e5e-ab2a-d4c984c3c97f None admin] PATH_INFO: `/v3/services` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:53.713066 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5d0e70-9639-4e5e-ab2a-d4c984c3c97f None admin] RBAC: Adding query filter params (name=network) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:53.713608 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5d0e70-9639-4e5e-ab2a-d4c984c3c97f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:53.715236 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5d0e70-9639-4e5e-ab2a-d4c984c3c97f None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:53.720467 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 390/775] 10.222.0.59 () {56 vars in 1112 bytes} [Tue Oct 4 11:40:53 2022] GET /identity/v3/services?name=network => generated 124 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 11:40:53.721842 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1b33fc-8fd8-46d7-8db3-1c217fcdda8d None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:53.722123 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1b33fc-8fd8-46d7-8db3-1c217fcdda8d None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:53.722395 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1b33fc-8fd8-46d7-8db3-1c217fcdda8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:53.741049 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-6f1b33fc-8fd8-46d7-8db3-1c217fcdda8d None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:40:53.741866 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-6f1b33fc-8fd8-46d7-8db3-1c217fcdda8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:40:53.793497 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:53.813300 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108b2767-ac0a-4047-b325-250b68fbaaef None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:53.832836 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 391/776] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:40:53 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 11:40:53.832836 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1b33fc-8fd8-46d7-8db3-1c217fcdda8d None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:53.872135 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431a924b-274d-49f4-a6de-908f51a7b542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:53.875059 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431a924b-274d-49f4-a6de-908f51a7b542 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:53.875335 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431a924b-274d-49f4-a6de-908f51a7b542 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:53.875605 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431a924b-274d-49f4-a6de-908f51a7b542 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:53.890306 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431a924b-274d-49f4-a6de-908f51a7b542 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:53.895175 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431a924b-274d-49f4-a6de-908f51a7b542 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:53.918276 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-431a924b-274d-49f4-a6de-908f51a7b542 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 11:40:53.918276 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:53.918276 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:53.918276 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:53.918276 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:53.918276 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:53.918276 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:53.918276 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:53.918276 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:53.918276 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:53.918276 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:53.918276 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:53.918276 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 11:40:53.918276 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 11:40:53.918276 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 11:40:53.919475 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 11:40:53.919475 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:53.919475 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:53.919475 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:40:53.919475 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:40:53.919475 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:40:53.919475 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:40:53.919475 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:40:53.919475 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:40:53.919475 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:40:53.919475 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:40:53.919475 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:40:53.919475 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:40:53.919475 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:40:53.919475 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:40:53.919475 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:40:53.919475 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:40:53.920627 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 11:40:53.920627 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 11:40:53.920627 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 11:40:53.920627 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 11:40:53.920627 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 11:40:53.920627 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 11:40:53.920627 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 11:40:53.920627 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:40:53.921117 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 386/777] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Oct 4 11:40:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:40:53.930431 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431a924b-274d-49f4-a6de-908f51a7b542 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:54.051247 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1b33fc-8fd8-46d7-8db3-1c217fcdda8d None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:54.077044 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:54.154019 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f167d48-b6ee-4261-a39e-8ec6e23ad8f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:54.154644 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f167d48-b6ee-4261-a39e-8ec6e23ad8f0 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:54.154917 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f167d48-b6ee-4261-a39e-8ec6e23ad8f0 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:54.155185 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f167d48-b6ee-4261-a39e-8ec6e23ad8f0 None admin] PATH_INFO: `/v3/services` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:54.155818 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f167d48-b6ee-4261-a39e-8ec6e23ad8f0 None admin] RBAC: Adding query filter params (type=network) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:54.156114 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f167d48-b6ee-4261-a39e-8ec6e23ad8f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:54.157514 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f167d48-b6ee-4261-a39e-8ec6e23ad8f0 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:54.163434 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 392/778] 10.222.0.59 () {56 vars in 1112 bytes} [Tue Oct 4 11:40:53 2022] GET /identity/v3/services?type=network => generated 350 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:54.164251 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f167d48-b6ee-4261-a39e-8ec6e23ad8f0 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:54.190588 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431a924b-274d-49f4-a6de-908f51a7b542 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:54.231039 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0706f8-89d6-4913-a2d3-5190358d8d4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:54.231666 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0706f8-89d6-4913-a2d3-5190358d8d4c None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:54.231934 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0706f8-89d6-4913-a2d3-5190358d8d4c None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:54.232207 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0706f8-89d6-4913-a2d3-5190358d8d4c None admin] PATH_INFO: `/v3/projects` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:54.232922 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0706f8-89d6-4913-a2d3-5190358d8d4c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:54.233227 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0706f8-89d6-4913-a2d3-5190358d8d4c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:54.234645 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0706f8-89d6-4913-a2d3-5190358d8d4c None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:54.249375 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 387/779] 10.222.0.59 () {56 vars in 1148 bytes} [Tue Oct 4 11:40:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:54.249375 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0706f8-89d6-4913-a2d3-5190358d8d4c None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:54.255508 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:54.300705 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f167d48-b6ee-4261-a39e-8ec6e23ad8f0 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:54.340915 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182e1797-ae2f-4a61-8112-98f985c60023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:54.341450 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182e1797-ae2f-4a61-8112-98f985c60023 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:54.341727 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182e1797-ae2f-4a61-8112-98f985c60023 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:54.341989 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182e1797-ae2f-4a61-8112-98f985c60023 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:54.353404 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182e1797-ae2f-4a61-8112-98f985c60023 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 11:40:54.358251 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-182e1797-ae2f-4a61-8112-98f985c60023 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 11:40:54.358251 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:54.358251 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:54.358251 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:54.358251 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:54.358251 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:54.358251 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:54.358251 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:54.358251 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:54.358251 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:54.358251 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:54.358251 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:54.358251 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 11:40:54.358251 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 11:40:54.358251 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 11:40:54.358251 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 11:40:54.359242 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 11:40:54.359242 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 11:40:54.359242 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 11:40:54.359242 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 11:40:54.359242 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:54.359242 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:54.359242 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:40:54.359242 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:40:54.359242 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:40:54.359242 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:40:54.359242 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:40:54.359242 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:40:54.359242 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:40:54.359242 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:40:54.359242 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:40:54.359242 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:40:54.360138 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:40:54.360138 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:40:54.360138 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:40:54.360138 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:40:54.360138 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 11:40:54.360138 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 11:40:54.360138 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 11:40:54.360138 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 11:40:54.360138 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 11:40:54.360138 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 11:40:54.360138 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 11:40:54.360138 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:40:54.360138 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 393/780] 10.222.0.59 () {56 vars in 1096 bytes} [Tue Oct 4 11:40:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:40:54.360138 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182e1797-ae2f-4a61-8112-98f985c60023 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:54.367861 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0706f8-89d6-4913-a2d3-5190358d8d4c None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:54.399482 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:54.404370 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8024d5c4-01dd-4a15-9c8b-953344561c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:54.405215 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8024d5c4-01dd-4a15-9c8b-953344561c76 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:54.405658 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8024d5c4-01dd-4a15-9c8b-953344561c76 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:54.406083 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8024d5c4-01dd-4a15-9c8b-953344561c76 None admin] PATH_INFO: `/v3/endpoints` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:54.406846 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8024d5c4-01dd-4a15-9c8b-953344561c76 None admin] RBAC: Adding query filter params (interface=public, service_id=0136b9004a4d49a0843553a6b6147dee, region_id=RegionOne) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:54.407157 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8024d5c4-01dd-4a15-9c8b-953344561c76 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:54.408553 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8024d5c4-01dd-4a15-9c8b-953344561c76 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:54.418367 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 388/781] 10.222.0.59 () {56 vars in 1251 bytes} [Tue Oct 4 11:40:54 2022] GET /identity/v3/endpoints?service_id=0136b9004a4d49a0843553a6b6147dee&interface=public®ion_id=RegionOne => generated 194 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:54.419638 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8b655e-d8ad-48a1-a71d-ee42ae1ff3e7 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:54.419927 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8b655e-d8ad-48a1-a71d-ee42ae1ff3e7 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:54.420202 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8b655e-d8ad-48a1-a71d-ee42ae1ff3e7 None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:54.424669 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 389/782] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:40:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:40:54.424669 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8b655e-d8ad-48a1-a71d-ee42ae1ff3e7 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:54.472896 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182e1797-ae2f-4a61-8112-98f985c60023 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:54.499005 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:54.514927 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31b39eb-7958-4e85-920e-bc4b7cae0b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:54.515572 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31b39eb-7958-4e85-920e-bc4b7cae0b21 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:54.515831 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31b39eb-7958-4e85-920e-bc4b7cae0b21 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:54.516102 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31b39eb-7958-4e85-920e-bc4b7cae0b21 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:54.516941 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31b39eb-7958-4e85-920e-bc4b7cae0b21 None admin] RBAC: Adding query filter params (role.id=01769bbdbd2e48f2bf8e855ba6a8507e, scope.project.id=39913dbe3e984f27a61493dd75381501, user.id=06d1850ea27c483780eed67ede9cc1e3) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:54.517402 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31b39eb-7958-4e85-920e-bc4b7cae0b21 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:54.518857 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31b39eb-7958-4e85-920e-bc4b7cae0b21 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:54.527494 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 394/783] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Oct 4 11:40:54 2022] GET /identity/v3/role_assignments?user.id=06d1850ea27c483780eed67ede9cc1e3&scope.project.id=39913dbe3e984f27a61493dd75381501&role.id=01769bbdbd2e48f2bf8e855ba6a8507e => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:54.537943 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31b39eb-7958-4e85-920e-bc4b7cae0b21 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:54.542452 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8b655e-d8ad-48a1-a71d-ee42ae1ff3e7 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:54.596031 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d256ada-089d-4d31-9ccc-ea6bc7b8ad0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:54.596697 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d256ada-089d-4d31-9ccc-ea6bc7b8ad0e None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:54.597037 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d256ada-089d-4d31-9ccc-ea6bc7b8ad0e None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:54.597392 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d256ada-089d-4d31-9ccc-ea6bc7b8ad0e None admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:54.598465 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d256ada-089d-4d31-9ccc-ea6bc7b8ad0e None admin] RBAC: Adding query filter params (name=admin) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:54.598600 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d256ada-089d-4d31-9ccc-ea6bc7b8ad0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:54.600285 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d256ada-089d-4d31-9ccc-ea6bc7b8ad0e None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:54.611051 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 390/784] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Oct 4 11:40:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:54.612663 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9163510f-0435-4c9c-9b0d-69edb847ee23 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:54.613016 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9163510f-0435-4c9c-9b0d-69edb847ee23 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:54.613348 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9163510f-0435-4c9c-9b0d-69edb847ee23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:54.633413 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-9163510f-0435-4c9c-9b0d-69edb847ee23 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:40:54.634742 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-9163510f-0435-4c9c-9b0d-69edb847ee23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:40:54.664663 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:54.668938 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31b39eb-7958-4e85-920e-bc4b7cae0b21 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:54.731217 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6fc830-6ec8-4fe4-8c41-d9d558f3c72f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:54.733391 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6fc830-6ec8-4fe4-8c41-d9d558f3c72f None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:54.734084 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6fc830-6ec8-4fe4-8c41-d9d558f3c72f None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:54.734934 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6fc830-6ec8-4fe4-8c41-d9d558f3c72f None admin] PATH_INFO: `/v3/services` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:54.736244 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6fc830-6ec8-4fe4-8c41-d9d558f3c72f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:54.738901 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6fc830-6ec8-4fe4-8c41-d9d558f3c72f None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:54.744779 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 391/785] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:40:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 11:40:54.746165 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9163510f-0435-4c9c-9b0d-69edb847ee23 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:54.756646 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 395/786] 10.222.0.59 () {56 vars in 1087 bytes} [Tue Oct 4 11:40:54 2022] GET /identity/v3/services => generated 772 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:54.867296 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:54.939347 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9163510f-0435-4c9c-9b0d-69edb847ee23 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:54.998627 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c6d0be-0816-4195-b206-d11fad686969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:54.999621 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c6d0be-0816-4195-b206-d11fad686969 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:55.000088 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c6d0be-0816-4195-b206-d11fad686969 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:55.000560 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c6d0be-0816-4195-b206-d11fad686969 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:55.019344 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c6d0be-0816-4195-b206-d11fad686969 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:55.021964 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c6d0be-0816-4195-b206-d11fad686969 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:55.048119 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-11c6d0be-0816-4195-b206-d11fad686969 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:40:55.048119 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:55.048119 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:55.048119 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:55.048119 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:55.048119 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:55.048119 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:55.048119 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:55.048119 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:55.048119 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:55.048119 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:55.048119 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:55.048119 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 11:40:55.048119 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 11:40:55.048119 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 11:40:55.048119 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 11:40:55.050030 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:55.050030 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:55.050030 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:40:55.050030 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:40:55.050030 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:40:55.050030 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:40:55.050030 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:40:55.050030 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:40:55.050030 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:40:55.050030 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:40:55.050030 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:40:55.050030 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:40:55.050030 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:40:55.050030 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:40:55.050030 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:40:55.050030 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:40:55.050030 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 11:40:55.051207 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 11:40:55.051207 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:40:55.051207 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:40:55.051207 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 392/787] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Oct 4 11:40:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:40:55.055915 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6fc830-6ec8-4fe4-8c41-d9d558f3c72f None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:55.188123 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6fc830-6ec8-4fe4-8c41-d9d558f3c72f None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:55.225509 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb6ae5f-6311-4825-9129-30a4310bceda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:55.226488 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb6ae5f-6311-4825-9129-30a4310bceda None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:55.226972 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb6ae5f-6311-4825-9129-30a4310bceda None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:55.227522 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb6ae5f-6311-4825-9129-30a4310bceda None admin] PATH_INFO: `/v3/domains` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:55.228414 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb6ae5f-6311-4825-9129-30a4310bceda None admin] RBAC: Adding query filter params (name=Default) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:55.228972 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb6ae5f-6311-4825-9129-30a4310bceda None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:55.230692 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb6ae5f-6311-4825-9129-30a4310bceda None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:55.244191 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 396/788] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Oct 4 11:40:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:55.249956 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c6d0be-0816-4195-b206-d11fad686969 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:55.271865 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb6ae5f-6311-4825-9129-30a4310bceda None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:55.313559 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:55.384034 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c6d0be-0816-4195-b206-d11fad686969 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:55.396760 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:55.445022 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff634f0-26d2-465e-950b-d192d5d46818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:55.445567 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff634f0-26d2-465e-950b-d192d5d46818 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:55.445840 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff634f0-26d2-465e-950b-d192d5d46818 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:55.446107 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff634f0-26d2-465e-950b-d192d5d46818 None admin] PATH_INFO: `/v3/users/swift` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:55.451239 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb6ae5f-6311-4825-9129-30a4310bceda None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:55.465096 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff634f0-26d2-465e-950b-d192d5d46818 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:55.466582 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff634f0-26d2-465e-950b-d192d5d46818 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:55.486967 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-2ff634f0-26d2-465e-950b-d192d5d46818 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 04 11:40:55.486967 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:55.486967 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:55.486967 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:55.486967 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:55.486967 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:55.486967 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:55.486967 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:55.486967 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:55.486967 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:55.486967 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:55.486967 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:55.486967 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 11:40:55.486967 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 11:40:55.486967 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 11:40:55.486967 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 11:40:55.488012 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:55.488012 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:55.488012 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 11:40:55.488012 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 11:40:55.488012 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 11:40:55.488012 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 11:40:55.488012 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:40:55.488012 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:40:55.488012 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:40:55.488012 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:40:55.488012 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:40:55.488012 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:40:55.488012 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:40:55.488012 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:40:55.488012 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:40:55.488012 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:40:55.488012 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:40:55.488012 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:40:55.489042 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:40:55.489042 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:40:55.489042 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 11:40:55.489042 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 11:40:55.489042 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 11:40:55.489042 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 11:40:55.489042 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 11:40:55.489042 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 11:40:55.489042 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 04 11:40:55.489042 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:40:55.489042 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 393/789] 10.222.0.59 () {56 vars in 1096 bytes} [Tue Oct 4 11:40:55 2022] GET /identity/v3/users/swift => generated 83 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:40:55.495333 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff634f0-26d2-465e-950b-d192d5d46818 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:55.524446 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea280f01-a5eb-4081-bb5c-f0fee76fc61f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:55.524446 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea280f01-a5eb-4081-bb5c-f0fee76fc61f None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:55.524809 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea280f01-a5eb-4081-bb5c-f0fee76fc61f None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:55.525079 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea280f01-a5eb-4081-bb5c-f0fee76fc61f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:55.547633 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea280f01-a5eb-4081-bb5c-f0fee76fc61f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 11:40:55.554685 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-ea280f01-a5eb-4081-bb5c-f0fee76fc61f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 11:40:55.554685 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:55.554685 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:55.554685 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:55.554685 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:55.554685 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:55.554685 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:55.554685 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:55.554685 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:55.554685 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:55.554685 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:55.554685 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:55.554685 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 11:40:55.554685 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 11:40:55.554685 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 11:40:55.554685 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 11:40:55.555649 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 11:40:55.555649 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 11:40:55.555649 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 11:40:55.555649 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 11:40:55.555649 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:55.555649 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:55.555649 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:40:55.555649 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:40:55.555649 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:40:55.555649 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:40:55.555649 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:40:55.555649 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:40:55.555649 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:40:55.555649 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:40:55.555649 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:40:55.555649 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:40:55.556522 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:40:55.556522 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:40:55.556522 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:40:55.556522 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:40:55.556522 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 11:40:55.556522 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 11:40:55.556522 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 11:40:55.556522 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 11:40:55.556522 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 11:40:55.556522 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 11:40:55.556522 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 11:40:55.556522 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:40:55.556522 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 397/790] 10.222.0.59 () {56 vars in 1096 bytes} [Tue Oct 4 11:40:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 11:40:55.567171 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea280f01-a5eb-4081-bb5c-f0fee76fc61f None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:55.683228 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff634f0-26d2-465e-950b-d192d5d46818 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:55.719024 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bad788b-8726-4628-9ac0-6275495634bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:55.720580 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bad788b-8726-4628-9ac0-6275495634bf None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:55.721719 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:55.722291 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bad788b-8726-4628-9ac0-6275495634bf None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:55.722809 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bad788b-8726-4628-9ac0-6275495634bf None admin] PATH_INFO: `/v3/users` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:55.723760 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bad788b-8726-4628-9ac0-6275495634bf None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:55.724525 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bad788b-8726-4628-9ac0-6275495634bf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:55.726181 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bad788b-8726-4628-9ac0-6275495634bf None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:55.745946 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 394/791] 10.222.0.59 () {56 vars in 1135 bytes} [Tue Oct 4 11:40:55 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:55.751203 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bad788b-8726-4628-9ac0-6275495634bf None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:55.759334 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea280f01-a5eb-4081-bb5c-f0fee76fc61f None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:55.801151 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:55.832957 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12cf0ac-0524-4da1-ae64-a40389162e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:55.833887 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12cf0ac-0524-4da1-ae64-a40389162e62 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:55.834160 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12cf0ac-0524-4da1-ae64-a40389162e62 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:55.834424 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12cf0ac-0524-4da1-ae64-a40389162e62 None admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:55.835275 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12cf0ac-0524-4da1-ae64-a40389162e62 None admin] RBAC: Adding query filter params (name=admin) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:55.835473 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12cf0ac-0524-4da1-ae64-a40389162e62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:55.836865 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12cf0ac-0524-4da1-ae64-a40389162e62 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:55.859309 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 398/792] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Oct 4 11:40:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:55.879900 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12cf0ac-0524-4da1-ae64-a40389162e62 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:55.894635 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bad788b-8726-4628-9ac0-6275495634bf None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:55.935814 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eef078-64bd-4cc5-9cda-e73f22841bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:55.936943 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eef078-64bd-4cc5-9cda-e73f22841bb6 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:55.937445 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eef078-64bd-4cc5-9cda-e73f22841bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:55.937917 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eef078-64bd-4cc5-9cda-e73f22841bb6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:55.950500 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eef078-64bd-4cc5-9cda-e73f22841bb6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:55.952403 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eef078-64bd-4cc5-9cda-e73f22841bb6 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:55.969197 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-74eef078-64bd-4cc5-9cda-e73f22841bb6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:40:55.969197 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:55.969197 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:55.969197 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:55.969197 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:55.969197 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:55.969197 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:55.969197 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:55.969197 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:55.969197 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:55.969197 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:55.969197 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:55.969197 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 11:40:55.969197 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 11:40:55.969197 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 11:40:55.969197 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 11:40:55.970737 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:55.970737 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:55.970737 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:40:55.970737 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:40:55.970737 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:40:55.970737 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:40:55.970737 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:40:55.970737 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:40:55.970737 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:40:55.970737 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:40:55.970737 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:40:55.970737 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:40:55.970737 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:40:55.970737 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:40:55.970737 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:40:55.970737 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:40:55.970737 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 11:40:55.972305 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 11:40:55.972305 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:40:55.972305 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:40:55.975081 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 395/793] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Oct 4 11:40:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:40:55.980265 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eef078-64bd-4cc5-9cda-e73f22841bb6 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:56.072501 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12cf0ac-0524-4da1-ae64-a40389162e62 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:56.074113 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:56.097399 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eef078-64bd-4cc5-9cda-e73f22841bb6 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:56.122517 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52d93fc-86ee-4786-8779-bbccd7534a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:56.123185 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52d93fc-86ee-4786-8779-bbccd7534a9c None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:56.123584 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52d93fc-86ee-4786-8779-bbccd7534a9c None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:56.123916 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52d93fc-86ee-4786-8779-bbccd7534a9c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:56.136465 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52d93fc-86ee-4786-8779-bbccd7534a9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:56.138055 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52d93fc-86ee-4786-8779-bbccd7534a9c None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:56.140944 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:56.144092 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c438d9-6683-4291-9f93-71b83acb9103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:56.145060 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c438d9-6683-4291-9f93-71b83acb9103 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:56.145581 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c438d9-6683-4291-9f93-71b83acb9103 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:56.146051 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c438d9-6683-4291-9f93-71b83acb9103 None admin] PATH_INFO: `/v3/domains` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:56.146885 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c438d9-6683-4291-9f93-71b83acb9103 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:56.147388 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c438d9-6683-4291-9f93-71b83acb9103 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:56.148984 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c438d9-6683-4291-9f93-71b83acb9103 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:56.158946 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-a52d93fc-86ee-4786-8779-bbccd7534a9c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:40:56.158946 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:56.158946 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:56.158946 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:56.158946 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:56.158946 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:56.158946 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:56.158946 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:56.158946 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:56.158946 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:56.158946 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:56.158946 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:56.158946 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 11:40:56.158946 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 11:40:56.158946 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 11:40:56.158946 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 11:40:56.159993 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:56.159993 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:56.159993 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:40:56.159993 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:40:56.159993 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:40:56.159993 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:40:56.159993 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:40:56.159993 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:40:56.159993 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:40:56.159993 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:40:56.159993 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:40:56.159993 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:40:56.159993 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:40:56.159993 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:40:56.159993 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:40:56.159993 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:40:56.159993 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 11:40:56.168965 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 11:40:56.168965 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:40:56.168965 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:40:56.168965 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 399/794] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Oct 4 11:40:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 11:40:56.168965 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b08319-9006-413f-b2dc-bcf025a36138 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:56.168965 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b08319-9006-413f-b2dc-bcf025a36138 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:56.168965 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b08319-9006-413f-b2dc-bcf025a36138 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:56.168965 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 400/795] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:40:56 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:40:56.169447 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 396/796] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Oct 4 11:40:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:56.169522 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc883a5-941f-48ab-8f9e-a60607af82e6 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:56.169522 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc883a5-941f-48ab-8f9e-a60607af82e6 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:56.169522 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc883a5-941f-48ab-8f9e-a60607af82e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:56.173625 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c438d9-6683-4291-9f93-71b83acb9103 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:56.196006 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-5fc883a5-941f-48ab-8f9e-a60607af82e6 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:40:56.197998 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-5fc883a5-941f-48ab-8f9e-a60607af82e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:40:56.286711 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 401/797] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:40:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 11:40:56.287882 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc883a5-941f-48ab-8f9e-a60607af82e6 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:56.292919 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c438d9-6683-4291-9f93-71b83acb9103 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:56.364198 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c224c75-6d95-4968-a512-a93200d2a797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:56.365254 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c224c75-6d95-4968-a512-a93200d2a797 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:56.365743 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c224c75-6d95-4968-a512-a93200d2a797 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:56.366261 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c224c75-6d95-4968-a512-a93200d2a797 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:56.376402 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c224c75-6d95-4968-a512-a93200d2a797 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:56.378826 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c224c75-6d95-4968-a512-a93200d2a797 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:56.388913 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:56.402097 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-0c224c75-6d95-4968-a512-a93200d2a797 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 11:40:56.402097 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:56.402097 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:56.402097 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:56.402097 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:56.402097 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:56.402097 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:56.402097 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:56.402097 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:56.402097 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:56.402097 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:56.402097 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:56.402097 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 11:40:56.402097 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 11:40:56.402097 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 11:40:56.403051 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 11:40:56.403051 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:56.403051 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:56.403051 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:40:56.403051 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:40:56.403051 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:40:56.403051 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:40:56.403051 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:40:56.403051 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:40:56.403051 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:40:56.403051 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:40:56.403051 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:40:56.403051 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:40:56.403051 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:40:56.403051 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:40:56.403051 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:40:56.403051 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:40:56.403958 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 11:40:56.403958 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 11:40:56.403958 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 11:40:56.403958 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 11:40:56.403958 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 11:40:56.403958 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 11:40:56.403958 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 11:40:56.403958 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:40:56.403958 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 397/798] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Oct 4 11:40:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:40:56.412508 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c224c75-6d95-4968-a512-a93200d2a797 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:56.490389 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc883a5-941f-48ab-8f9e-a60607af82e6 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:56.547068 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:56.567312 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0836d6a6-c26a-4c65-b0c3-1e89be5722e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:56.567926 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0836d6a6-c26a-4c65-b0c3-1e89be5722e1 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:56.573254 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0836d6a6-c26a-4c65-b0c3-1e89be5722e1 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:56.573254 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0836d6a6-c26a-4c65-b0c3-1e89be5722e1 None admin] PATH_INFO: `/v3/domains` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:56.573254 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0836d6a6-c26a-4c65-b0c3-1e89be5722e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:56.573254 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0836d6a6-c26a-4c65-b0c3-1e89be5722e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:56.573254 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0836d6a6-c26a-4c65-b0c3-1e89be5722e1 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:56.596288 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 402/799] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Oct 4 11:40:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:56.597458 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0836d6a6-c26a-4c65-b0c3-1e89be5722e1 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:56.597656 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c224c75-6d95-4968-a512-a93200d2a797 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:56.637577 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b66da2-7f2b-46d9-9aaa-68a6bfd22607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:56.638191 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b66da2-7f2b-46d9-9aaa-68a6bfd22607 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:56.638472 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b66da2-7f2b-46d9-9aaa-68a6bfd22607 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:56.638749 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b66da2-7f2b-46d9-9aaa-68a6bfd22607 None admin] PATH_INFO: `/v3/projects` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:56.639439 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b66da2-7f2b-46d9-9aaa-68a6bfd22607 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:56.639743 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b66da2-7f2b-46d9-9aaa-68a6bfd22607 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:56.641202 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b66da2-7f2b-46d9-9aaa-68a6bfd22607 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:56.654634 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 398/800] 10.222.0.59 () {56 vars in 1148 bytes} [Tue Oct 4 11:40:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:56.655461 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b66da2-7f2b-46d9-9aaa-68a6bfd22607 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:56.732430 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0836d6a6-c26a-4c65-b0c3-1e89be5722e1 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:56.734693 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:56.769103 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ff6ace-edcf-414f-8af6-84470f0c7544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:56.769786 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ff6ace-edcf-414f-8af6-84470f0c7544 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:56.770075 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ff6ace-edcf-414f-8af6-84470f0c7544 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:56.770356 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ff6ace-edcf-414f-8af6-84470f0c7544 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:56.770996 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ff6ace-edcf-414f-8af6-84470f0c7544 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:56.772575 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ff6ace-edcf-414f-8af6-84470f0c7544 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:56.780789 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b66da2-7f2b-46d9-9aaa-68a6bfd22607 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:56.782359 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-87ff6ace-edcf-414f-8af6-84470f0c7544 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 04 11:40:56.782359 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:56.782359 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 11:40:56.782359 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 11:40:56.782359 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 11:40:56.782359 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 11:40:56.782359 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 11:40:56.782359 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 11:40:56.782359 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 04 11:40:56.782359 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:40:56.782359 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 11:40:56.782359 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:40:56.782359 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:56.782359 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:56.782359 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:56.782359 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:56.782359 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:56.784692 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:56.784692 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:56.784692 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:56.784692 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:56.784692 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:56.784692 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:56.784692 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 11:40:56.784692 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 11:40:56.784692 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 11:40:56.784692 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 11:40:56.784692 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:56.784692 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:56.784692 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:40:56.784692 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:40:56.784692 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:40:56.784692 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:40:56.786719 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:40:56.786719 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:40:56.786719 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:40:56.786719 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:40:56.786719 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:40:56.786719 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:40:56.786719 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:40:56.786719 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:40:56.786719 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:40:56.786719 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:40:56.786719 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 11:40:56.786719 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 11:40:56.786719 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 04 11:40:56.786719 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:40:56.786719 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 403/801] 10.222.0.59 () {56 vars in 1129 bytes} [Tue Oct 4 11:40:56 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:40:56.788328 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ff6ace-edcf-414f-8af6-84470f0c7544 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:56.819130 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22523f7f-f1fd-4f3f-a295-04d540af6405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:56.820037 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22523f7f-f1fd-4f3f-a295-04d540af6405 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:56.820314 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22523f7f-f1fd-4f3f-a295-04d540af6405 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:56.820680 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22523f7f-f1fd-4f3f-a295-04d540af6405 None admin] PATH_INFO: `/v3/users/nova` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:56.827961 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22523f7f-f1fd-4f3f-a295-04d540af6405 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:56.829922 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22523f7f-f1fd-4f3f-a295-04d540af6405 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:56.840631 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:56.841512 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-22523f7f-f1fd-4f3f-a295-04d540af6405 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 04 11:40:56.841512 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:56.841512 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:56.841512 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:56.841512 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:56.841512 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:56.841512 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:56.841512 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:56.841512 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:56.841512 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:56.841512 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:56.841512 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:56.841512 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 11:40:56.841512 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 11:40:56.841512 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 11:40:56.841512 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 11:40:56.842479 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:56.842479 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:56.842479 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 11:40:56.842479 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 11:40:56.842479 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 11:40:56.842479 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 11:40:56.842479 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:40:56.842479 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:40:56.842479 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:40:56.842479 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:40:56.842479 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:40:56.842479 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:40:56.842479 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:40:56.842479 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:40:56.842479 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:40:56.842479 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:40:56.842479 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:40:56.842479 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:40:56.843466 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:40:56.843466 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:40:56.843466 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 11:40:56.843466 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 11:40:56.843466 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 11:40:56.843466 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 11:40:56.843466 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 11:40:56.843466 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 11:40:56.843466 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 04 11:40:56.843466 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:40:56.843466 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 399/802] 10.222.0.59 () {56 vars in 1093 bytes} [Tue Oct 4 11:40:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:40:56.843466 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22523f7f-f1fd-4f3f-a295-04d540af6405 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:56.896460 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ff6ace-edcf-414f-8af6-84470f0c7544 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:56.931740 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a0f73b-53df-4e76-a589-bbba53260de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:56.932403 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a0f73b-53df-4e76-a589-bbba53260de2 None admin] REQUEST_METHOD: `PUT` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:56.932711 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a0f73b-53df-4e76-a589-bbba53260de2 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:56.932987 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a0f73b-53df-4e76-a589-bbba53260de2 None admin] PATH_INFO: `/v3/projects/39913dbe3e984f27a61493dd75381501/users/1605c3e03b7a4bcba4e19f0d92c671bc/roles/d6e7421d1ff9451c808004b818354550` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:56.934964 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a0f73b-53df-4e76-a589-bbba53260de2 None admin] RBAC: Authorizing `identity:create_grant(project_id=39913dbe3e984f27a61493dd75381501, user_id=1605c3e03b7a4bcba4e19f0d92c671bc, role_id=d6e7421d1ff9451c808004b818354550)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:56.936507 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a0f73b-53df-4e76-a589-bbba53260de2 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:56.949211 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22523f7f-f1fd-4f3f-a295-04d540af6405 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:56.969267 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:56.983505 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16c4dde-eaa2-42bb-b443-73cadcc02b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:56.984109 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16c4dde-eaa2-42bb-b443-73cadcc02b77 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:56.984388 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16c4dde-eaa2-42bb-b443-73cadcc02b77 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:56.984694 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16c4dde-eaa2-42bb-b443-73cadcc02b77 None admin] PATH_INFO: `/v3/services` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:56.985318 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16c4dde-eaa2-42bb-b443-73cadcc02b77 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:56.985671 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16c4dde-eaa2-42bb-b443-73cadcc02b77 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:56.987021 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16c4dde-eaa2-42bb-b443-73cadcc02b77 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:56.991325 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 400/803] 10.222.0.59 () {56 vars in 1124 bytes} [Tue Oct 4 11:40:56 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:56.992524 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549321c3-4b04-4747-a9ba-2ff30bdc3a22 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:56.992842 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549321c3-4b04-4747-a9ba-2ff30bdc3a22 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:56.993116 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549321c3-4b04-4747-a9ba-2ff30bdc3a22 None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:56.996302 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 401/804] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:40:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:40:56.996302 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549321c3-4b04-4747-a9ba-2ff30bdc3a22 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:57.044687 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 404/805] 10.222.0.59 () {58 vars in 1439 bytes} [Tue Oct 4 11:40:56 2022] PUT /identity/v3/projects/39913dbe3e984f27a61493dd75381501/users/1605c3e03b7a4bcba4e19f0d92c671bc/roles/d6e7421d1ff9451c808004b818354550 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 11:40:57.044687 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a0f73b-53df-4e76-a589-bbba53260de2 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:57.133297 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549321c3-4b04-4747-a9ba-2ff30bdc3a22 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:57.181414 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da40adb-4163-4611-b750-d01a79229120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:57.182437 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da40adb-4163-4611-b750-d01a79229120 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:57.182721 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da40adb-4163-4611-b750-d01a79229120 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:57.183144 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da40adb-4163-4611-b750-d01a79229120 None admin] PATH_INFO: `/v3/users` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:57.184067 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da40adb-4163-4611-b750-d01a79229120 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:57.184388 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da40adb-4163-4611-b750-d01a79229120 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:57.185380 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a0f73b-53df-4e76-a589-bbba53260de2 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:57.185986 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da40adb-4163-4611-b750-d01a79229120 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:57.200516 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:57.210313 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 402/806] 10.222.0.59 () {56 vars in 1133 bytes} [Tue Oct 4 11:40:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:57.212890 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baace5df-f61a-4694-8626-3153b0cfd841 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:57.213385 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baace5df-f61a-4694-8626-3153b0cfd841 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:57.213850 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baace5df-f61a-4694-8626-3153b0cfd841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:57.236715 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400134a2-6410-4ca7-93a4-cbd3e4304f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:57.237651 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400134a2-6410-4ca7-93a4-cbd3e4304f27 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:57.238116 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400134a2-6410-4ca7-93a4-cbd3e4304f27 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:57.238570 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400134a2-6410-4ca7-93a4-cbd3e4304f27 None admin] PATH_INFO: `/v3/services` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:57.238700 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-baace5df-f61a-4694-8626-3153b0cfd841 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:40:57.239541 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400134a2-6410-4ca7-93a4-cbd3e4304f27 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:57.239827 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-baace5df-f61a-4694-8626-3153b0cfd841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:40:57.239945 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400134a2-6410-4ca7-93a4-cbd3e4304f27 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:57.242026 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400134a2-6410-4ca7-93a4-cbd3e4304f27 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:57.247134 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 405/807] 10.222.0.59 () {56 vars in 1124 bytes} [Tue Oct 4 11:40:57 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:57.248056 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400134a2-6410-4ca7-93a4-cbd3e4304f27 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:57.279396 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:57.319832 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 403/808] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:40:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 11:40:57.328840 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baace5df-f61a-4694-8626-3153b0cfd841 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:57.365784 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400134a2-6410-4ca7-93a4-cbd3e4304f27 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:57.406109 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3933017c-e476-49df-aa00-81d16e636b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:57.406629 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3933017c-e476-49df-aa00-81d16e636b4c None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:57.406907 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3933017c-e476-49df-aa00-81d16e636b4c None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:57.407177 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3933017c-e476-49df-aa00-81d16e636b4c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:57.473209 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:57.511235 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baace5df-f61a-4694-8626-3153b0cfd841 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:57.513554 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3933017c-e476-49df-aa00-81d16e636b4c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:57.519437 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3933017c-e476-49df-aa00-81d16e636b4c None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:57.549089 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94b783c-4259-4d25-ae95-cdff0ad6b318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:57.549953 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94b783c-4259-4d25-ae95-cdff0ad6b318 None admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:57.550280 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94b783c-4259-4d25-ae95-cdff0ad6b318 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:57.550556 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94b783c-4259-4d25-ae95-cdff0ad6b318 None admin] PATH_INFO: `/v3/endpoints` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:57.551398 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94b783c-4259-4d25-ae95-cdff0ad6b318 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:57.555050 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94b783c-4259-4d25-ae95-cdff0ad6b318 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:57.633436 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 406/809] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Oct 4 11:40:57 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 11:40:57.634961 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fbd2eb-eed1-40a9-b7cc-610a62cfd050 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:57.635243 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fbd2eb-eed1-40a9-b7cc-610a62cfd050 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:57.635513 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fbd2eb-eed1-40a9-b7cc-610a62cfd050 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:57.641016 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 407/810] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:40:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:40:57.641016 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fbd2eb-eed1-40a9-b7cc-610a62cfd050 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:57.663386 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 404/811] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Oct 4 11:40:57 2022] POST /identity/v3/endpoints => generated 346 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 11:40:57.665996 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dff2ac-ca1b-4cf8-934f-471b3738d6e6 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:57.666285 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dff2ac-ca1b-4cf8-934f-471b3738d6e6 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:57.666718 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dff2ac-ca1b-4cf8-934f-471b3738d6e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:57.689794 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-03dff2ac-ca1b-4cf8-934f-471b3738d6e6 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:40:57.691048 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-03dff2ac-ca1b-4cf8-934f-471b3738d6e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:40:57.718556 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:57.745001 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:57.775130 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fbd2eb-eed1-40a9-b7cc-610a62cfd050 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:57.778451 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 405/812] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:40:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 11:40:57.779661 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dff2ac-ca1b-4cf8-934f-471b3738d6e6 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:57.816076 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed57c7c1-b1be-4885-9574-26ccac08807e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:57.816801 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed57c7c1-b1be-4885-9574-26ccac08807e None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:57.817149 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed57c7c1-b1be-4885-9574-26ccac08807e None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:57.817500 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed57c7c1-b1be-4885-9574-26ccac08807e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:57.829944 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed57c7c1-b1be-4885-9574-26ccac08807e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:57.832247 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed57c7c1-b1be-4885-9574-26ccac08807e None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:57.850723 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-ed57c7c1-b1be-4885-9574-26ccac08807e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:40:57.850723 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:57.850723 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:57.850723 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:57.850723 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:57.850723 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:57.850723 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:57.850723 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:57.850723 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:57.850723 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:57.850723 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:57.850723 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:57.850723 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 11:40:57.850723 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 11:40:57.850723 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 11:40:57.850723 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 11:40:57.851741 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:57.851741 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:57.851741 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:40:57.851741 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:40:57.851741 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:40:57.851741 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:40:57.851741 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:40:57.851741 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:40:57.851741 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:40:57.851741 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:40:57.851741 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:40:57.851741 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:40:57.851741 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:40:57.851741 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:40:57.851741 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:40:57.851741 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:40:57.851741 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 11:40:57.852984 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 11:40:57.852984 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:40:57.852984 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:40:57.852984 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 408/813] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Oct 4 11:40:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:40:57.858217 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed57c7c1-b1be-4885-9574-26ccac08807e None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:57.921236 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dff2ac-ca1b-4cf8-934f-471b3738d6e6 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:57.968061 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e928d5-030b-4080-b6d9-0deb402a39e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:57.969590 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e928d5-030b-4080-b6d9-0deb402a39e3 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:57.969590 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e928d5-030b-4080-b6d9-0deb402a39e3 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:57.969590 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e928d5-030b-4080-b6d9-0deb402a39e3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:57.984289 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e928d5-030b-4080-b6d9-0deb402a39e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 11:40:57.990164 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-88e928d5-030b-4080-b6d9-0deb402a39e3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 11:40:57.990164 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:57.990164 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:57.990164 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:57.990164 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:57.990164 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:57.990164 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:57.990164 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:57.990164 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:57.990164 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:57.990164 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:57.990164 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:57.990164 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 11:40:57.990164 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 11:40:57.990164 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 11:40:57.990164 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 11:40:57.991145 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 11:40:57.991145 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 11:40:57.991145 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 11:40:57.991145 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 11:40:57.991145 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:57.991145 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:57.991145 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:40:57.991145 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:40:57.991145 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:40:57.991145 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:40:57.991145 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:40:57.991145 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:40:57.991145 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:40:57.991145 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:40:57.991145 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:40:57.991145 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:40:57.992001 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:40:57.992001 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:40:57.992001 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:40:57.992001 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:40:57.992001 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 11:40:57.992001 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 11:40:57.992001 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 11:40:57.992001 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 11:40:57.992001 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 11:40:57.992001 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 11:40:57.992001 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 11:40:57.992001 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:40:57.992904 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 406/814] 10.222.0.59 () {56 vars in 1102 bytes} [Tue Oct 4 11:40:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:40:58.003750 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e928d5-030b-4080-b6d9-0deb402a39e3 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:58.014001 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed57c7c1-b1be-4885-9574-26ccac08807e None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:58.028211 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:58.042173 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:58.054485 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceec95b7-d6d1-4c1c-b3be-c845b3a30111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:58.055110 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceec95b7-d6d1-4c1c-b3be-c845b3a30111 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:58.055375 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceec95b7-d6d1-4c1c-b3be-c845b3a30111 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:58.055647 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceec95b7-d6d1-4c1c-b3be-c845b3a30111 None admin] PATH_INFO: `/v3/domains` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:58.056284 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceec95b7-d6d1-4c1c-b3be-c845b3a30111 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:58.056587 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceec95b7-d6d1-4c1c-b3be-c845b3a30111 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:58.058010 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceec95b7-d6d1-4c1c-b3be-c845b3a30111 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:58.071562 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 409/815] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Oct 4 11:40:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:58.077626 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceec95b7-d6d1-4c1c-b3be-c845b3a30111 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:58.137627 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e928d5-030b-4080-b6d9-0deb402a39e3 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:58.177041 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2c3f86-cb95-4772-a124-6a9b9db806c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:58.177576 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c3f86-cb95-4772-a124-6a9b9db806c3 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:58.177855 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c3f86-cb95-4772-a124-6a9b9db806c3 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:58.178136 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c3f86-cb95-4772-a124-6a9b9db806c3 None admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:58.178847 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2c3f86-cb95-4772-a124-6a9b9db806c3 None admin] RBAC: Adding query filter params (name=service) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:58.179150 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2c3f86-cb95-4772-a124-6a9b9db806c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:58.180558 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2c3f86-cb95-4772-a124-6a9b9db806c3 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:58.189431 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 407/816] 10.222.0.59 () {56 vars in 1103 bytes} [Tue Oct 4 11:40:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:58.190248 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2c3f86-cb95-4772-a124-6a9b9db806c3 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:58.230958 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceec95b7-d6d1-4c1c-b3be-c845b3a30111 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:58.279574 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:58.285103 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81515a35-70f9-4072-aee9-de69ee367545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:58.286114 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81515a35-70f9-4072-aee9-de69ee367545 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:58.289876 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81515a35-70f9-4072-aee9-de69ee367545 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:58.289876 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81515a35-70f9-4072-aee9-de69ee367545 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:58.294707 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81515a35-70f9-4072-aee9-de69ee367545 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:58.296350 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81515a35-70f9-4072-aee9-de69ee367545 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:58.300340 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2c3f86-cb95-4772-a124-6a9b9db806c3 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:58.309985 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-81515a35-70f9-4072-aee9-de69ee367545 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 11:40:58.309985 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:58.309985 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:58.309985 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:58.309985 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:58.309985 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:58.309985 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:58.309985 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:58.309985 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:58.309985 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:58.309985 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:58.309985 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:58.309985 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 11:40:58.309985 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 11:40:58.309985 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 11:40:58.310909 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 11:40:58.310909 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:58.310909 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:58.310909 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:40:58.310909 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:40:58.310909 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:40:58.310909 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:40:58.310909 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:40:58.310909 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:40:58.310909 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:40:58.310909 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:40:58.310909 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:40:58.310909 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:40:58.310909 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:40:58.310909 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:40:58.310909 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:40:58.310909 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:40:58.311823 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 11:40:58.311823 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 11:40:58.311823 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 11:40:58.311823 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 11:40:58.311823 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 11:40:58.311823 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 11:40:58.311823 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 11:40:58.311823 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:40:58.318758 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 410/817] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Oct 4 11:40:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 11:40:58.319850 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81515a35-70f9-4072-aee9-de69ee367545 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:58.337629 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afe3aef-58e1-4014-a056-89f20d58f20b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:58.338336 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe3aef-58e1-4014-a056-89f20d58f20b None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:58.338615 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe3aef-58e1-4014-a056-89f20d58f20b None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:58.338959 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe3aef-58e1-4014-a056-89f20d58f20b None admin] PATH_INFO: `/v3/services/network` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:58.339518 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afe3aef-58e1-4014-a056-89f20d58f20b None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:58.341047 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afe3aef-58e1-4014-a056-89f20d58f20b None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:58.350801 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-8afe3aef-58e1-4014-a056-89f20d58f20b None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 04 11:40:58.350801 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:58.350801 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 11:40:58.350801 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 11:40:58.350801 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 11:40:58.350801 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 11:40:58.350801 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 11:40:58.350801 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 11:40:58.350801 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 04 11:40:58.350801 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:40:58.350801 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 11:40:58.350801 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:40:58.350801 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:58.350801 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:58.350801 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:58.350801 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:58.350801 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:58.351829 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:58.351829 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:58.351829 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:58.351829 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:58.351829 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:58.351829 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:58.351829 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 11:40:58.351829 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 11:40:58.351829 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 11:40:58.351829 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 11:40:58.351829 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:58.351829 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:58.351829 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:40:58.351829 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:40:58.351829 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:40:58.351829 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:40:58.352746 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:40:58.352746 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:40:58.352746 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:40:58.352746 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:40:58.352746 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:40:58.352746 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:40:58.352746 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:40:58.352746 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:40:58.352746 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:40:58.352746 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:40:58.352746 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 11:40:58.352746 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 11:40:58.352746 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 04 11:40:58.352746 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:40:58.352746 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 408/818] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Oct 4 11:40:58 2022] GET /identity/v3/services/network => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:40:58.353545 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afe3aef-58e1-4014-a056-89f20d58f20b None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:58.371775 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:58.433541 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81515a35-70f9-4072-aee9-de69ee367545 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:58.469311 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756240fe-09d9-46da-bc4a-8461cfec936c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:58.470482 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756240fe-09d9-46da-bc4a-8461cfec936c None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:58.470906 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756240fe-09d9-46da-bc4a-8461cfec936c None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:58.471335 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756240fe-09d9-46da-bc4a-8461cfec936c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:58.481916 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afe3aef-58e1-4014-a056-89f20d58f20b None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:58.482654 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756240fe-09d9-46da-bc4a-8461cfec936c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:58.484268 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756240fe-09d9-46da-bc4a-8461cfec936c None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:58.499420 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-756240fe-09d9-46da-bc4a-8461cfec936c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:40:58.499420 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:58.499420 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:58.499420 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:58.499420 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:58.499420 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:58.499420 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:58.499420 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:58.499420 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:58.499420 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:58.499420 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:58.499420 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:58.499420 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 11:40:58.499420 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 11:40:58.499420 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 11:40:58.499420 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 11:40:58.500647 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:58.500647 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:58.500647 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:40:58.500647 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:40:58.500647 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:40:58.500647 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:40:58.500647 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:40:58.500647 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:40:58.500647 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:40:58.500647 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:40:58.500647 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:40:58.500647 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:40:58.500647 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:40:58.500647 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:40:58.500647 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:40:58.500647 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:40:58.500647 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 11:40:58.502154 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 11:40:58.502154 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:40:58.502154 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:40:58.508440 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 411/819] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Oct 4 11:40:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:40:58.509562 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756240fe-09d9-46da-bc4a-8461cfec936c None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:58.533064 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e21186-a7b9-45bf-98af-30fd28b04d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:58.534933 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e21186-a7b9-45bf-98af-30fd28b04d16 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:58.535694 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e21186-a7b9-45bf-98af-30fd28b04d16 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:58.537027 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e21186-a7b9-45bf-98af-30fd28b04d16 None admin] PATH_INFO: `/v3/projects` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:58.537814 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e21186-a7b9-45bf-98af-30fd28b04d16 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:58.538194 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e21186-a7b9-45bf-98af-30fd28b04d16 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:58.540362 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e21186-a7b9-45bf-98af-30fd28b04d16 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:58.566603 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 409/820] 10.222.0.59 () {56 vars in 1148 bytes} [Tue Oct 4 11:40:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:58.566603 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e21186-a7b9-45bf-98af-30fd28b04d16 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:58.571495 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:58.640359 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:58.649586 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756240fe-09d9-46da-bc4a-8461cfec936c None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:58.681016 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e21186-a7b9-45bf-98af-30fd28b04d16 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:58.695737 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83b3ec2-0323-4abf-ae19-67e2153fa9c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:58.696276 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83b3ec2-0323-4abf-ae19-67e2153fa9c2 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:58.696551 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83b3ec2-0323-4abf-ae19-67e2153fa9c2 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:58.696864 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83b3ec2-0323-4abf-ae19-67e2153fa9c2 None admin] PATH_INFO: `/v3/services` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:58.697741 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83b3ec2-0323-4abf-ae19-67e2153fa9c2 None admin] RBAC: Adding query filter params (name=network) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:58.698045 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83b3ec2-0323-4abf-ae19-67e2153fa9c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:58.700144 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83b3ec2-0323-4abf-ae19-67e2153fa9c2 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:58.708749 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 412/821] 10.222.0.59 () {56 vars in 1112 bytes} [Tue Oct 4 11:40:58 2022] GET /identity/v3/services?name=network => generated 124 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:58.709983 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83b3ec2-0323-4abf-ae19-67e2153fa9c2 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:58.729718 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd71c3b9-5694-43ec-9eda-22f6071029fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:58.730334 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd71c3b9-5694-43ec-9eda-22f6071029fe None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:58.730614 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd71c3b9-5694-43ec-9eda-22f6071029fe None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:58.730884 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd71c3b9-5694-43ec-9eda-22f6071029fe None admin] PATH_INFO: `/v3/domains` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:58.731918 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd71c3b9-5694-43ec-9eda-22f6071029fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:58.732222 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd71c3b9-5694-43ec-9eda-22f6071029fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:58.733908 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd71c3b9-5694-43ec-9eda-22f6071029fe None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:58.754502 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 410/822] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Oct 4 11:40:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:58.754502 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd71c3b9-5694-43ec-9eda-22f6071029fe None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:58.824485 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:58.844484 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83b3ec2-0323-4abf-ae19-67e2153fa9c2 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:58.875683 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd71c3b9-5694-43ec-9eda-22f6071029fe None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:58.882143 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147ce33e-3d22-4e24-b109-3cf93e8cef5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:58.883077 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147ce33e-3d22-4e24-b109-3cf93e8cef5d None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:58.883590 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147ce33e-3d22-4e24-b109-3cf93e8cef5d None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:58.884072 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147ce33e-3d22-4e24-b109-3cf93e8cef5d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:58.885008 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147ce33e-3d22-4e24-b109-3cf93e8cef5d None admin] RBAC: Adding query filter params (role.id=d6e7421d1ff9451c808004b818354550, scope.project.id=39913dbe3e984f27a61493dd75381501, user.id=a8e23d1d2fe24bdf9552e7c2f0ae3424) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:58.885515 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147ce33e-3d22-4e24-b109-3cf93e8cef5d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:58.887204 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147ce33e-3d22-4e24-b109-3cf93e8cef5d None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:58.901077 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 413/823] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Oct 4 11:40:58 2022] GET /identity/v3/role_assignments?user.id=a8e23d1d2fe24bdf9552e7c2f0ae3424&scope.project.id=39913dbe3e984f27a61493dd75381501&role.id=d6e7421d1ff9451c808004b818354550 => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:58.902449 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147ce33e-3d22-4e24-b109-3cf93e8cef5d None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:58.920575 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87adda54-dbb8-41b8-a861-a986068e999d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:58.924729 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87adda54-dbb8-41b8-a861-a986068e999d None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:58.927664 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87adda54-dbb8-41b8-a861-a986068e999d None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:58.928234 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87adda54-dbb8-41b8-a861-a986068e999d None admin] PATH_INFO: `/v3/services` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:58.930919 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87adda54-dbb8-41b8-a861-a986068e999d None admin] RBAC: Adding query filter params (type=network) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:58.931645 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87adda54-dbb8-41b8-a861-a986068e999d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:58.934977 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87adda54-dbb8-41b8-a861-a986068e999d None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:58.944963 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 411/824] 10.222.0.59 () {56 vars in 1112 bytes} [Tue Oct 4 11:40:58 2022] GET /identity/v3/services?type=network => generated 350 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:40:58.951700 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87adda54-dbb8-41b8-a861-a986068e999d None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:58.956537 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:59.077486 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147ce33e-3d22-4e24-b109-3cf93e8cef5d None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:59.111967 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87adda54-dbb8-41b8-a861-a986068e999d None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:59.153257 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b69dccc-6cb6-4c9d-bf20-e36679fc753d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:59.153911 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b69dccc-6cb6-4c9d-bf20-e36679fc753d None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:59.154189 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b69dccc-6cb6-4c9d-bf20-e36679fc753d None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:59.154461 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b69dccc-6cb6-4c9d-bf20-e36679fc753d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:59.166089 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b69dccc-6cb6-4c9d-bf20-e36679fc753d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:59.167549 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b69dccc-6cb6-4c9d-bf20-e36679fc753d None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:59.171269 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:59.181665 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-9b69dccc-6cb6-4c9d-bf20-e36679fc753d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 04 11:40:59.181665 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:59.181665 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:59.181665 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:59.181665 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:59.181665 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:59.181665 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:59.181665 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:59.181665 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:59.181665 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:59.181665 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:59.181665 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:59.181665 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 11:40:59.181665 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 11:40:59.181665 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 11:40:59.181665 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 11:40:59.197495 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:59.197495 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:59.197495 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 11:40:59.197495 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 11:40:59.197495 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 11:40:59.197495 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 11:40:59.197495 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:40:59.197495 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:40:59.197495 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:40:59.197495 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:40:59.197495 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:40:59.197495 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:40:59.197495 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:40:59.197495 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:40:59.197495 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:40:59.197495 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:40:59.197495 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:40:59.197495 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:40:59.198491 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:40:59.198491 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:40:59.198491 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 11:40:59.198491 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 11:40:59.198491 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 11:40:59.198491 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 11:40:59.198491 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 11:40:59.198491 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 11:40:59.198491 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 04 11:40:59.198491 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:40:59.199043 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac5c32f-ed4f-4639-8a00-3ee07e0e42ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:59.199043 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac5c32f-ed4f-4639-8a00-3ee07e0e42ae None admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:59.199225 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 414/825] 10.222.0.59 () {56 vars in 1117 bytes} [Tue Oct 4 11:40:58 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:40:59.199306 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac5c32f-ed4f-4639-8a00-3ee07e0e42ae None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:59.199306 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac5c32f-ed4f-4639-8a00-3ee07e0e42ae None admin] PATH_INFO: `/v3/endpoints` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:59.199306 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac5c32f-ed4f-4639-8a00-3ee07e0e42ae None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:59.199306 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac5c32f-ed4f-4639-8a00-3ee07e0e42ae None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:59.199569 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b69dccc-6cb6-4c9d-bf20-e36679fc753d None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:59.291663 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 412/826] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Oct 4 11:40:58 2022] POST /identity/v3/endpoints => generated 337 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 11:40:59.297623 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:59.321818 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b69dccc-6cb6-4c9d-bf20-e36679fc753d None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:59.371834 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a440b031-5288-4872-a502-d6af5e3143b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:59.372924 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a440b031-5288-4872-a502-d6af5e3143b1 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:59.373442 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a440b031-5288-4872-a502-d6af5e3143b1 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:59.373940 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a440b031-5288-4872-a502-d6af5e3143b1 None admin] PATH_INFO: `/v3/users` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:59.374948 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a440b031-5288-4872-a502-d6af5e3143b1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:59.375466 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a440b031-5288-4872-a502-d6af5e3143b1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:59.377932 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a440b031-5288-4872-a502-d6af5e3143b1 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:59.401955 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 415/827] 10.222.0.59 () {56 vars in 1149 bytes} [Tue Oct 4 11:40:59 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 11:40:59.407285 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac5c32f-ed4f-4639-8a00-3ee07e0e42ae None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:59.540742 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac5c32f-ed4f-4639-8a00-3ee07e0e42ae None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:59.541344 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e1aba-236d-48c7-b1a1-4f206d4dd108 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:59.541449 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e1aba-236d-48c7-b1a1-4f206d4dd108 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:59.541738 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e1aba-236d-48c7-b1a1-4f206d4dd108 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:59.543213 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 416/828] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:40:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 11:40:59.548304 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b86f462-c037-4c2b-9e67-75ecbfd2bb68 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:59.548958 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b86f462-c037-4c2b-9e67-75ecbfd2bb68 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:59.549228 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b86f462-c037-4c2b-9e67-75ecbfd2bb68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:59.573096 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-7b86f462-c037-4c2b-9e67-75ecbfd2bb68 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:40:59.574558 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-7b86f462-c037-4c2b-9e67-75ecbfd2bb68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:40:59.589349 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dac4aa-350d-4c8b-a4af-56d26a1e9027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:59.590598 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dac4aa-350d-4c8b-a4af-56d26a1e9027 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:59.591104 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dac4aa-350d-4c8b-a4af-56d26a1e9027 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:59.592035 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dac4aa-350d-4c8b-a4af-56d26a1e9027 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:59.609468 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dac4aa-350d-4c8b-a4af-56d26a1e9027 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:59.612141 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dac4aa-350d-4c8b-a4af-56d26a1e9027 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:59.635046 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-59dac4aa-350d-4c8b-a4af-56d26a1e9027 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:40:59.635046 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:40:59.635046 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:40:59.635046 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:40:59.635046 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:40:59.635046 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:40:59.635046 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:40:59.635046 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:40:59.635046 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:40:59.635046 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:40:59.635046 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:40:59.635046 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:40:59.635046 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 11:40:59.635046 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 11:40:59.635046 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 11:40:59.635046 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 11:40:59.636134 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:40:59.636134 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:40:59.636134 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:40:59.636134 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:40:59.636134 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:40:59.636134 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:40:59.636134 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:40:59.636134 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:40:59.636134 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:40:59.636134 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:40:59.636134 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:40:59.636134 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:40:59.636134 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:40:59.636134 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:40:59.636134 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:40:59.636134 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:40:59.636134 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 11:40:59.637065 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 11:40:59.637065 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:40:59.637065 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:40:59.638761 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 413/829] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Oct 4 11:40:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:40:59.646844 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dac4aa-350d-4c8b-a4af-56d26a1e9027 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:59.692358 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 417/830] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:40:59 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 11:40:59.694571 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:59.765676 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dac4aa-350d-4c8b-a4af-56d26a1e9027 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:59.810697 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483256c8-0110-4499-ab25-692122281d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:59.811560 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483256c8-0110-4499-ab25-692122281d59 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:59.811993 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483256c8-0110-4499-ab25-692122281d59 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:59.812405 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483256c8-0110-4499-ab25-692122281d59 None admin] PATH_INFO: `/v3/domains` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:40:59.813204 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483256c8-0110-4499-ab25-692122281d59 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:40:59.813694 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483256c8-0110-4499-ab25-692122281d59 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:40:59.815375 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483256c8-0110-4499-ab25-692122281d59 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:40:59.835384 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 414/831] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Oct 4 11:40:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 11:40:59.840853 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b86f462-c037-4c2b-9e67-75ecbfd2bb68 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:59.916899 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:59.954718 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b86f462-c037-4c2b-9e67-75ecbfd2bb68 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:40:59.985440 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483256c8-0110-4499-ab25-692122281d59 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:40:59.993667 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbce14f-d0a9-4dcf-8927-5fbc0805c505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:40:59.994651 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbce14f-d0a9-4dcf-8927-5fbc0805c505 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:40:59.995149 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbce14f-d0a9-4dcf-8927-5fbc0805c505 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:40:59.995648 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbce14f-d0a9-4dcf-8927-5fbc0805c505 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:00.003373 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbce14f-d0a9-4dcf-8927-5fbc0805c505 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:00.005299 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbce14f-d0a9-4dcf-8927-5fbc0805c505 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:00.018460 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-afbce14f-d0a9-4dcf-8927-5fbc0805c505 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 11:41:00.018460 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:41:00.018460 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:41:00.018460 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:41:00.018460 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:41:00.018460 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:41:00.018460 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:41:00.018460 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:41:00.018460 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:41:00.018460 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:41:00.018460 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:41:00.018460 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:41:00.018460 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 11:41:00.018460 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 11:41:00.018460 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 11:41:00.019414 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 11:41:00.019414 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:41:00.019414 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:41:00.019414 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:41:00.019414 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:41:00.019414 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:41:00.019414 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:41:00.019414 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:41:00.019414 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:41:00.019414 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:41:00.019414 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:41:00.019414 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:41:00.019414 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:41:00.019414 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:41:00.019414 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:41:00.019414 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:41:00.019414 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:41:00.020311 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 11:41:00.020311 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 11:41:00.020311 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 11:41:00.020311 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 11:41:00.020311 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 11:41:00.020311 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 11:41:00.020311 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 11:41:00.020311 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:41:00.022752 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 418/832] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Oct 4 11:40:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:41:00.028414 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbce14f-d0a9-4dcf-8927-5fbc0805c505 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:00.083429 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:00.089665 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483256c8-0110-4499-ab25-692122281d59 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:00.129269 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd2ccd3-aead-4cab-9065-c5a3a8339d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:00.129904 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd2ccd3-aead-4cab-9065-c5a3a8339d1e None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:00.130179 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd2ccd3-aead-4cab-9065-c5a3a8339d1e None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:00.130452 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd2ccd3-aead-4cab-9065-c5a3a8339d1e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:00.141197 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd2ccd3-aead-4cab-9065-c5a3a8339d1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 11:41:00.146815 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-ebd2ccd3-aead-4cab-9065-c5a3a8339d1e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 11:41:00.146815 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:41:00.146815 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:41:00.146815 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:41:00.146815 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:41:00.146815 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:41:00.146815 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:41:00.146815 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:41:00.146815 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:41:00.146815 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:41:00.146815 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:41:00.146815 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:41:00.146815 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 11:41:00.146815 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 11:41:00.146815 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 11:41:00.146815 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 11:41:00.147758 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 11:41:00.147758 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 11:41:00.147758 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 11:41:00.147758 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 11:41:00.147758 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:41:00.147758 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:41:00.147758 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:41:00.147758 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:41:00.147758 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:41:00.147758 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:41:00.147758 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:41:00.147758 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:41:00.147758 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:41:00.147758 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:41:00.147758 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:41:00.147758 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:41:00.148592 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:41:00.148592 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:41:00.148592 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:41:00.148592 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:41:00.148592 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 11:41:00.148592 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 11:41:00.148592 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 11:41:00.148592 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 11:41:00.148592 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 11:41:00.148592 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 11:41:00.148592 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 11:41:00.148592 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:41:00.151621 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbce14f-d0a9-4dcf-8927-5fbc0805c505 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:00.152855 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 415/833] 10.222.0.59 () {56 vars in 1096 bytes} [Tue Oct 4 11:40:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 11:41:00.154081 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd2ccd3-aead-4cab-9065-c5a3a8339d1e None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:00.180936 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:00.191450 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f22980d-ddaf-4a5e-ad79-d5997d73ba8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:00.192331 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f22980d-ddaf-4a5e-ad79-d5997d73ba8c None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:00.192816 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f22980d-ddaf-4a5e-ad79-d5997d73ba8c None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:00.193637 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f22980d-ddaf-4a5e-ad79-d5997d73ba8c None admin] PATH_INFO: `/v3/projects` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:00.194363 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f22980d-ddaf-4a5e-ad79-d5997d73ba8c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:41:00.194863 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f22980d-ddaf-4a5e-ad79-d5997d73ba8c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:00.196612 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f22980d-ddaf-4a5e-ad79-d5997d73ba8c None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:00.215255 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 419/834] 10.222.0.59 () {56 vars in 1148 bytes} [Tue Oct 4 11:41:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 11:41:00.215255 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77963e4c-e6ca-4f91-b720-c2be4755c386 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:00.215255 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77963e4c-e6ca-4f91-b720-c2be4755c386 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:00.215255 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77963e4c-e6ca-4f91-b720-c2be4755c386 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:00.216340 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 420/835] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:41:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:41:00.217059 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77963e4c-e6ca-4f91-b720-c2be4755c386 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:00.263292 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd2ccd3-aead-4cab-9065-c5a3a8339d1e None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:00.301460 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a58947-98ae-478d-ab96-a392f991d0cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:00.302407 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a58947-98ae-478d-ab96-a392f991d0cc None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:00.302893 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a58947-98ae-478d-ab96-a392f991d0cc None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:00.303935 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a58947-98ae-478d-ab96-a392f991d0cc None admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:00.304894 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a58947-98ae-478d-ab96-a392f991d0cc None admin] RBAC: Adding query filter params (name=admin) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:41:00.305791 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a58947-98ae-478d-ab96-a392f991d0cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:00.308012 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a58947-98ae-478d-ab96-a392f991d0cc None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:00.323733 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 416/836] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Oct 4 11:41:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:41:00.325802 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cbe6b5-ecfc-4aa3-87ef-61b04b4e1d04 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:00.326277 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cbe6b5-ecfc-4aa3-87ef-61b04b4e1d04 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:00.326563 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cbe6b5-ecfc-4aa3-87ef-61b04b4e1d04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:00.331640 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77963e4c-e6ca-4f91-b720-c2be4755c386 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:00.347906 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-65cbe6b5-ecfc-4aa3-87ef-61b04b4e1d04 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:41:00.349558 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-65cbe6b5-ecfc-4aa3-87ef-61b04b4e1d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:41:00.365821 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:00.366443 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dd488b-ba3f-42cf-b8d3-69bd35bf8d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:00.367086 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dd488b-ba3f-42cf-b8d3-69bd35bf8d6f None admin] REQUEST_METHOD: `PUT` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:00.367361 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dd488b-ba3f-42cf-b8d3-69bd35bf8d6f None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:00.367627 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dd488b-ba3f-42cf-b8d3-69bd35bf8d6f None admin] PATH_INFO: `/v3/projects/39913dbe3e984f27a61493dd75381501/users/06d1850ea27c483780eed67ede9cc1e3/roles/01769bbdbd2e48f2bf8e855ba6a8507e` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:00.382700 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dd488b-ba3f-42cf-b8d3-69bd35bf8d6f None admin] RBAC: Authorizing `identity:create_grant(project_id=39913dbe3e984f27a61493dd75381501, user_id=06d1850ea27c483780eed67ede9cc1e3, role_id=01769bbdbd2e48f2bf8e855ba6a8507e)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:00.384325 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dd488b-ba3f-42cf-b8d3-69bd35bf8d6f None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:00.424125 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 417/837] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:41:00 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 11:41:00.424984 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cbe6b5-ecfc-4aa3-87ef-61b04b4e1d04 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:00.453169 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 421/838] 10.222.0.59 () {58 vars in 1439 bytes} [Tue Oct 4 11:41:00 2022] PUT /identity/v3/projects/39913dbe3e984f27a61493dd75381501/users/06d1850ea27c483780eed67ede9cc1e3/roles/01769bbdbd2e48f2bf8e855ba6a8507e => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 11:41:00.553802 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cbe6b5-ecfc-4aa3-87ef-61b04b4e1d04 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:00.597202 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb24e7a-1bf6-41f3-af20-6d45cf497797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:00.598304 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb24e7a-1bf6-41f3-af20-6d45cf497797 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:00.598793 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb24e7a-1bf6-41f3-af20-6d45cf497797 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:00.599585 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb24e7a-1bf6-41f3-af20-6d45cf497797 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:00.612344 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb24e7a-1bf6-41f3-af20-6d45cf497797 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:00.614235 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb24e7a-1bf6-41f3-af20-6d45cf497797 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:00.624760 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:00.632455 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-0cb24e7a-1bf6-41f3-af20-6d45cf497797 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:41:00.632455 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:41:00.632455 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:41:00.632455 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:41:00.632455 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:41:00.632455 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:41:00.632455 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:41:00.632455 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:41:00.632455 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:41:00.632455 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:41:00.632455 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:41:00.632455 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:41:00.632455 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 11:41:00.632455 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 11:41:00.632455 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 11:41:00.632455 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 11:41:00.635526 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:41:00.635526 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:41:00.635526 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:41:00.635526 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:41:00.635526 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:41:00.635526 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:41:00.635526 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:41:00.635526 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:41:00.635526 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:41:00.635526 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:41:00.635526 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:41:00.635526 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:41:00.635526 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:41:00.635526 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:41:00.635526 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:41:00.635526 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:41:00.635526 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 11:41:00.636425 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 11:41:00.636425 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:41:00.636425 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:41:00.636425 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 418/839] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Oct 4 11:41:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:41:00.640144 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dd488b-ba3f-42cf-b8d3-69bd35bf8d6f None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:00.679496 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:00.709412 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb24e7a-1bf6-41f3-af20-6d45cf497797 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:00.761314 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dd488b-ba3f-42cf-b8d3-69bd35bf8d6f None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:00.799839 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2858ae7-4320-431d-b931-406382ab3b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:00.800462 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2858ae7-4320-431d-b931-406382ab3b74 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:00.800773 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2858ae7-4320-431d-b931-406382ab3b74 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:00.801104 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2858ae7-4320-431d-b931-406382ab3b74 None admin] PATH_INFO: `/v3/domains` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:00.801862 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2858ae7-4320-431d-b931-406382ab3b74 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:41:00.802175 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2858ae7-4320-431d-b931-406382ab3b74 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:00.803655 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2858ae7-4320-431d-b931-406382ab3b74 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:00.816175 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 422/840] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Oct 4 11:41:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:41:00.821291 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb24e7a-1bf6-41f3-af20-6d45cf497797 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:00.821723 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2858ae7-4320-431d-b931-406382ab3b74 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:00.858195 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0103d9-ea85-4898-a3ed-8e267020bfb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:00.858750 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0103d9-ea85-4898-a3ed-8e267020bfb1 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:00.859073 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0103d9-ea85-4898-a3ed-8e267020bfb1 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:00.859353 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0103d9-ea85-4898-a3ed-8e267020bfb1 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:00.859938 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0103d9-ea85-4898-a3ed-8e267020bfb1 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:00.862386 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0103d9-ea85-4898-a3ed-8e267020bfb1 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:00.871512 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-2f0103d9-ea85-4898-a3ed-8e267020bfb1 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 04 11:41:00.871512 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:41:00.871512 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 11:41:00.871512 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 11:41:00.871512 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 11:41:00.871512 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 11:41:00.871512 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 11:41:00.871512 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 11:41:00.871512 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 04 11:41:00.871512 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:41:00.871512 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 11:41:00.871512 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:41:00.871512 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:41:00.871512 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:41:00.871512 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:41:00.871512 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:41:00.871512 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:41:00.872526 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:41:00.872526 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:41:00.872526 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:41:00.872526 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:41:00.872526 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:41:00.872526 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:41:00.872526 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 11:41:00.872526 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 11:41:00.872526 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 11:41:00.872526 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 11:41:00.872526 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:41:00.872526 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:41:00.872526 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:41:00.872526 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:41:00.872526 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:41:00.872526 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:41:00.873458 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:41:00.873458 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:41:00.873458 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:41:00.873458 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:41:00.873458 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:41:00.873458 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:41:00.873458 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:41:00.873458 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:41:00.873458 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:41:00.873458 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:41:00.873458 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 11:41:00.873458 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 11:41:00.873458 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 04 11:41:00.873458 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:41:00.878293 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 419/841] 10.222.0.59 () {56 vars in 1114 bytes} [Tue Oct 4 11:41:00 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 11:41:00.879157 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0103d9-ea85-4898-a3ed-8e267020bfb1 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:00.930750 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2858ae7-4320-431d-b931-406382ab3b74 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:00.946115 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:00.954276 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:00.968806 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50f74ea-0b10-4ddf-b568-17b8d82cea25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:00.970299 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50f74ea-0b10-4ddf-b568-17b8d82cea25 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:00.970752 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50f74ea-0b10-4ddf-b568-17b8d82cea25 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:00.971303 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50f74ea-0b10-4ddf-b568-17b8d82cea25 None admin] PATH_INFO: `/v3/users/swift` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:00.980972 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50f74ea-0b10-4ddf-b568-17b8d82cea25 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:00.982775 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50f74ea-0b10-4ddf-b568-17b8d82cea25 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:00.988203 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0103d9-ea85-4898-a3ed-8e267020bfb1 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:01.001557 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-f50f74ea-0b10-4ddf-b568-17b8d82cea25 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 04 11:41:01.001557 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:41:01.001557 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:41:01.001557 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:41:01.001557 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:41:01.001557 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:41:01.001557 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:41:01.001557 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:41:01.001557 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:41:01.001557 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:41:01.001557 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:41:01.001557 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:41:01.001557 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 11:41:01.001557 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 11:41:01.001557 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 11:41:01.001557 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 11:41:01.003202 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:41:01.003202 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:41:01.003202 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 11:41:01.003202 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 11:41:01.003202 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 11:41:01.003202 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 11:41:01.003202 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:41:01.003202 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:41:01.003202 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:41:01.003202 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:41:01.003202 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:41:01.003202 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:41:01.003202 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:41:01.003202 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:41:01.003202 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:41:01.003202 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:41:01.003202 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:41:01.003202 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:41:01.005472 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:41:01.005472 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:41:01.005472 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 11:41:01.005472 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 11:41:01.005472 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 11:41:01.005472 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 11:41:01.005472 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 11:41:01.005472 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 11:41:01.005472 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 04 11:41:01.005472 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:41:01.012643 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 423/842] 10.222.0.59 () {56 vars in 1096 bytes} [Tue Oct 4 11:41:00 2022] GET /identity/v3/users/swift => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:41:01.014534 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50f74ea-0b10-4ddf-b568-17b8d82cea25 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:01.027990 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d0325e-89e3-43cb-9f5f-e35d377472e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:01.028956 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d0325e-89e3-43cb-9f5f-e35d377472e2 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:01.029411 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d0325e-89e3-43cb-9f5f-e35d377472e2 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:01.029857 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d0325e-89e3-43cb-9f5f-e35d377472e2 None admin] PATH_INFO: `/v3/services` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:01.030680 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d0325e-89e3-43cb-9f5f-e35d377472e2 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:41:01.031166 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d0325e-89e3-43cb-9f5f-e35d377472e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:01.033018 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d0325e-89e3-43cb-9f5f-e35d377472e2 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:01.042436 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 420/843] 10.222.0.59 () {56 vars in 1114 bytes} [Tue Oct 4 11:41:00 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:41:01.043749 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d0325e-89e3-43cb-9f5f-e35d377472e2 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:01.139927 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50f74ea-0b10-4ddf-b568-17b8d82cea25 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:01.158381 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d0325e-89e3-43cb-9f5f-e35d377472e2 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:01.185042 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43241e2f-0122-4b41-a180-b2b2dc6368cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:01.185717 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43241e2f-0122-4b41-a180-b2b2dc6368cc None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:01.186011 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43241e2f-0122-4b41-a180-b2b2dc6368cc None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:01.186294 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43241e2f-0122-4b41-a180-b2b2dc6368cc None admin] PATH_INFO: `/v3/users` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:01.187136 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43241e2f-0122-4b41-a180-b2b2dc6368cc None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:41:01.187551 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43241e2f-0122-4b41-a180-b2b2dc6368cc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:01.189848 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43241e2f-0122-4b41-a180-b2b2dc6368cc None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:01.191113 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:01.199929 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b7fa5c-b505-4650-adee-23ab9518c451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:01.200762 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b7fa5c-b505-4650-adee-23ab9518c451 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:01.201041 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b7fa5c-b505-4650-adee-23ab9518c451 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:01.201313 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b7fa5c-b505-4650-adee-23ab9518c451 None admin] PATH_INFO: `/v3/services` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:01.202835 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b7fa5c-b505-4650-adee-23ab9518c451 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:41:01.205799 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b7fa5c-b505-4650-adee-23ab9518c451 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:01.205799 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b7fa5c-b505-4650-adee-23ab9518c451 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:01.211463 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 421/844] 10.222.0.59 () {56 vars in 1114 bytes} [Tue Oct 4 11:41:01 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 11:41:01.211901 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 424/845] 10.222.0.59 () {56 vars in 1135 bytes} [Tue Oct 4 11:41:01 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 11:41:01.220772 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b7fa5c-b505-4650-adee-23ab9518c451 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:01.334694 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b7fa5c-b505-4650-adee-23ab9518c451 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:01.376930 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a911df-6a0d-45ea-bf39-406ff4ecc785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:01.378163 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a911df-6a0d-45ea-bf39-406ff4ecc785 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:01.378651 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a911df-6a0d-45ea-bf39-406ff4ecc785 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:01.379151 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a911df-6a0d-45ea-bf39-406ff4ecc785 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:01.443625 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:01.453250 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a911df-6a0d-45ea-bf39-406ff4ecc785 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:01.455031 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a911df-6a0d-45ea-bf39-406ff4ecc785 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:01.573812 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 422/846] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Oct 4 11:41:01 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 11:41:01.579871 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43241e2f-0122-4b41-a180-b2b2dc6368cc None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:01.596365 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e9ed56-c44d-47de-8cc2-08544e25f2e5 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:01.596706 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e9ed56-c44d-47de-8cc2-08544e25f2e5 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:01.596938 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e9ed56-c44d-47de-8cc2-08544e25f2e5 None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:01.599172 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:01.599426 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 423/847] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:41:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 11:41:01.604811 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c21e0b-2a72-441f-b10e-4ad585d0e09f None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:01.605092 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c21e0b-2a72-441f-b10e-4ad585d0e09f None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:01.605363 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c21e0b-2a72-441f-b10e-4ad585d0e09f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:01.624222 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-f7c21e0b-2a72-441f-b10e-4ad585d0e09f None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:41:01.625486 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-f7c21e0b-2a72-441f-b10e-4ad585d0e09f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:41:01.694409 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43241e2f-0122-4b41-a180-b2b2dc6368cc None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:01.702758 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 424/848] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:41:01 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 11:41:01.731130 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb37a526-9af4-4611-b9e1-ae770bdab9a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:01.731753 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb37a526-9af4-4611-b9e1-ae770bdab9a1 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:01.732078 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb37a526-9af4-4611-b9e1-ae770bdab9a1 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:01.732353 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb37a526-9af4-4611-b9e1-ae770bdab9a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:01.743207 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb37a526-9af4-4611-b9e1-ae770bdab9a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:01.744793 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb37a526-9af4-4611-b9e1-ae770bdab9a1 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:01.760554 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-fb37a526-9af4-4611-b9e1-ae770bdab9a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:41:01.760554 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:41:01.760554 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:41:01.760554 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:41:01.760554 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:41:01.760554 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:41:01.760554 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:41:01.760554 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:41:01.760554 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:41:01.760554 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:41:01.760554 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:41:01.760554 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:41:01.760554 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 11:41:01.760554 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 11:41:01.760554 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 11:41:01.760554 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 11:41:01.761580 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:41:01.761580 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:41:01.761580 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:41:01.761580 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:41:01.761580 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:41:01.761580 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:41:01.761580 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:41:01.761580 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:41:01.761580 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:41:01.761580 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:41:01.761580 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:41:01.761580 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:41:01.761580 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:41:01.761580 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:41:01.761580 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:41:01.761580 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:41:01.761580 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 11:41:01.762549 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 11:41:01.762549 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:41:01.762549 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:41:01.762549 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 425/849] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Oct 4 11:41:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:41:01.767870 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c21e0b-2a72-441f-b10e-4ad585d0e09f None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:01.792488 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:01.869852 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c21e0b-2a72-441f-b10e-4ad585d0e09f None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:01.905210 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f6fb7e-a01b-48ac-a08f-a347cea8ae42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:01.905814 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f6fb7e-a01b-48ac-a08f-a347cea8ae42 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:01.906088 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f6fb7e-a01b-48ac-a08f-a347cea8ae42 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:01.906358 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f6fb7e-a01b-48ac-a08f-a347cea8ae42 None admin] PATH_INFO: `/v3/domains` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:01.906990 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f6fb7e-a01b-48ac-a08f-a347cea8ae42 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:41:01.907461 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f6fb7e-a01b-48ac-a08f-a347cea8ae42 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:01.908711 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f6fb7e-a01b-48ac-a08f-a347cea8ae42 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:01.920454 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 425/850] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Oct 4 11:41:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:41:01.926175 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb37a526-9af4-4611-b9e1-ae770bdab9a1 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:01.980566 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f6fb7e-a01b-48ac-a08f-a347cea8ae42 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:02.001695 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:02.042737 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb37a526-9af4-4611-b9e1-ae770bdab9a1 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:02.075278 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:02.082366 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1319f07f-d94d-4465-b159-7a1e16c3d60d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:02.083181 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1319f07f-d94d-4465-b159-7a1e16c3d60d None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:02.083606 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1319f07f-d94d-4465-b159-7a1e16c3d60d None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:02.084017 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1319f07f-d94d-4465-b159-7a1e16c3d60d None admin] PATH_INFO: `/v3/projects/service` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:02.091252 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1319f07f-d94d-4465-b159-7a1e16c3d60d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:02.092881 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1319f07f-d94d-4465-b159-7a1e16c3d60d None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:02.096111 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f6fb7e-a01b-48ac-a08f-a347cea8ae42 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:02.105150 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-1319f07f-d94d-4465-b159-7a1e16c3d60d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 11:41:02.105150 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:41:02.105150 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:41:02.105150 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:41:02.105150 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:41:02.105150 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:41:02.105150 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:41:02.105150 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:41:02.105150 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:41:02.105150 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:41:02.105150 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:41:02.105150 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:41:02.105150 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 11:41:02.105150 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 11:41:02.105150 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 11:41:02.106301 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 11:41:02.106301 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:41:02.106301 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:41:02.106301 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:41:02.106301 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:41:02.106301 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:41:02.106301 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:41:02.106301 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:41:02.106301 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:41:02.106301 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:41:02.106301 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:41:02.106301 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:41:02.106301 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:41:02.106301 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:41:02.106301 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:41:02.106301 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:41:02.106301 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:41:02.107409 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 11:41:02.107409 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 11:41:02.107409 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 11:41:02.107409 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 11:41:02.107409 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 11:41:02.107409 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 11:41:02.107409 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 11:41:02.107409 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:41:02.109461 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 426/851] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Oct 4 11:41:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 11:41:02.118908 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1319f07f-d94d-4465-b159-7a1e16c3d60d None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:02.136038 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64328c0d-92aa-4479-b2cd-f1d6bdf05f13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:02.136910 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64328c0d-92aa-4479-b2cd-f1d6bdf05f13 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:02.137585 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64328c0d-92aa-4479-b2cd-f1d6bdf05f13 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:02.138000 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64328c0d-92aa-4479-b2cd-f1d6bdf05f13 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:02.139116 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64328c0d-92aa-4479-b2cd-f1d6bdf05f13 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:02.140659 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64328c0d-92aa-4479-b2cd-f1d6bdf05f13 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:02.151824 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-64328c0d-92aa-4479-b2cd-f1d6bdf05f13 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 04 11:41:02.151824 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:41:02.151824 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 11:41:02.151824 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 11:41:02.151824 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 11:41:02.151824 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 11:41:02.151824 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 11:41:02.151824 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 11:41:02.151824 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 04 11:41:02.151824 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:41:02.151824 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 11:41:02.151824 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:41:02.151824 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:41:02.151824 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:41:02.151824 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:41:02.151824 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:41:02.152963 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:41:02.152963 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:41:02.152963 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:41:02.152963 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:41:02.152963 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:41:02.152963 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:41:02.152963 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:41:02.152963 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 11:41:02.152963 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 11:41:02.152963 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 11:41:02.152963 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 11:41:02.152963 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:41:02.152963 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:41:02.152963 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:41:02.152963 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:41:02.152963 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:41:02.152963 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:41:02.154001 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:41:02.154001 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:41:02.154001 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:41:02.154001 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:41:02.154001 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:41:02.154001 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:41:02.154001 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:41:02.154001 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:41:02.154001 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:41:02.154001 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:41:02.154001 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 11:41:02.154001 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 11:41:02.154001 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 04 11:41:02.154001 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:41:02.157332 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 426/852] 10.222.0.59 () {56 vars in 1132 bytes} [Tue Oct 4 11:41:01 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 11:41:02.163268 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64328c0d-92aa-4479-b2cd-f1d6bdf05f13 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:02.229387 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1319f07f-d94d-4465-b159-7a1e16c3d60d None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:02.257456 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:02.267617 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1fbb33-d71c-4c97-8a91-6ca3b056ac00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:02.268514 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1fbb33-d71c-4c97-8a91-6ca3b056ac00 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:02.275398 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1fbb33-d71c-4c97-8a91-6ca3b056ac00 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:02.275398 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1fbb33-d71c-4c97-8a91-6ca3b056ac00 None admin] PATH_INFO: `/v3/projects` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:02.275398 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1fbb33-d71c-4c97-8a91-6ca3b056ac00 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:41:02.275398 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1fbb33-d71c-4c97-8a91-6ca3b056ac00 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:02.275398 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1fbb33-d71c-4c97-8a91-6ca3b056ac00 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:02.275803 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64328c0d-92aa-4479-b2cd-f1d6bdf05f13 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:02.285847 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 427/853] 10.222.0.59 () {56 vars in 1148 bytes} [Tue Oct 4 11:41:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:41:02.296659 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1fbb33-d71c-4c97-8a91-6ca3b056ac00 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:02.313068 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6769cacc-3cbb-42ed-9cd2-d2740e39ff53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:02.314421 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6769cacc-3cbb-42ed-9cd2-d2740e39ff53 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:02.314760 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6769cacc-3cbb-42ed-9cd2-d2740e39ff53 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:02.315089 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6769cacc-3cbb-42ed-9cd2-d2740e39ff53 None admin] PATH_INFO: `/v3/services` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:02.315810 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6769cacc-3cbb-42ed-9cd2-d2740e39ff53 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:41:02.316178 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6769cacc-3cbb-42ed-9cd2-d2740e39ff53 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:02.318231 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6769cacc-3cbb-42ed-9cd2-d2740e39ff53 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:02.323436 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 427/854] 10.222.0.59 () {56 vars in 1126 bytes} [Tue Oct 4 11:41:02 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:41:02.329667 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6769cacc-3cbb-42ed-9cd2-d2740e39ff53 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:02.343849 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:02.404925 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1fbb33-d71c-4c97-8a91-6ca3b056ac00 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:02.441929 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b9d326-3ecc-45b8-a724-d92d047140d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:02.442524 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b9d326-3ecc-45b8-a724-d92d047140d4 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:02.442798 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b9d326-3ecc-45b8-a724-d92d047140d4 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:02.443065 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b9d326-3ecc-45b8-a724-d92d047140d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:02.443781 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b9d326-3ecc-45b8-a724-d92d047140d4 None admin] RBAC: Adding query filter params (role.id=d6e7421d1ff9451c808004b818354550, scope.project.id=39913dbe3e984f27a61493dd75381501, user.id=1605c3e03b7a4bcba4e19f0d92c671bc) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:41:02.444091 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b9d326-3ecc-45b8-a724-d92d047140d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:02.445599 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b9d326-3ecc-45b8-a724-d92d047140d4 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:02.452394 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 428/855] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Oct 4 11:41:02 2022] GET /identity/v3/role_assignments?user.id=1605c3e03b7a4bcba4e19f0d92c671bc&scope.project.id=39913dbe3e984f27a61493dd75381501&role.id=d6e7421d1ff9451c808004b818354550 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:41:02.455851 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6769cacc-3cbb-42ed-9cd2-d2740e39ff53 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:02.496642 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afb43a3-4523-4760-8707-ab24ae0f2acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:02.497644 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afb43a3-4523-4760-8707-ab24ae0f2acf None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:02.498148 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afb43a3-4523-4760-8707-ab24ae0f2acf None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:02.498625 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afb43a3-4523-4760-8707-ab24ae0f2acf None admin] PATH_INFO: `/v3/services` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:02.499467 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afb43a3-4523-4760-8707-ab24ae0f2acf None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:41:02.499980 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afb43a3-4523-4760-8707-ab24ae0f2acf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:02.502171 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afb43a3-4523-4760-8707-ab24ae0f2acf None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:02.512830 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 428/856] 10.222.0.59 () {56 vars in 1126 bytes} [Tue Oct 4 11:41:02 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:41:02.873728 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff3a84f-1212-417e-a7ae-4e13f842070b None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:02.873921 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff3a84f-1212-417e-a7ae-4e13f842070b None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:02.874214 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff3a84f-1212-417e-a7ae-4e13f842070b None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:02.875957 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 429/857] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:41:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:41:02.881939 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b1c38b-2022-4548-8349-28ff5b2700aa None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:02.882397 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b1c38b-2022-4548-8349-28ff5b2700aa None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:02.882574 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b1c38b-2022-4548-8349-28ff5b2700aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:02.902216 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-a8b1c38b-2022-4548-8349-28ff5b2700aa None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:41:02.903390 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-a8b1c38b-2022-4548-8349-28ff5b2700aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:41:02.977195 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 429/858] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:41:02 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 11:41:03.260662 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff3a84f-1212-417e-a7ae-4e13f842070b None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:03.316921 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:03.375580 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff3a84f-1212-417e-a7ae-4e13f842070b None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:03.416203 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df03dd93-1c69-407c-a2b1-bb0555c79764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:03.417253 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df03dd93-1c69-407c-a2b1-bb0555c79764 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:03.417737 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df03dd93-1c69-407c-a2b1-bb0555c79764 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:03.418229 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df03dd93-1c69-407c-a2b1-bb0555c79764 None admin] PATH_INFO: `/v3/roles/service` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:03.430144 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df03dd93-1c69-407c-a2b1-bb0555c79764 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 11:41:03.436689 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-df03dd93-1c69-407c-a2b1-bb0555c79764 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 11:41:03.436689 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:41:03.436689 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:41:03.436689 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:41:03.436689 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:41:03.436689 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:41:03.436689 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:41:03.436689 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:41:03.436689 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:41:03.436689 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:41:03.436689 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:41:03.436689 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:41:03.436689 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 11:41:03.436689 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 11:41:03.436689 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 11:41:03.436689 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 11:41:03.437644 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 11:41:03.437644 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 11:41:03.437644 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 11:41:03.437644 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 11:41:03.437644 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:41:03.437644 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:41:03.437644 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:41:03.437644 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:41:03.437644 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:41:03.437644 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:41:03.437644 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:41:03.437644 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:41:03.437644 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:41:03.437644 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:41:03.437644 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:41:03.437644 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:41:03.438579 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:41:03.438579 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:41:03.438579 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:41:03.438579 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:41:03.438579 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 11:41:03.438579 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 11:41:03.438579 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 11:41:03.438579 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 11:41:03.438579 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 11:41:03.438579 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 11:41:03.438579 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 11:41:03.438579 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:41:03.441369 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 430/859] 10.222.0.59 () {56 vars in 1102 bytes} [Tue Oct 4 11:41:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:41:03.448754 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b1c38b-2022-4548-8349-28ff5b2700aa None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:03.451006 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:03.582466 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b1c38b-2022-4548-8349-28ff5b2700aa None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:03.617309 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cf7976-55a5-443b-9954-c117e62a217e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:03.617921 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cf7976-55a5-443b-9954-c117e62a217e None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:03.618556 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cf7976-55a5-443b-9954-c117e62a217e None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:03.618556 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cf7976-55a5-443b-9954-c117e62a217e None admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:03.619208 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cf7976-55a5-443b-9954-c117e62a217e None admin] RBAC: Adding query filter params (name=service) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:41:03.619514 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cf7976-55a5-443b-9954-c117e62a217e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:03.619991 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e55abf-747d-4d94-b14b-4f79b3e72444 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:03.620282 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e55abf-747d-4d94-b14b-4f79b3e72444 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:03.620562 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e55abf-747d-4d94-b14b-4f79b3e72444 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:03.620926 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cf7976-55a5-443b-9954-c117e62a217e None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:03.622184 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 431/860] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:41:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:41:03.627385 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4c48d7-3993-4242-856c-8226f496ba04 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:03.627669 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4c48d7-3993-4242-856c-8226f496ba04 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:03.627947 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4c48d7-3993-4242-856c-8226f496ba04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:03.630181 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 430/861] 10.222.0.59 () {56 vars in 1103 bytes} [Tue Oct 4 11:41:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:41:03.635703 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cf7976-55a5-443b-9954-c117e62a217e None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:03.649418 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-9c4c48d7-3993-4242-856c-8226f496ba04 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:41:03.650612 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-9c4c48d7-3993-4242-856c-8226f496ba04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:41:03.723342 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 432/862] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:41:03 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 11:41:03.732952 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:03.759936 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cf7976-55a5-443b-9954-c117e62a217e None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:03.796431 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78442654-7b63-4569-a271-63aa0f034e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:03.797455 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78442654-7b63-4569-a271-63aa0f034e0d None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:03.798661 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78442654-7b63-4569-a271-63aa0f034e0d None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:03.799287 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78442654-7b63-4569-a271-63aa0f034e0d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:03.810666 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78442654-7b63-4569-a271-63aa0f034e0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:03.812469 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78442654-7b63-4569-a271-63aa0f034e0d None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:03.827814 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-78442654-7b63-4569-a271-63aa0f034e0d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:41:03.827814 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:41:03.827814 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:41:03.827814 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:41:03.827814 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:41:03.827814 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:41:03.827814 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:41:03.827814 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:41:03.827814 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:41:03.827814 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:41:03.827814 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:41:03.827814 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:41:03.827814 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 11:41:03.827814 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 11:41:03.827814 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 11:41:03.827814 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 11:41:03.828810 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:41:03.828810 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:41:03.828810 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:41:03.828810 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:41:03.828810 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:41:03.828810 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:41:03.828810 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:41:03.828810 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:41:03.828810 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:41:03.828810 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:41:03.828810 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:41:03.828810 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:41:03.828810 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:41:03.828810 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:41:03.828810 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:41:03.828810 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:41:03.828810 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 11:41:03.830866 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 11:41:03.830866 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:41:03.830866 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:41:03.832919 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 431/863] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Oct 4 11:41:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:41:03.838817 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4c48d7-3993-4242-856c-8226f496ba04 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:03.885757 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:03.948699 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4c48d7-3993-4242-856c-8226f496ba04 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:03.986391 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e836556-b072-4bde-a98e-ea36358aff0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:03.987379 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e836556-b072-4bde-a98e-ea36358aff0d None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:03.987860 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e836556-b072-4bde-a98e-ea36358aff0d None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:03.988383 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e836556-b072-4bde-a98e-ea36358aff0d None admin] PATH_INFO: `/v3/domains` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:03.989252 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e836556-b072-4bde-a98e-ea36358aff0d None admin] RBAC: Adding query filter params (name=Default) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:41:03.989755 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e836556-b072-4bde-a98e-ea36358aff0d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:03.991307 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e836556-b072-4bde-a98e-ea36358aff0d None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:03.998573 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78442654-7b63-4569-a271-63aa0f034e0d None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:04.005528 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 433/864] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Oct 4 11:41:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:41:04.011081 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e836556-b072-4bde-a98e-ea36358aff0d None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:04.110840 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78442654-7b63-4569-a271-63aa0f034e0d None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:04.121940 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:04.126871 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e836556-b072-4bde-a98e-ea36358aff0d None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:04.130584 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:04.149642 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30c2046-7b2f-4042-99e2-663ddcfc1f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:04.150253 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30c2046-7b2f-4042-99e2-663ddcfc1f20 None admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:04.150537 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30c2046-7b2f-4042-99e2-663ddcfc1f20 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:04.152099 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30c2046-7b2f-4042-99e2-663ddcfc1f20 None admin] PATH_INFO: `/v3/services` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:04.152099 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30c2046-7b2f-4042-99e2-663ddcfc1f20 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:04.153637 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30c2046-7b2f-4042-99e2-663ddcfc1f20 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:04.166904 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e595e411-ed83-48ee-8aa8-87a231488321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:04.167533 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e595e411-ed83-48ee-8aa8-87a231488321 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:04.167812 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e595e411-ed83-48ee-8aa8-87a231488321 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:04.168141 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e595e411-ed83-48ee-8aa8-87a231488321 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:04.176439 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e595e411-ed83-48ee-8aa8-87a231488321 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:04.178470 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e595e411-ed83-48ee-8aa8-87a231488321 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:04.191408 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-e595e411-ed83-48ee-8aa8-87a231488321 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 04 11:41:04.191408 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:41:04.191408 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:41:04.191408 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:41:04.191408 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:41:04.191408 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:41:04.191408 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:41:04.191408 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:41:04.191408 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:41:04.191408 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:41:04.191408 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:41:04.191408 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:41:04.191408 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 11:41:04.191408 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 11:41:04.191408 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 11:41:04.191408 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 11:41:04.192385 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:41:04.192385 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:41:04.192385 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 11:41:04.192385 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 11:41:04.192385 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 11:41:04.192385 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 11:41:04.192385 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:41:04.192385 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:41:04.192385 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:41:04.192385 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:41:04.192385 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:41:04.192385 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:41:04.192385 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:41:04.192385 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:41:04.192385 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:41:04.192385 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:41:04.192385 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:41:04.192385 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:41:04.193426 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:41:04.193426 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:41:04.193426 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 11:41:04.193426 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 11:41:04.193426 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 11:41:04.193426 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 11:41:04.193426 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 11:41:04.193426 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 11:41:04.193426 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 04 11:41:04.193426 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:41:04.197069 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 434/865] 10.222.0.59 () {56 vars in 1117 bytes} [Tue Oct 4 11:41:04 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 11:41:04.198019 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e595e411-ed83-48ee-8aa8-87a231488321 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:04.231287 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 432/866] 10.222.0.59 () {60 vars in 1141 bytes} [Tue Oct 4 11:41:03 2022] POST /identity/v3/services => generated 251 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 11:41:04.324262 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e595e411-ed83-48ee-8aa8-87a231488321 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:04.372682 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b083f38b-dd64-4c6a-a6ee-763493989f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:04.373237 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b083f38b-dd64-4c6a-a6ee-763493989f6a None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:04.373517 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b083f38b-dd64-4c6a-a6ee-763493989f6a None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:04.373854 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b083f38b-dd64-4c6a-a6ee-763493989f6a None admin] PATH_INFO: `/v3/users` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:04.374604 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b083f38b-dd64-4c6a-a6ee-763493989f6a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:41:04.374910 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b083f38b-dd64-4c6a-a6ee-763493989f6a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:04.377204 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b083f38b-dd64-4c6a-a6ee-763493989f6a None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:04.399435 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 435/867] 10.222.0.59 () {56 vars in 1149 bytes} [Tue Oct 4 11:41:04 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:41:04.405217 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30c2046-7b2f-4042-99e2-663ddcfc1f20 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:04.532644 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30c2046-7b2f-4042-99e2-663ddcfc1f20 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:04.564912 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f482cf64-6bf2-47a2-9b66-dacaf664102e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:04.565624 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f482cf64-6bf2-47a2-9b66-dacaf664102e None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:04.565911 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f482cf64-6bf2-47a2-9b66-dacaf664102e None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:04.566186 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f482cf64-6bf2-47a2-9b66-dacaf664102e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:04.620824 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:04.650142 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f482cf64-6bf2-47a2-9b66-dacaf664102e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:04.650142 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f482cf64-6bf2-47a2-9b66-dacaf664102e None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:04.684898 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8885195-a779-4050-96c3-8808c20978f9 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:04.685215 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8885195-a779-4050-96c3-8808c20978f9 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:04.685464 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8885195-a779-4050-96c3-8808c20978f9 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:04.687045 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 436/868] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:41:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:41:04.692755 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c57594-0a28-421f-b470-2f1fd660dad9 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:04.693037 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c57594-0a28-421f-b470-2f1fd660dad9 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:04.693676 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c57594-0a28-421f-b470-2f1fd660dad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:04.717794 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-46c57594-0a28-421f-b470-2f1fd660dad9 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:41:04.720199 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-46c57594-0a28-421f-b470-2f1fd660dad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:41:04.733565 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:04.766172 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 433/869] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Oct 4 11:41:04 2022] GET /identity/v3/auth/tokens => generated 1262 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 11:41:04.771806 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f482cf64-6bf2-47a2-9b66-dacaf664102e None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:04.832563 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 437/870] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:41:04 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 11:41:04.871528 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:04.893212 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f482cf64-6bf2-47a2-9b66-dacaf664102e None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:04.934507 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda5fe1d-a3bd-44d2-97fd-aa5a84cdaa6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:04.935123 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda5fe1d-a3bd-44d2-97fd-aa5a84cdaa6c None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:04.935405 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda5fe1d-a3bd-44d2-97fd-aa5a84cdaa6c None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:04.935725 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda5fe1d-a3bd-44d2-97fd-aa5a84cdaa6c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:04.947184 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda5fe1d-a3bd-44d2-97fd-aa5a84cdaa6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:04.948709 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda5fe1d-a3bd-44d2-97fd-aa5a84cdaa6c None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:04.954232 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647d1df5-da2d-4693-9cd9-56666f2ec5b3 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:04.954513 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647d1df5-da2d-4693-9cd9-56666f2ec5b3 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:04.954781 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647d1df5-da2d-4693-9cd9-56666f2ec5b3 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:04.956278 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 438/871] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:41:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:41:04.964639 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afd33e2-5566-41ed-9649-07f7d75356cf None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:04.964639 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afd33e2-5566-41ed-9649-07f7d75356cf None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:04.964639 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afd33e2-5566-41ed-9649-07f7d75356cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:04.964926 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-bda5fe1d-a3bd-44d2-97fd-aa5a84cdaa6c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:41:04.964926 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:41:04.964926 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:41:04.964926 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:41:04.964926 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:41:04.964926 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:41:04.964926 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:41:04.964926 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:41:04.964926 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:41:04.964926 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:41:04.964926 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:41:04.964926 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:41:04.964926 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 11:41:04.964926 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 11:41:04.964926 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 11:41:04.964926 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 11:41:04.965804 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:41:04.965804 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:41:04.965804 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:41:04.965804 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:41:04.965804 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:41:04.965804 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:41:04.965804 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:41:04.965804 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:41:04.965804 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:41:04.965804 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:41:04.965804 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:41:04.965804 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:41:04.965804 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:41:04.965804 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:41:04.965804 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:41:04.965804 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:41:04.965804 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 11:41:04.967300 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 11:41:04.967300 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:41:04.967300 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:41:04.967300 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 434/872] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Oct 4 11:41:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 11:41:04.976623 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda5fe1d-a3bd-44d2-97fd-aa5a84cdaa6c None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:04.989601 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-4afd33e2-5566-41ed-9649-07f7d75356cf None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:41:04.990986 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-4afd33e2-5566-41ed-9649-07f7d75356cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:41:05.076349 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 439/873] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:41:04 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 11:41:05.098023 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda5fe1d-a3bd-44d2-97fd-aa5a84cdaa6c None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:05.130410 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:05.136683 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b01e6e-7bef-4158-bf64-6de14c7ca6d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:05.137346 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b01e6e-7bef-4158-bf64-6de14c7ca6d7 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:05.137626 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b01e6e-7bef-4158-bf64-6de14c7ca6d7 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:05.137903 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b01e6e-7bef-4158-bf64-6de14c7ca6d7 None admin] PATH_INFO: `/v3/domains` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:05.138589 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b01e6e-7bef-4158-bf64-6de14c7ca6d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:41:05.138893 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b01e6e-7bef-4158-bf64-6de14c7ca6d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:05.140362 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b01e6e-7bef-4158-bf64-6de14c7ca6d7 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:05.151270 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afd33e2-5566-41ed-9649-07f7d75356cf None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:05.154331 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 435/874] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Oct 4 11:41:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:41:05.160550 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b01e6e-7bef-4158-bf64-6de14c7ca6d7 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:05.259999 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:05.280233 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b01e6e-7bef-4158-bf64-6de14c7ca6d7 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:05.294995 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afd33e2-5566-41ed-9649-07f7d75356cf None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:05.320249 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f81b82-5ded-45c4-97e0-23bea0e67ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:05.320919 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f81b82-5ded-45c4-97e0-23bea0e67ae1 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:05.321198 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f81b82-5ded-45c4-97e0-23bea0e67ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:05.321467 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f81b82-5ded-45c4-97e0-23bea0e67ae1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:05.330364 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f81b82-5ded-45c4-97e0-23bea0e67ae1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:05.332313 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f81b82-5ded-45c4-97e0-23bea0e67ae1 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:05.342656 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5839b0e7-4663-4cdc-aab8-a2554c28c122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:05.343796 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5839b0e7-4663-4cdc-aab8-a2554c28c122 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:05.344219 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5839b0e7-4663-4cdc-aab8-a2554c28c122 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:05.344814 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5839b0e7-4663-4cdc-aab8-a2554c28c122 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:05.345537 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5839b0e7-4663-4cdc-aab8-a2554c28c122 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:05.346385 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-f3f81b82-5ded-45c4-97e0-23bea0e67ae1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 11:41:05.346385 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:41:05.346385 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:41:05.346385 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:41:05.346385 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:41:05.346385 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:41:05.346385 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:41:05.346385 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:41:05.346385 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:41:05.346385 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:41:05.346385 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:41:05.346385 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:41:05.346385 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 11:41:05.346385 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 11:41:05.346385 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 11:41:05.347362 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 11:41:05.347362 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:41:05.347362 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:41:05.347362 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:41:05.347362 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:41:05.347362 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:41:05.347362 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:41:05.347362 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:41:05.347362 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:41:05.347362 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:41:05.347362 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:41:05.347362 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:41:05.347362 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:41:05.347362 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:41:05.347362 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:41:05.347362 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:41:05.347362 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:41:05.348706 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 11:41:05.348706 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 11:41:05.348706 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 11:41:05.348706 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 11:41:05.348706 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 11:41:05.348706 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 11:41:05.348706 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 11:41:05.348706 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:41:05.348706 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 436/875] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Oct 4 11:41:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 11:41:05.349755 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5839b0e7-4663-4cdc-aab8-a2554c28c122 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:05.353487 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f81b82-5ded-45c4-97e0-23bea0e67ae1 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:05.359118 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-5839b0e7-4663-4cdc-aab8-a2554c28c122 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 11:41:05.359118 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:41:05.359118 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 11:41:05.359118 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 11:41:05.359118 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 11:41:05.359118 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 11:41:05.359118 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 11:41:05.359118 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 11:41:05.359118 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 11:41:05.359118 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:41:05.359118 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 11:41:05.359118 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:41:05.359118 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:41:05.359118 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:41:05.359118 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:41:05.359118 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:41:05.359118 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:41:05.361150 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:41:05.361150 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:41:05.361150 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:41:05.361150 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:41:05.361150 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:41:05.361150 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:41:05.361150 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 11:41:05.361150 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 11:41:05.361150 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 11:41:05.361150 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 11:41:05.361150 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:41:05.361150 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:41:05.361150 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:41:05.361150 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:41:05.361150 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:41:05.361150 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:41:05.362299 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:41:05.362299 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:41:05.362299 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:41:05.362299 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:41:05.362299 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:41:05.362299 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:41:05.362299 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:41:05.362299 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:41:05.362299 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:41:05.362299 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:41:05.362299 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 11:41:05.362299 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 11:41:05.362299 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 11:41:05.362299 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:41:05.362299 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 440/876] 10.222.0.59 () {56 vars in 1126 bytes} [Tue Oct 4 11:41:05 2022] GET /identity/v3/services/object-store => generated 93 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 11:41:05.371733 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5839b0e7-4663-4cdc-aab8-a2554c28c122 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:05.413746 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:05.491046 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f81b82-5ded-45c4-97e0-23bea0e67ae1 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:05.499536 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5839b0e7-4663-4cdc-aab8-a2554c28c122 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:05.533016 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9ad3d7-60ba-4602-879c-4ca085fc7750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:05.533539 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9ad3d7-60ba-4602-879c-4ca085fc7750 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:05.533863 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9ad3d7-60ba-4602-879c-4ca085fc7750 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:05.534247 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9ad3d7-60ba-4602-879c-4ca085fc7750 None admin] PATH_INFO: `/v3/projects` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:05.534824 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9ad3d7-60ba-4602-879c-4ca085fc7750 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:41:05.535122 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9ad3d7-60ba-4602-879c-4ca085fc7750 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:05.536535 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9ad3d7-60ba-4602-879c-4ca085fc7750 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:05.543994 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a8da21-d0d1-4f58-88ce-88ee432803f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:05.544812 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a8da21-d0d1-4f58-88ce-88ee432803f2 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:05.545094 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a8da21-d0d1-4f58-88ce-88ee432803f2 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:05.545370 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a8da21-d0d1-4f58-88ce-88ee432803f2 None admin] PATH_INFO: `/v3/services` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:05.546000 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a8da21-d0d1-4f58-88ce-88ee432803f2 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:41:05.546302 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a8da21-d0d1-4f58-88ce-88ee432803f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:05.547863 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a8da21-d0d1-4f58-88ce-88ee432803f2 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:05.549569 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 437/877] 10.222.0.59 () {56 vars in 1148 bytes} [Tue Oct 4 11:41:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:41:05.550522 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9ad3d7-60ba-4602-879c-4ca085fc7750 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:05.558399 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 441/878] 10.222.0.59 () {56 vars in 1122 bytes} [Tue Oct 4 11:41:05 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:41:05.559429 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a8da21-d0d1-4f58-88ce-88ee432803f2 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:05.566701 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:05.665197 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9ad3d7-60ba-4602-879c-4ca085fc7750 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:05.671482 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a8da21-d0d1-4f58-88ce-88ee432803f2 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:05.677714 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:05.703560 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59608d9a-91dd-4a32-8205-77b4f8b2541e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:05.704245 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59608d9a-91dd-4a32-8205-77b4f8b2541e None admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:05.704511 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59608d9a-91dd-4a32-8205-77b4f8b2541e None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:05.704817 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59608d9a-91dd-4a32-8205-77b4f8b2541e None admin] PATH_INFO: `/v3/services` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:05.705469 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59608d9a-91dd-4a32-8205-77b4f8b2541e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:05.706939 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59608d9a-91dd-4a32-8205-77b4f8b2541e None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:05.708714 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3c5f2a-0d7d-408b-9b5f-b3e2b418937b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:05.709538 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3c5f2a-0d7d-408b-9b5f-b3e2b418937b None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:05.709956 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3c5f2a-0d7d-408b-9b5f-b3e2b418937b None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:05.710383 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3c5f2a-0d7d-408b-9b5f-b3e2b418937b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:05.711858 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3c5f2a-0d7d-408b-9b5f-b3e2b418937b None admin] RBAC: Adding query filter params (role.id=01769bbdbd2e48f2bf8e855ba6a8507e, scope.project.id=39913dbe3e984f27a61493dd75381501, user.id=06d1850ea27c483780eed67ede9cc1e3) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:41:05.712177 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3c5f2a-0d7d-408b-9b5f-b3e2b418937b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:05.713718 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3c5f2a-0d7d-408b-9b5f-b3e2b418937b None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:05.720354 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 442/879] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Oct 4 11:41:05 2022] GET /identity/v3/role_assignments?user.id=06d1850ea27c483780eed67ede9cc1e3&scope.project.id=39913dbe3e984f27a61493dd75381501&role.id=01769bbdbd2e48f2bf8e855ba6a8507e => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:41:05.721330 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3c5f2a-0d7d-408b-9b5f-b3e2b418937b None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:05.782429 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 438/880] 10.222.0.59 () {60 vars in 1141 bytes} [Tue Oct 4 11:41:05 2022] POST /identity/v3/services => generated 269 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 11:41:05.824707 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:05.873966 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3c5f2a-0d7d-408b-9b5f-b3e2b418937b None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:05.923994 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4584b8-a9ed-4d6e-86f5-91a861f4eee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:05.925111 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4584b8-a9ed-4d6e-86f5-91a861f4eee1 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:05.925650 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4584b8-a9ed-4d6e-86f5-91a861f4eee1 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:05.926128 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4584b8-a9ed-4d6e-86f5-91a861f4eee1 None admin] PATH_INFO: `/v3/services` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:05.926983 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4584b8-a9ed-4d6e-86f5-91a861f4eee1 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:41:05.927497 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4584b8-a9ed-4d6e-86f5-91a861f4eee1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:05.929221 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4584b8-a9ed-4d6e-86f5-91a861f4eee1 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:05.934988 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 443/881] 10.222.0.59 () {56 vars in 1122 bytes} [Tue Oct 4 11:41:05 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:41:06.513942 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680038c8-0369-47b9-8126-a77c42e91c19 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:06.514455 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680038c8-0369-47b9-8126-a77c42e91c19 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:06.514532 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680038c8-0369-47b9-8126-a77c42e91c19 None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:06.515945 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 439/882] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:41:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:41:06.521561 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97911461-8629-437e-9cbf-2f2b99a4ee5f None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:06.522446 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97911461-8629-437e-9cbf-2f2b99a4ee5f None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:06.522917 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97911461-8629-437e-9cbf-2f2b99a4ee5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:06.542055 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-97911461-8629-437e-9cbf-2f2b99a4ee5f None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:41:06.543224 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-97911461-8629-437e-9cbf-2f2b99a4ee5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:41:06.611884 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 444/883] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:41:06 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 11:41:06.883588 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680038c8-0369-47b9-8126-a77c42e91c19 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:06.990738 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680038c8-0369-47b9-8126-a77c42e91c19 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:07.028628 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712cc260-bdcc-43a4-b113-33faf1998848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:07.029255 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712cc260-bdcc-43a4-b113-33faf1998848 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:07.029530 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712cc260-bdcc-43a4-b113-33faf1998848 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:07.029804 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712cc260-bdcc-43a4-b113-33faf1998848 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:07.030379 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712cc260-bdcc-43a4-b113-33faf1998848 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:07.031728 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712cc260-bdcc-43a4-b113-33faf1998848 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:07.041338 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-712cc260-bdcc-43a4-b113-33faf1998848 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 04 11:41:07.041338 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:41:07.041338 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 11:41:07.041338 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 11:41:07.041338 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 11:41:07.041338 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 11:41:07.041338 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 11:41:07.041338 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 11:41:07.041338 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 04 11:41:07.041338 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:41:07.041338 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 11:41:07.041338 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:41:07.041338 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:41:07.041338 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:41:07.041338 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:41:07.041338 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:41:07.041338 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:41:07.042328 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:41:07.042328 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:41:07.042328 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:41:07.042328 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:41:07.042328 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:41:07.042328 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:41:07.042328 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 11:41:07.042328 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 11:41:07.042328 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 11:41:07.042328 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 11:41:07.042328 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:41:07.042328 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:41:07.042328 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:41:07.042328 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:41:07.042328 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:41:07.042328 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:41:07.043188 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:41:07.043188 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:41:07.043188 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:41:07.043188 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:41:07.043188 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:41:07.043188 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:41:07.043188 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:41:07.043188 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:41:07.043188 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:41:07.043188 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:41:07.043188 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 11:41:07.043188 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 11:41:07.043188 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 04 11:41:07.043188 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:41:07.043188 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 440/884] 10.222.0.59 () {56 vars in 1114 bytes} [Tue Oct 4 11:41:06 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:41:07.048664 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97911461-8629-437e-9cbf-2f2b99a4ee5f None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:07.104504 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:07.153518 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97911461-8629-437e-9cbf-2f2b99a4ee5f None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:07.190652 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9debf20-ed9e-4a91-97c2-89da539ca433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:07.191261 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9debf20-ed9e-4a91-97c2-89da539ca433 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:07.191542 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9debf20-ed9e-4a91-97c2-89da539ca433 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:07.191819 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9debf20-ed9e-4a91-97c2-89da539ca433 None admin] PATH_INFO: `/v3/services` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:07.192442 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9debf20-ed9e-4a91-97c2-89da539ca433 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:41:07.192776 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9debf20-ed9e-4a91-97c2-89da539ca433 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:07.194141 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9debf20-ed9e-4a91-97c2-89da539ca433 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:07.199383 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 445/885] 10.222.0.59 () {56 vars in 1114 bytes} [Tue Oct 4 11:41:07 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:41:07.204911 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712cc260-bdcc-43a4-b113-33faf1998848 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:07.244104 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:07.325521 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712cc260-bdcc-43a4-b113-33faf1998848 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:07.359815 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf96e212-722a-49b9-82fc-e0199ed57d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:07.361194 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf96e212-722a-49b9-82fc-e0199ed57d70 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:07.361469 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf96e212-722a-49b9-82fc-e0199ed57d70 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:07.361739 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf96e212-722a-49b9-82fc-e0199ed57d70 None admin] PATH_INFO: `/v3/services` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:07.362355 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf96e212-722a-49b9-82fc-e0199ed57d70 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:41:07.362654 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf96e212-722a-49b9-82fc-e0199ed57d70 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:07.364010 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf96e212-722a-49b9-82fc-e0199ed57d70 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:07.369076 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 441/886] 10.222.0.59 () {56 vars in 1114 bytes} [Tue Oct 4 11:41:07 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:41:07.377995 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9debf20-ed9e-4a91-97c2-89da539ca433 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:07.480216 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9debf20-ed9e-4a91-97c2-89da539ca433 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:07.500692 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:07.518356 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fb4d93-44ad-4fe4-90bf-368b99017862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:07.518975 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fb4d93-44ad-4fe4-90bf-368b99017862 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:07.519260 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fb4d93-44ad-4fe4-90bf-368b99017862 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:07.519513 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fb4d93-44ad-4fe4-90bf-368b99017862 None admin] PATH_INFO: `/v3/endpoints` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:07.520209 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fb4d93-44ad-4fe4-90bf-368b99017862 None admin] RBAC: Adding query filter params (interface=public, service_id=7514d2bdb254470f8a7114e103b24330, region_id=RegionOne) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:41:07.520517 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fb4d93-44ad-4fe4-90bf-368b99017862 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:07.521912 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fb4d93-44ad-4fe4-90bf-368b99017862 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:07.530153 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 446/887] 10.222.0.59 () {56 vars in 1251 bytes} [Tue Oct 4 11:41:07 2022] GET /identity/v3/endpoints?service_id=7514d2bdb254470f8a7114e103b24330&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:41:07.536295 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf96e212-722a-49b9-82fc-e0199ed57d70 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:07.639441 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:07.643775 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf96e212-722a-49b9-82fc-e0199ed57d70 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:07.679301 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e0e4e1-04ef-47de-8917-05c87aed19d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:07.679913 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e0e4e1-04ef-47de-8917-05c87aed19d7 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:07.680188 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e0e4e1-04ef-47de-8917-05c87aed19d7 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:07.680454 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e0e4e1-04ef-47de-8917-05c87aed19d7 None admin] PATH_INFO: `/v3/services` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:07.681081 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e0e4e1-04ef-47de-8917-05c87aed19d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:07.682440 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e0e4e1-04ef-47de-8917-05c87aed19d7 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:07.689357 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 442/888] 10.222.0.59 () {56 vars in 1087 bytes} [Tue Oct 4 11:41:07 2022] GET /identity/v3/services => generated 1268 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 11:41:08.090140 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2b61dd-6853-403a-89c8-fb66226b795a None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:08.090794 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2b61dd-6853-403a-89c8-fb66226b795a None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:08.091305 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2b61dd-6853-403a-89c8-fb66226b795a None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:08.093108 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 447/889] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:41:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:41:08.099217 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3429649d-2f2e-4214-b69c-2a0346ea8d14 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:08.099777 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3429649d-2f2e-4214-b69c-2a0346ea8d14 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:08.100264 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3429649d-2f2e-4214-b69c-2a0346ea8d14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:08.121752 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-3429649d-2f2e-4214-b69c-2a0346ea8d14 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:41:08.123018 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-3429649d-2f2e-4214-b69c-2a0346ea8d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:41:08.171798 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08584740-6866-4a22-812c-a9197c6ea1c1 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:08.172108 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08584740-6866-4a22-812c-a9197c6ea1c1 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:08.172911 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08584740-6866-4a22-812c-a9197c6ea1c1 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:08.175615 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 448/890] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:41:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 11:41:08.179720 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab9c13d-45ab-47cf-8696-e22c4043ef81 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:08.180004 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab9c13d-45ab-47cf-8696-e22c4043ef81 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:08.180279 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab9c13d-45ab-47cf-8696-e22c4043ef81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:08.199151 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-aab9c13d-45ab-47cf-8696-e22c4043ef81 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:41:08.200492 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-aab9c13d-45ab-47cf-8696-e22c4043ef81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:41:08.200987 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 443/891] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:41:08 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 11:41:08.246024 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11b6339-af79-4735-93a5-facacf48916c None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:08.246354 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11b6339-af79-4735-93a5-facacf48916c None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:08.246573 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11b6339-af79-4735-93a5-facacf48916c None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:08.248154 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 444/892] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:41:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 11:41:08.253184 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e46728-78ae-41ac-a76a-0b71ffd1f875 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:08.253521 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e46728-78ae-41ac-a76a-0b71ffd1f875 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:08.253801 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e46728-78ae-41ac-a76a-0b71ffd1f875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:08.272357 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-53e46728-78ae-41ac-a76a-0b71ffd1f875 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:41:08.273624 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-53e46728-78ae-41ac-a76a-0b71ffd1f875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:41:08.280730 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 449/893] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:41:08 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 11:41:08.342021 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 445/894] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:41:08 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 11:41:08.477758 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab9c13d-45ab-47cf-8696-e22c4043ef81 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:08.570180 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e46728-78ae-41ac-a76a-0b71ffd1f875 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:08.588809 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab9c13d-45ab-47cf-8696-e22c4043ef81 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:08.609305 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:08.612988 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:08.630578 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630db83d-c84e-4186-908f-f999f07add29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:08.631271 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630db83d-c84e-4186-908f-f999f07add29 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:08.631552 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630db83d-c84e-4186-908f-f999f07add29 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:08.631847 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630db83d-c84e-4186-908f-f999f07add29 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:08.643652 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630db83d-c84e-4186-908f-f999f07add29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 11:41:08.649489 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-630db83d-c84e-4186-908f-f999f07add29 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 04 11:41:08.649489 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:41:08.649489 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:41:08.649489 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:41:08.649489 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:41:08.649489 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:41:08.649489 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:41:08.649489 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:41:08.649489 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:41:08.649489 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:41:08.649489 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:41:08.649489 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:41:08.649489 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 11:41:08.649489 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 11:41:08.649489 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 11:41:08.649489 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 11:41:08.654349 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 11:41:08.654349 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 11:41:08.654349 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 11:41:08.654349 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 11:41:08.654349 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:41:08.654349 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:41:08.654349 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:41:08.654349 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:41:08.654349 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:41:08.654349 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:41:08.654349 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:41:08.654349 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:41:08.654349 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:41:08.654349 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:41:08.654349 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:41:08.654349 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:41:08.655441 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:41:08.655441 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:41:08.655441 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:41:08.655441 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:41:08.655441 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 11:41:08.655441 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 11:41:08.655441 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 11:41:08.655441 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 11:41:08.655441 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 11:41:08.655441 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 11:41:08.655441 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 04 11:41:08.655441 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:41:08.655441 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 450/895] 10.222.0.59 () {56 vars in 1120 bytes} [Tue Oct 4 11:41:08 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:41:08.655441 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630db83d-c84e-4186-908f-f999f07add29 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:08.694834 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e46728-78ae-41ac-a76a-0b71ffd1f875 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:08.729498 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f64298d-c05a-4ed4-8c52-075e8a0a08e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:08.730123 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f64298d-c05a-4ed4-8c52-075e8a0a08e9 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:08.730395 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f64298d-c05a-4ed4-8c52-075e8a0a08e9 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:08.730660 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f64298d-c05a-4ed4-8c52-075e8a0a08e9 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:08.731233 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f64298d-c05a-4ed4-8c52-075e8a0a08e9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:08.732587 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f64298d-c05a-4ed4-8c52-075e8a0a08e9 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:08.741340 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-1f64298d-c05a-4ed4-8c52-075e8a0a08e9 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 04 11:41:08.741340 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:41:08.741340 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 11:41:08.741340 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 11:41:08.741340 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 11:41:08.741340 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 11:41:08.741340 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 11:41:08.741340 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 11:41:08.741340 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 04 11:41:08.741340 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:41:08.741340 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 11:41:08.741340 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:41:08.741340 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:41:08.741340 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:41:08.741340 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:41:08.741340 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:41:08.747586 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:41:08.747586 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:41:08.747586 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:41:08.747586 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:41:08.747586 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:41:08.747586 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:41:08.747586 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:41:08.747586 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 11:41:08.747586 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 11:41:08.747586 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 11:41:08.747586 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 11:41:08.747586 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:41:08.747586 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:41:08.747586 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:41:08.747586 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:41:08.747586 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:41:08.747586 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:41:08.748708 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:41:08.748708 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:41:08.748708 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:41:08.748708 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:41:08.748708 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:41:08.748708 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:41:08.748708 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:41:08.748708 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:41:08.748708 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:41:08.748708 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:41:08.748708 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 11:41:08.748708 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 11:41:08.748708 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 04 11:41:08.748708 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:41:08.748708 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 446/896] 10.222.0.59 () {56 vars in 1132 bytes} [Tue Oct 4 11:41:08 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 11:41:08.749547 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f64298d-c05a-4ed4-8c52-075e8a0a08e9 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:08.767191 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630db83d-c84e-4186-908f-f999f07add29 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:08.800759 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed494e7-e817-4872-81dc-2ec941d103af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:08.801414 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed494e7-e817-4872-81dc-2ec941d103af None admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:08.801688 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed494e7-e817-4872-81dc-2ec941d103af None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:08.801949 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed494e7-e817-4872-81dc-2ec941d103af None admin] PATH_INFO: `/v3/services` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:08.802629 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed494e7-e817-4872-81dc-2ec941d103af None admin] RBAC: Authorizing `identity:create_service()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:08.804046 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed494e7-e817-4872-81dc-2ec941d103af None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:08.838314 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:08.853780 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f64298d-c05a-4ed4-8c52-075e8a0a08e9 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:08.880232 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 451/897] 10.222.0.59 () {60 vars in 1141 bytes} [Tue Oct 4 11:41:08 2022] POST /identity/v3/services => generated 241 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 11:41:08.880232 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed494e7-e817-4872-81dc-2ec941d103af None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:08.899600 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cac027e-bb59-4e5d-a2cd-455356be0b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:08.900523 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cac027e-bb59-4e5d-a2cd-455356be0b0b None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:08.900870 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cac027e-bb59-4e5d-a2cd-455356be0b0b None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:08.901207 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cac027e-bb59-4e5d-a2cd-455356be0b0b None admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:08.902020 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cac027e-bb59-4e5d-a2cd-455356be0b0b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:41:08.902439 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cac027e-bb59-4e5d-a2cd-455356be0b0b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:08.903970 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cac027e-bb59-4e5d-a2cd-455356be0b0b None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:08.920332 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 447/898] 10.222.0.59 () {56 vars in 1115 bytes} [Tue Oct 4 11:41:08 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:41:08.926092 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cac027e-bb59-4e5d-a2cd-455356be0b0b None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:08.938954 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:09.013012 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed494e7-e817-4872-81dc-2ec941d103af None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:09.055733 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63577517-9e25-4dee-97fa-3dcd8ed76f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:09.056918 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63577517-9e25-4dee-97fa-3dcd8ed76f09 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:09.057437 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63577517-9e25-4dee-97fa-3dcd8ed76f09 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:09.058605 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63577517-9e25-4dee-97fa-3dcd8ed76f09 None admin] PATH_INFO: `/v3/services` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:09.059877 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63577517-9e25-4dee-97fa-3dcd8ed76f09 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:41:09.060365 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63577517-9e25-4dee-97fa-3dcd8ed76f09 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:09.061942 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63577517-9e25-4dee-97fa-3dcd8ed76f09 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:09.070640 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 452/899] 10.222.0.59 () {56 vars in 1126 bytes} [Tue Oct 4 11:41:08 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:41:09.076463 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63577517-9e25-4dee-97fa-3dcd8ed76f09 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:09.082196 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cac027e-bb59-4e5d-a2cd-455356be0b0b None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:09.124280 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3418c1-1451-467a-8a56-27d1f5b3ef9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:09.124995 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3418c1-1451-467a-8a56-27d1f5b3ef9b None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:09.125271 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3418c1-1451-467a-8a56-27d1f5b3ef9b None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:09.126440 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3418c1-1451-467a-8a56-27d1f5b3ef9b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:09.138314 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3418c1-1451-467a-8a56-27d1f5b3ef9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:09.140162 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3418c1-1451-467a-8a56-27d1f5b3ef9b None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:09.147708 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:09.165377 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-9e3418c1-1451-467a-8a56-27d1f5b3ef9b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:41:09.165377 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:41:09.165377 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:41:09.165377 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:41:09.165377 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:41:09.165377 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:41:09.165377 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:41:09.165377 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:41:09.165377 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:41:09.165377 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:41:09.165377 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:41:09.165377 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:41:09.165377 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 11:41:09.165377 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 11:41:09.165377 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 11:41:09.165377 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 11:41:09.166384 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:41:09.166384 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:41:09.166384 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:41:09.166384 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:41:09.166384 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:41:09.166384 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:41:09.166384 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:41:09.166384 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:41:09.166384 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:41:09.166384 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:41:09.166384 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:41:09.166384 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:41:09.166384 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:41:09.166384 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:41:09.166384 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:41:09.166384 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:41:09.166384 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 11:41:09.167376 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 11:41:09.167376 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:41:09.167376 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:41:09.167552 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 448/900] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Oct 4 11:41:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:41:09.173940 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3418c1-1451-467a-8a56-27d1f5b3ef9b None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:09.197951 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:09.201965 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63577517-9e25-4dee-97fa-3dcd8ed76f09 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:09.237797 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298766d7-db04-424d-8ee5-d4efd55e99e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:09.238405 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298766d7-db04-424d-8ee5-d4efd55e99e7 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:09.238682 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298766d7-db04-424d-8ee5-d4efd55e99e7 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:09.238954 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298766d7-db04-424d-8ee5-d4efd55e99e7 None admin] PATH_INFO: `/v3/services` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:09.239577 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298766d7-db04-424d-8ee5-d4efd55e99e7 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:41:09.239878 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298766d7-db04-424d-8ee5-d4efd55e99e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:09.241344 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298766d7-db04-424d-8ee5-d4efd55e99e7 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:09.252579 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 453/901] 10.222.0.59 () {56 vars in 1126 bytes} [Tue Oct 4 11:41:09 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 11:41:09.253637 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298766d7-db04-424d-8ee5-d4efd55e99e7 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:09.316292 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3418c1-1451-467a-8a56-27d1f5b3ef9b None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:09.354111 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd568032-4051-4c45-bfc0-c7a22ff7cfd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:09.354974 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd568032-4051-4c45-bfc0-c7a22ff7cfd6 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:09.355295 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd568032-4051-4c45-bfc0-c7a22ff7cfd6 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:09.355687 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd568032-4051-4c45-bfc0-c7a22ff7cfd6 None admin] PATH_INFO: `/v3/domains` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:09.356430 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd568032-4051-4c45-bfc0-c7a22ff7cfd6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:41:09.357103 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd568032-4051-4c45-bfc0-c7a22ff7cfd6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:09.358332 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd568032-4051-4c45-bfc0-c7a22ff7cfd6 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:09.377404 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 449/902] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Oct 4 11:41:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:41:09.378512 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd568032-4051-4c45-bfc0-c7a22ff7cfd6 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:09.390420 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298766d7-db04-424d-8ee5-d4efd55e99e7 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:09.438642 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8b990d-5434-4bc6-993a-6adac06dd788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:09.439503 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8b990d-5434-4bc6-993a-6adac06dd788 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:09.440120 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8b990d-5434-4bc6-993a-6adac06dd788 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:09.440543 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8b990d-5434-4bc6-993a-6adac06dd788 None admin] PATH_INFO: `/v3/endpoints` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:09.441182 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:09.442597 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8b990d-5434-4bc6-993a-6adac06dd788 None admin] RBAC: Adding query filter params (interface=public, service_id=51a9bb13d5964056ad8a56aec7e86ff9, region_id=RegionOne) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:41:09.443061 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8b990d-5434-4bc6-993a-6adac06dd788 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:09.445258 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8b990d-5434-4bc6-993a-6adac06dd788 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:09.457036 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 454/903] 10.222.0.59 () {56 vars in 1251 bytes} [Tue Oct 4 11:41:09 2022] GET /identity/v3/endpoints?service_id=51a9bb13d5964056ad8a56aec7e86ff9&interface=public®ion_id=RegionOne => generated 194 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:41:09.466717 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8b990d-5434-4bc6-993a-6adac06dd788 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:09.494438 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd568032-4051-4c45-bfc0-c7a22ff7cfd6 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:09.495930 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:09.544990 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b67efcb-4b80-4fdd-80dc-456b7493f12b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:09.546050 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b67efcb-4b80-4fdd-80dc-456b7493f12b None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:09.546433 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b67efcb-4b80-4fdd-80dc-456b7493f12b None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:09.546815 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b67efcb-4b80-4fdd-80dc-456b7493f12b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:09.556619 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b67efcb-4b80-4fdd-80dc-456b7493f12b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:09.558203 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b67efcb-4b80-4fdd-80dc-456b7493f12b None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:09.572892 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-8b67efcb-4b80-4fdd-80dc-456b7493f12b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 04 11:41:09.572892 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:41:09.572892 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:41:09.572892 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:41:09.572892 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:41:09.572892 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:41:09.572892 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:41:09.572892 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:41:09.572892 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:41:09.572892 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:41:09.572892 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:41:09.572892 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:41:09.572892 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 11:41:09.572892 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 11:41:09.572892 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 11:41:09.572892 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 11:41:09.574411 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:41:09.574411 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:41:09.574411 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 11:41:09.574411 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 11:41:09.574411 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 11:41:09.574411 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 11:41:09.574411 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:41:09.574411 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:41:09.574411 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:41:09.574411 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:41:09.574411 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:41:09.574411 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:41:09.574411 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:41:09.574411 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:41:09.574411 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:41:09.574411 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:41:09.574411 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:41:09.574411 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:41:09.575410 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:41:09.575410 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:41:09.575410 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 11:41:09.575410 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 11:41:09.575410 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 11:41:09.575410 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 11:41:09.575410 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 11:41:09.575410 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 11:41:09.575410 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 04 11:41:09.575410 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:41:09.580110 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 450/904] 10.222.0.59 () {56 vars in 1117 bytes} [Tue Oct 4 11:41:09 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:41:09.581613 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b67efcb-4b80-4fdd-80dc-456b7493f12b None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:09.593060 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8b990d-5434-4bc6-993a-6adac06dd788 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:09.636902 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c931fd24-045e-40b2-bb2b-71db06992ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:09.637889 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c931fd24-045e-40b2-bb2b-71db06992ee2 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:09.638373 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c931fd24-045e-40b2-bb2b-71db06992ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:09.638896 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c931fd24-045e-40b2-bb2b-71db06992ee2 None admin] PATH_INFO: `/v3/services` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:09.639755 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c931fd24-045e-40b2-bb2b-71db06992ee2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:09.642141 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c931fd24-045e-40b2-bb2b-71db06992ee2 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:09.657127 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 455/905] 10.222.0.59 () {56 vars in 1087 bytes} [Tue Oct 4 11:41:09 2022] GET /identity/v3/services => generated 1497 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 11:41:09.712003 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b67efcb-4b80-4fdd-80dc-456b7493f12b None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:09.731681 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:09.753717 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c213e37c-00ae-4c30-88fd-1a1b8424db40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:09.754312 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c213e37c-00ae-4c30-88fd-1a1b8424db40 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:09.754594 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c213e37c-00ae-4c30-88fd-1a1b8424db40 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:09.754869 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c213e37c-00ae-4c30-88fd-1a1b8424db40 None admin] PATH_INFO: `/v3/users` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:09.755615 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c213e37c-00ae-4c30-88fd-1a1b8424db40 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:41:09.755922 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c213e37c-00ae-4c30-88fd-1a1b8424db40 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:09.757427 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c213e37c-00ae-4c30-88fd-1a1b8424db40 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:09.784774 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 451/906] 10.222.0.59 () {56 vars in 1149 bytes} [Tue Oct 4 11:41:09 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 11:41:09.786982 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c931fd24-045e-40b2-bb2b-71db06992ee2 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:09.894481 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:09.899528 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebde423-7adc-4ceb-ba50-45935be02941 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:09.899904 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebde423-7adc-4ceb-ba50-45935be02941 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:09.906187 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebde423-7adc-4ceb-ba50-45935be02941 None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:09.906187 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 452/907] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:41:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 11:41:09.906392 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c931fd24-045e-40b2-bb2b-71db06992ee2 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:09.908407 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a16548-2f0c-4859-a5ee-c209f8d6d3e2 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:09.908725 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a16548-2f0c-4859-a5ee-c209f8d6d3e2 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:09.909009 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a16548-2f0c-4859-a5ee-c209f8d6d3e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:09.929969 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-b3a16548-2f0c-4859-a5ee-c209f8d6d3e2 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:41:09.931322 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-b3a16548-2f0c-4859-a5ee-c209f8d6d3e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:41:09.943087 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1234a966-17ea-4e12-ac13-ea108851b68d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:09.944045 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1234a966-17ea-4e12-ac13-ea108851b68d None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:09.944498 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1234a966-17ea-4e12-ac13-ea108851b68d None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:09.945075 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1234a966-17ea-4e12-ac13-ea108851b68d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:10.018549 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 453/908] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:41:09 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 11:41:10.039746 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1234a966-17ea-4e12-ac13-ea108851b68d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:10.041293 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1234a966-17ea-4e12-ac13-ea108851b68d None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:10.137147 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:10.150360 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 456/909] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Oct 4 11:41:09 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 11:41:10.153713 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a16548-2f0c-4859-a5ee-c209f8d6d3e2 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:10.262813 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a16548-2f0c-4859-a5ee-c209f8d6d3e2 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:10.265147 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:10.299307 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea86bfd-c190-456e-a1b5-94523c7d57e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:10.299987 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea86bfd-c190-456e-a1b5-94523c7d57e7 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:10.300264 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea86bfd-c190-456e-a1b5-94523c7d57e7 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:10.300534 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea86bfd-c190-456e-a1b5-94523c7d57e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:10.310085 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1234a966-17ea-4e12-ac13-ea108851b68d None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:10.311035 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea86bfd-c190-456e-a1b5-94523c7d57e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:10.312478 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea86bfd-c190-456e-a1b5-94523c7d57e7 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:10.327222 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-8ea86bfd-c190-456e-a1b5-94523c7d57e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:41:10.327222 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:41:10.327222 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:41:10.327222 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:41:10.327222 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:41:10.327222 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:41:10.327222 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:41:10.327222 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:41:10.327222 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:41:10.327222 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:41:10.327222 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:41:10.327222 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:41:10.327222 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 11:41:10.327222 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 11:41:10.327222 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 11:41:10.327222 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 11:41:10.328158 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:41:10.328158 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:41:10.328158 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:41:10.328158 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:41:10.328158 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:41:10.328158 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:41:10.328158 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:41:10.328158 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:41:10.328158 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:41:10.328158 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:41:10.328158 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:41:10.328158 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:41:10.328158 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:41:10.328158 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:41:10.328158 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:41:10.328158 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:41:10.328158 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 11:41:10.329634 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 11:41:10.329634 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:41:10.329634 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:41:10.329634 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 454/910] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Oct 4 11:41:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:41:10.335242 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea86bfd-c190-456e-a1b5-94523c7d57e7 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:10.436325 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1234a966-17ea-4e12-ac13-ea108851b68d None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:10.451248 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea86bfd-c190-456e-a1b5-94523c7d57e7 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:10.480587 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a290bd-1d52-470c-82a9-33fd115fc028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:10.481637 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a290bd-1d52-470c-82a9-33fd115fc028 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:10.481981 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a290bd-1d52-470c-82a9-33fd115fc028 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:10.482519 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a290bd-1d52-470c-82a9-33fd115fc028 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:10.483100 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a290bd-1d52-470c-82a9-33fd115fc028 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:10.485578 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a290bd-1d52-470c-82a9-33fd115fc028 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:10.490045 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7693ed68-9a97-42ea-a01b-2ab9a53b0f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:10.490664 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7693ed68-9a97-42ea-a01b-2ab9a53b0f9e None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:10.490939 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7693ed68-9a97-42ea-a01b-2ab9a53b0f9e None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:10.491213 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7693ed68-9a97-42ea-a01b-2ab9a53b0f9e None admin] PATH_INFO: `/v3/domains` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:10.491848 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7693ed68-9a97-42ea-a01b-2ab9a53b0f9e None admin] RBAC: Adding query filter params (name=Default) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:41:10.492146 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7693ed68-9a97-42ea-a01b-2ab9a53b0f9e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:10.493519 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7693ed68-9a97-42ea-a01b-2ab9a53b0f9e None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:10.494684 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-18a290bd-1d52-470c-82a9-33fd115fc028 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 04 11:41:10.494684 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:41:10.494684 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 11:41:10.494684 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 11:41:10.494684 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 11:41:10.494684 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 11:41:10.494684 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 11:41:10.494684 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 11:41:10.494684 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 04 11:41:10.494684 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:41:10.494684 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 11:41:10.494684 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:41:10.494684 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:41:10.494684 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:41:10.494684 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:41:10.494684 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:41:10.494684 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:41:10.496735 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:41:10.496735 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:41:10.496735 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:41:10.496735 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:41:10.496735 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:41:10.496735 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:41:10.496735 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 11:41:10.496735 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 11:41:10.496735 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 11:41:10.496735 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 11:41:10.496735 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:41:10.496735 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:41:10.496735 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:41:10.496735 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:41:10.496735 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:41:10.496735 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:41:10.497945 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:41:10.497945 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:41:10.497945 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:41:10.497945 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:41:10.497945 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:41:10.497945 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:41:10.497945 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:41:10.497945 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:41:10.497945 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:41:10.497945 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:41:10.497945 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 11:41:10.497945 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 11:41:10.497945 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 04 11:41:10.497945 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:41:10.497945 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 457/911] 10.222.0.59 () {56 vars in 1114 bytes} [Tue Oct 4 11:41:10 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:41:10.504571 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a290bd-1d52-470c-82a9-33fd115fc028 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:10.511416 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 455/912] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Oct 4 11:41:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:41:10.518781 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7693ed68-9a97-42ea-a01b-2ab9a53b0f9e None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:10.541424 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:10.574722 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:10.629316 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a290bd-1d52-470c-82a9-33fd115fc028 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:10.661199 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7693ed68-9a97-42ea-a01b-2ab9a53b0f9e None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:10.669757 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c65c8d0-f285-428e-ab0e-e2cd060932af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:10.670740 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c65c8d0-f285-428e-ab0e-e2cd060932af None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:10.671224 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c65c8d0-f285-428e-ab0e-e2cd060932af None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:10.671722 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c65c8d0-f285-428e-ab0e-e2cd060932af None admin] PATH_INFO: `/v3/services` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:10.673301 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c65c8d0-f285-428e-ab0e-e2cd060932af None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:41:10.673848 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c65c8d0-f285-428e-ab0e-e2cd060932af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:10.675547 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c65c8d0-f285-428e-ab0e-e2cd060932af None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:10.686022 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 458/913] 10.222.0.59 () {56 vars in 1114 bytes} [Tue Oct 4 11:41:10 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:41:10.687295 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c65c8d0-f285-428e-ab0e-e2cd060932af None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:10.700735 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e3cd50-3386-47ac-bd0b-1cd323492347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:10.701401 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e3cd50-3386-47ac-bd0b-1cd323492347 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:10.701689 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e3cd50-3386-47ac-bd0b-1cd323492347 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:10.701946 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e3cd50-3386-47ac-bd0b-1cd323492347 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:10.711582 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e3cd50-3386-47ac-bd0b-1cd323492347 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:10.713043 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e3cd50-3386-47ac-bd0b-1cd323492347 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:10.730031 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-a9e3cd50-3386-47ac-bd0b-1cd323492347 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 11:41:10.730031 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:41:10.730031 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:41:10.730031 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:41:10.730031 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:41:10.730031 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:41:10.730031 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:41:10.730031 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:41:10.730031 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:41:10.730031 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:41:10.730031 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:41:10.730031 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:41:10.730031 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 11:41:10.730031 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 11:41:10.730031 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 11:41:10.730950 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 11:41:10.730950 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:41:10.730950 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:41:10.730950 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:41:10.730950 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:41:10.730950 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:41:10.730950 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:41:10.730950 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:41:10.730950 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:41:10.730950 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:41:10.730950 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:41:10.730950 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:41:10.730950 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:41:10.730950 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:41:10.730950 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:41:10.730950 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:41:10.730950 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:41:10.731879 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 11:41:10.731879 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 11:41:10.731879 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 11:41:10.731879 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 11:41:10.731879 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 11:41:10.731879 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 11:41:10.731879 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 11:41:10.731879 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:41:10.736549 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 456/914] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Oct 4 11:41:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 11:41:10.737447 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e3cd50-3386-47ac-bd0b-1cd323492347 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:10.807141 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c65c8d0-f285-428e-ab0e-e2cd060932af None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:10.827408 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:10.843015 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:10.847774 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0400b57-6437-46e8-9446-55fea1e79201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:10.848717 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0400b57-6437-46e8-9446-55fea1e79201 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:10.849529 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0400b57-6437-46e8-9446-55fea1e79201 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:10.850014 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0400b57-6437-46e8-9446-55fea1e79201 None admin] PATH_INFO: `/v3/services` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:10.850918 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0400b57-6437-46e8-9446-55fea1e79201 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:41:10.851432 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0400b57-6437-46e8-9446-55fea1e79201 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:10.853046 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0400b57-6437-46e8-9446-55fea1e79201 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:10.863260 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 459/915] 10.222.0.59 () {56 vars in 1114 bytes} [Tue Oct 4 11:41:10 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:41:10.864441 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0400b57-6437-46e8-9446-55fea1e79201 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:10.868116 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e3cd50-3386-47ac-bd0b-1cd323492347 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:10.910533 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ea0561-841d-4834-ba11-6d443054234c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:10.911173 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ea0561-841d-4834-ba11-6d443054234c None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:10.911448 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ea0561-841d-4834-ba11-6d443054234c None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:10.911772 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ea0561-841d-4834-ba11-6d443054234c None admin] PATH_INFO: `/v3/projects` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:10.912667 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ea0561-841d-4834-ba11-6d443054234c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:41:10.912972 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ea0561-841d-4834-ba11-6d443054234c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:10.914916 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ea0561-841d-4834-ba11-6d443054234c None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:10.935650 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 457/916] 10.222.0.59 () {56 vars in 1148 bytes} [Tue Oct 4 11:41:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:41:10.937616 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ea0561-841d-4834-ba11-6d443054234c None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:10.985195 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0400b57-6437-46e8-9446-55fea1e79201 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:11.033597 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d0187c-8dc9-4c88-b4f9-0bdd7d8819e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:11.034931 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d0187c-8dc9-4c88-b4f9-0bdd7d8819e5 None admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:11.035695 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d0187c-8dc9-4c88-b4f9-0bdd7d8819e5 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:11.036175 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d0187c-8dc9-4c88-b4f9-0bdd7d8819e5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:11.037778 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d0187c-8dc9-4c88-b4f9-0bdd7d8819e5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:11.040015 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d0187c-8dc9-4c88-b4f9-0bdd7d8819e5 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:11.045437 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ea0561-841d-4834-ba11-6d443054234c None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:11.086116 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981f415e-c71d-41eb-84bd-3ac6411318ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:11.086907 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981f415e-c71d-41eb-84bd-3ac6411318ab None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:11.087182 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981f415e-c71d-41eb-84bd-3ac6411318ab None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:11.087447 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981f415e-c71d-41eb-84bd-3ac6411318ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:11.088334 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981f415e-c71d-41eb-84bd-3ac6411318ab None admin] RBAC: Adding query filter params (role.id=c4a56aec8c5b46e995400c7a9e32f979, scope.project.id=39913dbe3e984f27a61493dd75381501, user.id=06d1850ea27c483780eed67ede9cc1e3) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:41:11.088663 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981f415e-c71d-41eb-84bd-3ac6411318ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:11.090138 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981f415e-c71d-41eb-84bd-3ac6411318ab None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:11.094050 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:11.104635 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 458/917] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Oct 4 11:41:10 2022] GET /identity/v3/role_assignments?user.id=06d1850ea27c483780eed67ede9cc1e3&scope.project.id=39913dbe3e984f27a61493dd75381501&role.id=c4a56aec8c5b46e995400c7a9e32f979 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:41:11.116569 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 460/918] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Oct 4 11:41:10 2022] POST /identity/v3/endpoints => generated 346 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 11:41:11.195756 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485f5fe1-e984-4894-90bf-5f0095abbffc None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:11.195935 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485f5fe1-e984-4894-90bf-5f0095abbffc None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:11.196282 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485f5fe1-e984-4894-90bf-5f0095abbffc None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:11.198150 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 459/919] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:41:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:41:11.204925 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f7ec51-f12f-4e76-a8ff-2b370174fe73 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:11.205527 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f7ec51-f12f-4e76-a8ff-2b370174fe73 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:11.205984 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f7ec51-f12f-4e76-a8ff-2b370174fe73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:11.226662 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-02f7ec51-f12f-4e76-a8ff-2b370174fe73 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:41:11.228285 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-02f7ec51-f12f-4e76-a8ff-2b370174fe73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:41:11.266878 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:11.323212 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 461/920] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:41:11 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 11:41:11.596966 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485f5fe1-e984-4894-90bf-5f0095abbffc None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:11.704116 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485f5fe1-e984-4894-90bf-5f0095abbffc None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:11.741262 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5ec2b7-9ba4-4e86-a5c6-53942dbd4353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:11.742262 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5ec2b7-9ba4-4e86-a5c6-53942dbd4353 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:11.742745 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5ec2b7-9ba4-4e86-a5c6-53942dbd4353 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:11.743238 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5ec2b7-9ba4-4e86-a5c6-53942dbd4353 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:11.744039 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5ec2b7-9ba4-4e86-a5c6-53942dbd4353 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:11.745635 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5ec2b7-9ba4-4e86-a5c6-53942dbd4353 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:11.755648 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-ec5ec2b7-9ba4-4e86-a5c6-53942dbd4353 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 11:41:11.755648 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:41:11.755648 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 11:41:11.755648 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 11:41:11.755648 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 11:41:11.755648 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 11:41:11.755648 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 11:41:11.755648 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 11:41:11.755648 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 11:41:11.755648 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:41:11.755648 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 11:41:11.755648 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:41:11.755648 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:41:11.755648 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:41:11.755648 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:41:11.755648 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:41:11.755648 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:41:11.756691 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:41:11.756691 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:41:11.756691 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:41:11.756691 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:41:11.756691 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:41:11.756691 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:41:11.756691 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 11:41:11.756691 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 11:41:11.756691 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 11:41:11.756691 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 11:41:11.756691 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:41:11.756691 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:41:11.756691 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:41:11.756691 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:41:11.756691 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:41:11.756691 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:41:11.757698 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:41:11.757698 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:41:11.757698 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:41:11.757698 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:41:11.757698 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:41:11.757698 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:41:11.757698 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:41:11.757698 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:41:11.757698 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:41:11.757698 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:41:11.757698 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 11:41:11.757698 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 11:41:11.757698 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 11:41:11.757698 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:41:11.760134 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 460/921] 10.222.0.59 () {56 vars in 1126 bytes} [Tue Oct 4 11:41:11 2022] GET /identity/v3/services/object-store => generated 93 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:41:11.766017 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f7ec51-f12f-4e76-a8ff-2b370174fe73 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:11.874808 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f7ec51-f12f-4e76-a8ff-2b370174fe73 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:11.910719 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d01677b-368f-4266-a3fc-630e8feaee4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:11.921982 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d01677b-368f-4266-a3fc-630e8feaee4d None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:11.921982 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d01677b-368f-4266-a3fc-630e8feaee4d None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:11.921982 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d01677b-368f-4266-a3fc-630e8feaee4d None admin] PATH_INFO: `/v3/services` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:11.921982 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d01677b-368f-4266-a3fc-630e8feaee4d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:41:11.921982 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d01677b-368f-4266-a3fc-630e8feaee4d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:11.921982 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d01677b-368f-4266-a3fc-630e8feaee4d None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:11.923078 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 462/922] 10.222.0.59 () {56 vars in 1122 bytes} [Tue Oct 4 11:41:11 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:41:11.927174 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5ec2b7-9ba4-4e86-a5c6-53942dbd4353 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:11.936085 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0581b7c0-653b-46c7-8d1e-bc073e4b9d48 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:11.936383 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0581b7c0-653b-46c7-8d1e-bc073e4b9d48 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:11.936646 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0581b7c0-653b-46c7-8d1e-bc073e4b9d48 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:11.938333 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 463/923] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:41:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 11:41:11.944680 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d606c8-da99-40b6-a7ae-2209246d3410 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:11.945078 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d606c8-da99-40b6-a7ae-2209246d3410 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:11.945351 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d606c8-da99-40b6-a7ae-2209246d3410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:11.969524 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-61d606c8-da99-40b6-a7ae-2209246d3410 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:41:11.972307 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-61d606c8-da99-40b6-a7ae-2209246d3410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:41:11.997459 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:12.007521 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:12.045874 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5ec2b7-9ba4-4e86-a5c6-53942dbd4353 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:12.056661 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 464/924] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:41:11 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 11:41:12.091989 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42edd6d-40c1-4f25-91d3-b93e59d9cc83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:12.093076 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42edd6d-40c1-4f25-91d3-b93e59d9cc83 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:12.093563 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42edd6d-40c1-4f25-91d3-b93e59d9cc83 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:12.094098 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42edd6d-40c1-4f25-91d3-b93e59d9cc83 None admin] PATH_INFO: `/v3/services` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:12.095431 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42edd6d-40c1-4f25-91d3-b93e59d9cc83 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:41:12.095951 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42edd6d-40c1-4f25-91d3-b93e59d9cc83 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:12.097622 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42edd6d-40c1-4f25-91d3-b93e59d9cc83 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:12.103323 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 461/925] 10.222.0.59 () {56 vars in 1122 bytes} [Tue Oct 4 11:41:11 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:41:12.109444 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d606c8-da99-40b6-a7ae-2209246d3410 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:12.221792 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d606c8-da99-40b6-a7ae-2209246d3410 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:12.260311 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e51c65e-7ac3-4d7d-a3d6-b1e3888d0d4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:12.261173 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e51c65e-7ac3-4d7d-a3d6-b1e3888d0d4c None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:12.261600 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e51c65e-7ac3-4d7d-a3d6-b1e3888d0d4c None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:12.262009 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e51c65e-7ac3-4d7d-a3d6-b1e3888d0d4c None admin] PATH_INFO: `/v3/endpoints` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:12.262850 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e51c65e-7ac3-4d7d-a3d6-b1e3888d0d4c None admin] RBAC: Adding query filter params (interface=public, service_id=fc94ff3a1a034673a17de3493a324256, region_id=RegionOne) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:41:12.263301 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e51c65e-7ac3-4d7d-a3d6-b1e3888d0d4c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:12.264840 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e51c65e-7ac3-4d7d-a3d6-b1e3888d0d4c None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:12.270574 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 465/926] 10.222.0.59 () {56 vars in 1251 bytes} [Tue Oct 4 11:41:12 2022] GET /identity/v3/endpoints?service_id=fc94ff3a1a034673a17de3493a324256&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:41:12.280632 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42edd6d-40c1-4f25-91d3-b93e59d9cc83 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:12.331831 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e51c65e-7ac3-4d7d-a3d6-b1e3888d0d4c None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:12.360065 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:12.388611 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42edd6d-40c1-4f25-91d3-b93e59d9cc83 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:12.423583 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:12.430455 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e91b11-6bc5-46de-9d46-b1d431cbaba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:12.431068 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e91b11-6bc5-46de-9d46-b1d431cbaba6 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:12.431405 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e91b11-6bc5-46de-9d46-b1d431cbaba6 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:12.431674 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e91b11-6bc5-46de-9d46-b1d431cbaba6 None admin] PATH_INFO: `/v3/services` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:12.432275 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e91b11-6bc5-46de-9d46-b1d431cbaba6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:12.433670 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e91b11-6bc5-46de-9d46-b1d431cbaba6 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:12.448629 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 462/927] 10.222.0.59 () {56 vars in 1087 bytes} [Tue Oct 4 11:41:12 2022] GET /identity/v3/services => generated 1497 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 11:41:12.464367 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e51c65e-7ac3-4d7d-a3d6-b1e3888d0d4c None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:12.510789 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fad096-f848-4ee5-a1f8-30b4e8a56d40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:12.511350 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fad096-f848-4ee5-a1f8-30b4e8a56d40 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:12.511622 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fad096-f848-4ee5-a1f8-30b4e8a56d40 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:12.511886 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fad096-f848-4ee5-a1f8-30b4e8a56d40 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:12.512471 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fad096-f848-4ee5-a1f8-30b4e8a56d40 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:12.514111 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fad096-f848-4ee5-a1f8-30b4e8a56d40 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:12.524349 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-24fad096-f848-4ee5-a1f8-30b4e8a56d40 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 04 11:41:12.524349 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:41:12.524349 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 11:41:12.524349 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 11:41:12.524349 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 11:41:12.524349 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 11:41:12.524349 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 11:41:12.524349 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 11:41:12.524349 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 04 11:41:12.524349 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:41:12.524349 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 11:41:12.524349 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:41:12.524349 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:41:12.524349 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:41:12.524349 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:41:12.524349 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:41:12.525414 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:41:12.525414 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:41:12.525414 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:41:12.525414 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:41:12.525414 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:41:12.525414 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:41:12.525414 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:41:12.525414 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 11:41:12.525414 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 11:41:12.525414 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 11:41:12.525414 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 11:41:12.525414 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:41:12.525414 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:41:12.525414 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:41:12.525414 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:41:12.525414 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:41:12.525414 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:41:12.526345 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:41:12.526345 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:41:12.526345 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:41:12.526345 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:41:12.526345 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:41:12.526345 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:41:12.526345 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:41:12.526345 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:41:12.526345 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:41:12.526345 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:41:12.526345 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 11:41:12.526345 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 11:41:12.526345 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 04 11:41:12.526345 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:41:12.526345 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 466/928] 10.222.0.59 () {56 vars in 1132 bytes} [Tue Oct 4 11:41:12 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 11:41:12.535827 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e91b11-6bc5-46de-9d46-b1d431cbaba6 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:12.656763 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e91b11-6bc5-46de-9d46-b1d431cbaba6 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:12.694386 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea760f3-5787-477c-8456-787205aac223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:12.694994 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea760f3-5787-477c-8456-787205aac223 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:12.695271 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea760f3-5787-477c-8456-787205aac223 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:12.695539 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea760f3-5787-477c-8456-787205aac223 None admin] PATH_INFO: `/v3/services` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:12.696160 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea760f3-5787-477c-8456-787205aac223 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:41:12.696456 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea760f3-5787-477c-8456-787205aac223 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:12.697838 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea760f3-5787-477c-8456-787205aac223 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:12.702922 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 463/929] 10.222.0.59 () {56 vars in 1126 bytes} [Tue Oct 4 11:41:12 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:41:12.713714 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fad096-f848-4ee5-a1f8-30b4e8a56d40 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:12.811603 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:12.827407 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fad096-f848-4ee5-a1f8-30b4e8a56d40 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:12.864520 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f5b338-5309-423a-a0e7-02a1305f93ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:12.865203 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f5b338-5309-423a-a0e7-02a1305f93ca None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:12.865480 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f5b338-5309-423a-a0e7-02a1305f93ca None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:12.865749 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f5b338-5309-423a-a0e7-02a1305f93ca None admin] PATH_INFO: `/v3/services` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:12.866375 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f5b338-5309-423a-a0e7-02a1305f93ca None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:41:12.866676 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f5b338-5309-423a-a0e7-02a1305f93ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:12.868044 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f5b338-5309-423a-a0e7-02a1305f93ca None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:12.873457 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 467/930] 10.222.0.59 () {56 vars in 1126 bytes} [Tue Oct 4 11:41:12 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:41:12.881695 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea760f3-5787-477c-8456-787205aac223 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:12.948914 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:13.007359 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea760f3-5787-477c-8456-787205aac223 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:13.044014 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff202c36-ebc8-478a-ba05-32e19eeff597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:13.044652 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff202c36-ebc8-478a-ba05-32e19eeff597 None admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:13.044938 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff202c36-ebc8-478a-ba05-32e19eeff597 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:13.045215 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff202c36-ebc8-478a-ba05-32e19eeff597 None admin] PATH_INFO: `/v3/endpoints` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:13.045889 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff202c36-ebc8-478a-ba05-32e19eeff597 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:13.047849 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff202c36-ebc8-478a-ba05-32e19eeff597 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:13.171361 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 464/931] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Oct 4 11:41:12 2022] POST /identity/v3/endpoints => generated 347 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 11:41:13.416643 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62581e53-43fd-463b-9a13-229854ef1428 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:13.417068 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62581e53-43fd-463b-9a13-229854ef1428 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:13.417345 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62581e53-43fd-463b-9a13-229854ef1428 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:13.418801 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 468/932] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:41:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:41:13.425148 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c996401-42bf-4f29-b66f-3894a3b84815 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:13.425383 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c996401-42bf-4f29-b66f-3894a3b84815 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:13.425649 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c996401-42bf-4f29-b66f-3894a3b84815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:13.446769 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-7c996401-42bf-4f29-b66f-3894a3b84815 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:41:13.447996 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-7c996401-42bf-4f29-b66f-3894a3b84815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:41:13.473244 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a668e1-0fbe-4d30-861b-cb37891486e7 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:13.473576 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a668e1-0fbe-4d30-861b-cb37891486e7 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:13.474049 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a668e1-0fbe-4d30-861b-cb37891486e7 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:13.475608 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 469/933] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:41:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:41:13.480852 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ae097f-249f-4efd-8bdf-efdff55cca73 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:13.481130 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ae097f-249f-4efd-8bdf-efdff55cca73 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:13.481398 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ae097f-249f-4efd-8bdf-efdff55cca73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:13.500520 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-f4ae097f-249f-4efd-8bdf-efdff55cca73 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:41:13.501884 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-f4ae097f-249f-4efd-8bdf-efdff55cca73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:41:13.537917 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 465/934] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:41:13 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 11:41:13.591369 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 470/935] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:41:13 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 11:41:13.811852 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c996401-42bf-4f29-b66f-3894a3b84815 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:13.853505 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:13.886933 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ae097f-249f-4efd-8bdf-efdff55cca73 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:13.916161 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c996401-42bf-4f29-b66f-3894a3b84815 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:13.954801 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fd56c5-ec25-41e1-a41b-f9b89e80bcf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:13.955551 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fd56c5-ec25-41e1-a41b-f9b89e80bcf2 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:13.955896 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fd56c5-ec25-41e1-a41b-f9b89e80bcf2 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:13.956480 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fd56c5-ec25-41e1-a41b-f9b89e80bcf2 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:13.971423 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fd56c5-ec25-41e1-a41b-f9b89e80bcf2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 11:41:13.974010 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:13.977205 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-e1fd56c5-ec25-41e1-a41b-f9b89e80bcf2 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 04 11:41:13.977205 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:41:13.977205 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:41:13.977205 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:41:13.977205 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:41:13.977205 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:41:13.977205 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:41:13.977205 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:41:13.977205 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:41:13.977205 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:41:13.977205 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:41:13.977205 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:41:13.977205 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 11:41:13.977205 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 11:41:13.977205 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 11:41:13.977205 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 11:41:13.978394 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 11:41:13.978394 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 11:41:13.978394 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 11:41:13.978394 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 11:41:13.978394 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:41:13.978394 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:41:13.978394 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:41:13.978394 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:41:13.978394 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:41:13.978394 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:41:13.978394 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:41:13.978394 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:41:13.978394 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:41:13.978394 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:41:13.978394 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:41:13.978394 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:41:13.979495 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:41:13.979495 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:41:13.979495 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:41:13.979495 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:41:13.979495 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 11:41:13.979495 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 11:41:13.979495 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 11:41:13.979495 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 11:41:13.979495 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 11:41:13.979495 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 11:41:13.979495 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 04 11:41:13.979495 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:41:13.979495 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 466/936] 10.222.0.59 () {56 vars in 1120 bytes} [Tue Oct 4 11:41:13 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:41:13.986608 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fd56c5-ec25-41e1-a41b-f9b89e80bcf2 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:14.006201 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ae097f-249f-4efd-8bdf-efdff55cca73 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:14.051376 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea9d51c-ab0f-4e05-aae8-964cbdc2b95b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:14.052521 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea9d51c-ab0f-4e05-aae8-964cbdc2b95b None admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:14.053382 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea9d51c-ab0f-4e05-aae8-964cbdc2b95b None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:14.054399 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea9d51c-ab0f-4e05-aae8-964cbdc2b95b None admin] PATH_INFO: `/v3/projects` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:14.055254 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea9d51c-ab0f-4e05-aae8-964cbdc2b95b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:14.056947 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea9d51c-ab0f-4e05-aae8-964cbdc2b95b None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:14.061286 dv-cinder-860212-2-smb devstack@keystone.service[98475]: WARNING keystone.server.flask.common [None req-2ea9d51c-ab0f-4e05-aae8-964cbdc2b95b None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 04 11:41:14.103026 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:14.107145 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fd56c5-ec25-41e1-a41b-f9b89e80bcf2 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:14.112666 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.sql.core [None req-2ea9d51c-ab0f-4e05-aae8-964cbdc2b95b None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 04 11:41:14.112666 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 04 11:41:14.112666 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [parameters: {'id': 'f4d881b12766417c84b439ffc8f576d9', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 04 11:41:14.112666 dv-cinder-860212-2-smb devstack@keystone.service[98475]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=98475) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 04 11:41:14.123378 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-2ea9d51c-ab0f-4e05-aae8-964cbdc2b95b None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f4d881b12766417c84b439ffc8f576d9.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f4d881b12766417c84b439ffc8f576d9. Oct 04 11:41:14.123378 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:41:14.123378 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 11:41:14.123378 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 04 11:41:14.123378 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 11:41:14.123378 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 04 11:41:14.123378 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 11:41:14.123378 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application result = self._query(query) Oct 04 11:41:14.123378 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 11:41:14.123378 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application conn.query(q) Oct 04 11:41:14.123378 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 11:41:14.123378 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 11:41:14.123378 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 11:41:14.127211 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application result.read() Oct 04 11:41:14.127211 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 11:41:14.127211 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 04 11:41:14.127211 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 11:41:14.127211 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 04 11:41:14.127211 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 11:41:14.127211 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 04 11:41:14.127211 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 11:41:14.127211 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 04 11:41:14.127211 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 04 11:41:14.127211 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:41:14.127211 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 04 11:41:14.127211 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:41:14.127211 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:41:14.127211 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 04 11:41:14.127211 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 04 11:41:14.127211 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 04 11:41:14.127211 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 04 11:41:14.128199 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 04 11:41:14.128199 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application next(self.gen) Oct 04 11:41:14.128199 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 04 11:41:14.128199 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application yield resource Oct 04 11:41:14.128199 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 04 11:41:14.128199 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application next(self.gen) Oct 04 11:41:14.128199 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 04 11:41:14.128199 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application self.session.rollback() Oct 04 11:41:14.128199 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 11:41:14.128199 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application self.force_reraise() Oct 04 11:41:14.128199 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 11:41:14.128199 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise self.value Oct 04 11:41:14.128199 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 04 11:41:14.128199 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 04 11:41:14.128199 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 04 11:41:14.128199 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application session.commit() Oct 04 11:41:14.128199 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 04 11:41:14.129177 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 04 11:41:14.129177 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 04 11:41:14.129177 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application self._prepare_impl() Oct 04 11:41:14.129177 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 04 11:41:14.129177 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application self.session.flush() Oct 04 11:41:14.129177 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 04 11:41:14.129177 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application self._flush(objects) Oct 04 11:41:14.129177 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 04 11:41:14.129177 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 04 11:41:14.129177 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 04 11:41:14.129177 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application compat.raise_( Oct 04 11:41:14.129177 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 11:41:14.129177 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception Oct 04 11:41:14.129177 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 04 11:41:14.129177 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application flush_context.execute() Oct 04 11:41:14.129177 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 04 11:41:14.129177 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rec.execute(self) Oct 04 11:41:14.130138 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 04 11:41:14.130138 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 04 11:41:14.130138 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 04 11:41:14.130138 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 04 11:41:14.130138 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 04 11:41:14.130138 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 04 11:41:14.130138 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 04 11:41:14.130138 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 04 11:41:14.130138 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 04 11:41:14.130138 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 04 11:41:14.130138 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 04 11:41:14.130138 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 04 11:41:14.130138 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 04 11:41:14.130138 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 04 11:41:14.130138 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 04 11:41:14.130971 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 04 11:41:14.130971 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 11:41:14.130971 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception Oct 04 11:41:14.130971 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 11:41:14.130971 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 04 11:41:14.130971 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 11:41:14.130971 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 04 11:41:14.130971 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 11:41:14.130971 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application result = self._query(query) Oct 04 11:41:14.130971 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 11:41:14.130971 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application conn.query(q) Oct 04 11:41:14.130971 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 11:41:14.130971 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 11:41:14.130971 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 11:41:14.130971 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application result.read() Oct 04 11:41:14.130971 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 11:41:14.130971 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 04 11:41:14.134871 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 11:41:14.134871 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 04 11:41:14.134871 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 11:41:14.134871 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 04 11:41:14.134871 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 11:41:14.134871 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 04 11:41:14.134871 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 04 11:41:14.134871 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 04 11:41:14.134871 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [parameters: {'id': 'f4d881b12766417c84b439ffc8f576d9', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 04 11:41:14.134871 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 04 11:41:14.134871 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:41:14.134871 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 11:41:14.134871 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:41:14.134871 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:41:14.134871 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 04 11:41:14.137055 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 04 11:41:14.137055 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 04 11:41:14.137055 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 04 11:41:14.137055 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Oct 04 11:41:14.137055 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:41:14.137055 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 11:41:14.137055 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:41:14.137055 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:41:14.137055 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:41:14.137055 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:41:14.137055 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:41:14.137055 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:41:14.137055 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:41:14.137055 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:41:14.137055 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:41:14.137055 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:41:14.137055 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:41:14.139544 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:41:14.139544 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Oct 04 11:41:14.139544 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Oct 04 11:41:14.139544 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:41:14.139544 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:41:14.139544 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 04 11:41:14.139544 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 04 11:41:14.139544 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f4d881b12766417c84b439ffc8f576d9. Oct 04 11:41:14.139544 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:41:14.139544 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 471/937] 10.222.0.59 () {60 vars in 1140 bytes} [Tue Oct 4 11:41:13 2022] POST /identity/v3/projects => generated 262 bytes in 240 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 04 11:41:14.139544 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea9d51c-ab0f-4e05-aae8-964cbdc2b95b None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:14.159355 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adebfc68-a3b2-4de7-996f-cdf795c2571a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:14.159988 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adebfc68-a3b2-4de7-996f-cdf795c2571a None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:14.160263 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adebfc68-a3b2-4de7-996f-cdf795c2571a None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:14.160532 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adebfc68-a3b2-4de7-996f-cdf795c2571a None admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:14.161774 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adebfc68-a3b2-4de7-996f-cdf795c2571a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:41:14.161774 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adebfc68-a3b2-4de7-996f-cdf795c2571a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:14.163092 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adebfc68-a3b2-4de7-996f-cdf795c2571a None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:14.178494 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 467/938] 10.222.0.59 () {56 vars in 1115 bytes} [Tue Oct 4 11:41:13 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:41:14.180502 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adebfc68-a3b2-4de7-996f-cdf795c2571a None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:14.267514 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea9d51c-ab0f-4e05-aae8-964cbdc2b95b None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:14.314969 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8609a505-ec23-408a-81f5-3b3e4fb1cd3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:14.315995 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8609a505-ec23-408a-81f5-3b3e4fb1cd3f None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:14.316410 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8609a505-ec23-408a-81f5-3b3e4fb1cd3f None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:14.316851 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8609a505-ec23-408a-81f5-3b3e4fb1cd3f None admin] PATH_INFO: `/v3/projects/service` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:14.320921 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:14.327589 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8609a505-ec23-408a-81f5-3b3e4fb1cd3f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:14.329890 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8609a505-ec23-408a-81f5-3b3e4fb1cd3f None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:14.330010 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adebfc68-a3b2-4de7-996f-cdf795c2571a None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:14.343553 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-8609a505-ec23-408a-81f5-3b3e4fb1cd3f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 11:41:14.343553 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:41:14.343553 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:41:14.343553 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:41:14.343553 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:41:14.343553 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:41:14.343553 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:41:14.343553 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:41:14.343553 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:41:14.343553 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:41:14.343553 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:41:14.343553 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:41:14.343553 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 11:41:14.343553 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 11:41:14.343553 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 11:41:14.344740 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 11:41:14.344740 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:41:14.344740 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:41:14.344740 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:41:14.344740 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:41:14.344740 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:41:14.344740 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:41:14.344740 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:41:14.344740 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:41:14.344740 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:41:14.344740 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:41:14.344740 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:41:14.344740 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:41:14.344740 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:41:14.344740 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:41:14.344740 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:41:14.344740 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:41:14.345679 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 11:41:14.345679 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 11:41:14.345679 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 11:41:14.345679 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 11:41:14.345679 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 11:41:14.345679 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 11:41:14.345679 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 11:41:14.345679 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:41:14.349125 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 472/939] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Oct 4 11:41:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:41:14.351267 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8609a505-ec23-408a-81f5-3b3e4fb1cd3f None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:14.384747 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab6fe0d-9e26-4605-ab3c-3e650890d734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:14.384747 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab6fe0d-9e26-4605-ab3c-3e650890d734 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:14.384747 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab6fe0d-9e26-4605-ab3c-3e650890d734 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:14.384747 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab6fe0d-9e26-4605-ab3c-3e650890d734 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:14.394100 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab6fe0d-9e26-4605-ab3c-3e650890d734 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:14.395970 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab6fe0d-9e26-4605-ab3c-3e650890d734 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:14.416585 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-3ab6fe0d-9e26-4605-ab3c-3e650890d734 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:41:14.416585 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:41:14.416585 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:41:14.416585 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:41:14.416585 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:41:14.416585 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:41:14.416585 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:41:14.416585 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:41:14.416585 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:41:14.416585 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:41:14.416585 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:41:14.416585 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:41:14.416585 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 11:41:14.416585 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 11:41:14.416585 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 11:41:14.416585 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 11:41:14.417888 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:41:14.417888 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:41:14.417888 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:41:14.417888 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:41:14.417888 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:41:14.417888 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:41:14.417888 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:41:14.417888 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:41:14.417888 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:41:14.417888 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:41:14.417888 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:41:14.417888 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:41:14.417888 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:41:14.417888 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:41:14.417888 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:41:14.417888 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:41:14.417888 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 11:41:14.418996 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 11:41:14.418996 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:41:14.418996 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:41:14.424690 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 468/940] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Oct 4 11:41:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:41:14.427499 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab6fe0d-9e26-4605-ab3c-3e650890d734 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:14.448283 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:14.492730 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8609a505-ec23-408a-81f5-3b3e4fb1cd3f None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:14.537880 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96fd654-ecf6-47b3-8bfd-d43b7a877f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:14.538723 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96fd654-ecf6-47b3-8bfd-d43b7a877f40 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:14.539151 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96fd654-ecf6-47b3-8bfd-d43b7a877f40 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:14.539569 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96fd654-ecf6-47b3-8bfd-d43b7a877f40 None admin] PATH_INFO: `/v3/projects` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:14.540409 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96fd654-ecf6-47b3-8bfd-d43b7a877f40 None admin] RBAC: Adding query filter params (name=service) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:41:14.540880 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96fd654-ecf6-47b3-8bfd-d43b7a877f40 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:14.543026 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96fd654-ecf6-47b3-8bfd-d43b7a877f40 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:14.566186 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 473/941] 10.222.0.59 () {56 vars in 1112 bytes} [Tue Oct 4 11:41:14 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:41:14.576207 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab6fe0d-9e26-4605-ab3c-3e650890d734 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:14.616399 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73acf33-2993-4da2-92cd-61107353bb0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:14.617385 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73acf33-2993-4da2-92cd-61107353bb0a None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:14.617815 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73acf33-2993-4da2-92cd-61107353bb0a None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:14.618292 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73acf33-2993-4da2-92cd-61107353bb0a None admin] PATH_INFO: `/v3/domains` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:14.619098 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73acf33-2993-4da2-92cd-61107353bb0a None admin] RBAC: Adding query filter params (name=Default) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:41:14.619568 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73acf33-2993-4da2-92cd-61107353bb0a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:14.621137 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73acf33-2993-4da2-92cd-61107353bb0a None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:14.635759 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 469/942] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Oct 4 11:41:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:41:14.642177 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96fd654-ecf6-47b3-8bfd-d43b7a877f40 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:14.715679 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:14.766866 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96fd654-ecf6-47b3-8bfd-d43b7a877f40 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:14.802326 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44007f39-43c0-4025-b75b-a4c4ab9ea49a None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:14.802613 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44007f39-43c0-4025-b75b-a4c4ab9ea49a None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:14.802890 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44007f39-43c0-4025-b75b-a4c4ab9ea49a None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:14.804491 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 470/943] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:41:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:41:14.805183 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ca7933-139d-4fd6-a6d2-7658669156ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:14.805818 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ca7933-139d-4fd6-a6d2-7658669156ec None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:14.806092 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ca7933-139d-4fd6-a6d2-7658669156ec None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:14.806395 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ca7933-139d-4fd6-a6d2-7658669156ec None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:14.810583 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e7de6a-965e-44f0-a88a-e529229994b2 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:14.810861 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e7de6a-965e-44f0-a88a-e529229994b2 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:14.811130 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e7de6a-965e-44f0-a88a-e529229994b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:14.815033 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ca7933-139d-4fd6-a6d2-7658669156ec None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:14.816586 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ca7933-139d-4fd6-a6d2-7658669156ec None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:14.829712 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-33ca7933-139d-4fd6-a6d2-7658669156ec None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 04 11:41:14.829712 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:41:14.829712 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:41:14.829712 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:41:14.829712 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:41:14.829712 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:41:14.829712 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:41:14.829712 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:41:14.829712 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:41:14.829712 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:41:14.829712 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:41:14.829712 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:41:14.829712 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 11:41:14.829712 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 11:41:14.829712 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 11:41:14.829712 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 11:41:14.830723 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:41:14.830723 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:41:14.830723 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 11:41:14.830723 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 11:41:14.830723 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 11:41:14.830723 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 11:41:14.830723 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:41:14.830723 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:41:14.830723 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:41:14.830723 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:41:14.830723 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:41:14.830723 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:41:14.830723 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:41:14.830723 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:41:14.830723 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:41:14.830723 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:41:14.830723 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:41:14.830723 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:41:14.831683 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:41:14.831683 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:41:14.831683 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 11:41:14.831683 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 11:41:14.831683 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 11:41:14.831683 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 11:41:14.831683 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 11:41:14.831683 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 11:41:14.831683 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 04 11:41:14.831683 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:41:14.831683 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 474/944] 10.222.0.59 () {56 vars in 1117 bytes} [Tue Oct 4 11:41:14 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:41:14.836028 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-39e7de6a-965e-44f0-a88a-e529229994b2 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:41:14.838734 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ca7933-139d-4fd6-a6d2-7658669156ec None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:14.838855 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-39e7de6a-965e-44f0-a88a-e529229994b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:41:14.930079 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 471/945] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:41:14 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 11:41:14.950501 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ca7933-139d-4fd6-a6d2-7658669156ec None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:14.968297 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:14.991937 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e83d5e-3f19-40b6-b401-ae71a9b4e59a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:14.993176 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e83d5e-3f19-40b6-b401-ae71a9b4e59a None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:14.993627 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e83d5e-3f19-40b6-b401-ae71a9b4e59a None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:14.994090 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e83d5e-3f19-40b6-b401-ae71a9b4e59a None admin] PATH_INFO: `/v3/users` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:14.995011 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e83d5e-3f19-40b6-b401-ae71a9b4e59a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:41:14.995456 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e83d5e-3f19-40b6-b401-ae71a9b4e59a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:14.997052 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e83d5e-3f19-40b6-b401-ae71a9b4e59a None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:15.016676 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 475/946] 10.222.0.59 () {56 vars in 1149 bytes} [Tue Oct 4 11:41:14 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 11:41:15.022299 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e7de6a-965e-44f0-a88a-e529229994b2 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:15.024955 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:15.126990 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e7de6a-965e-44f0-a88a-e529229994b2 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:15.162545 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5696c02b-fee6-4644-97f9-8e1126a34249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:15.163592 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5696c02b-fee6-4644-97f9-8e1126a34249 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:15.164078 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5696c02b-fee6-4644-97f9-8e1126a34249 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:15.164570 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5696c02b-fee6-4644-97f9-8e1126a34249 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:15.175632 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5696c02b-fee6-4644-97f9-8e1126a34249 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:15.177441 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5696c02b-fee6-4644-97f9-8e1126a34249 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:15.192741 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-5696c02b-fee6-4644-97f9-8e1126a34249 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:41:15.192741 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:41:15.192741 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:41:15.192741 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:41:15.192741 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:41:15.192741 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:41:15.192741 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:41:15.192741 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:41:15.192741 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:41:15.192741 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:41:15.192741 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:41:15.192741 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:41:15.192741 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 11:41:15.192741 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 11:41:15.192741 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 11:41:15.192741 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 11:41:15.193729 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:41:15.193729 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:41:15.193729 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:41:15.193729 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:41:15.193729 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:41:15.193729 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:41:15.193729 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:41:15.193729 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:41:15.193729 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:41:15.193729 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:41:15.193729 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:41:15.193729 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:41:15.193729 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:41:15.193729 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:41:15.193729 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:41:15.193729 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:41:15.193729 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 11:41:15.194646 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 11:41:15.194646 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:41:15.194646 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:41:15.200693 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 472/947] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Oct 4 11:41:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:41:15.202526 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e83d5e-3f19-40b6-b401-ae71a9b4e59a None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:15.215080 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5696c02b-fee6-4644-97f9-8e1126a34249 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:15.275900 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:15.323728 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5696c02b-fee6-4644-97f9-8e1126a34249 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:15.333997 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e83d5e-3f19-40b6-b401-ae71a9b4e59a None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:15.361251 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63370fa2-1488-4696-b7e3-65c4e0ba5eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:15.362242 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63370fa2-1488-4696-b7e3-65c4e0ba5eb8 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:15.362751 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63370fa2-1488-4696-b7e3-65c4e0ba5eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:15.363256 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63370fa2-1488-4696-b7e3-65c4e0ba5eb8 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:15.364040 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63370fa2-1488-4696-b7e3-65c4e0ba5eb8 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:15.365640 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63370fa2-1488-4696-b7e3-65c4e0ba5eb8 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:15.376514 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-63370fa2-1488-4696-b7e3-65c4e0ba5eb8 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 11:41:15.376514 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:41:15.376514 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 11:41:15.376514 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 11:41:15.376514 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 11:41:15.376514 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 11:41:15.376514 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 11:41:15.376514 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 11:41:15.376514 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 11:41:15.376514 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:41:15.376514 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 11:41:15.376514 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:41:15.376514 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:41:15.376514 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:41:15.376514 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:41:15.376514 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:41:15.376514 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:41:15.377591 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:41:15.377591 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:41:15.377591 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:41:15.377591 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:41:15.377591 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:41:15.377591 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:41:15.377591 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 11:41:15.377591 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 11:41:15.377591 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 11:41:15.377591 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 11:41:15.377591 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:41:15.377591 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:41:15.377591 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:41:15.377591 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:41:15.377591 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:41:15.377591 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:41:15.378472 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:41:15.378472 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:41:15.378472 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:41:15.378472 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:41:15.378472 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:41:15.378472 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:41:15.378472 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:41:15.378472 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:41:15.378472 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:41:15.378472 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:41:15.378472 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 11:41:15.378472 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 11:41:15.378472 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 11:41:15.378472 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:41:15.381558 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 473/948] 10.222.0.59 () {56 vars in 1126 bytes} [Tue Oct 4 11:41:15 2022] GET /identity/v3/services/object-store => generated 93 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:41:15.387309 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63370fa2-1488-4696-b7e3-65c4e0ba5eb8 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:15.388635 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c986d07-a104-474d-8779-a6f651fb4d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:15.389425 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c986d07-a104-474d-8779-a6f651fb4d11 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:15.389809 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c986d07-a104-474d-8779-a6f651fb4d11 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:15.390179 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c986d07-a104-474d-8779-a6f651fb4d11 None admin] PATH_INFO: `/v3/domains` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:15.391088 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c986d07-a104-474d-8779-a6f651fb4d11 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:41:15.391501 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c986d07-a104-474d-8779-a6f651fb4d11 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:15.394586 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c986d07-a104-474d-8779-a6f651fb4d11 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:15.417915 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 476/949] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Oct 4 11:41:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:41:15.420070 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c986d07-a104-474d-8779-a6f651fb4d11 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:15.462276 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:15.526669 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63370fa2-1488-4696-b7e3-65c4e0ba5eb8 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:15.547097 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:15.548745 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c986d07-a104-474d-8779-a6f651fb4d11 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:15.566125 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cbb736-07ae-415c-88be-64ad7b1256ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:15.566741 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cbb736-07ae-415c-88be-64ad7b1256ea None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:15.567013 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cbb736-07ae-415c-88be-64ad7b1256ea None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:15.567291 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cbb736-07ae-415c-88be-64ad7b1256ea None admin] PATH_INFO: `/v3/services` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:15.567934 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cbb736-07ae-415c-88be-64ad7b1256ea None admin] RBAC: Adding query filter params (name=object-store) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:41:15.568222 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cbb736-07ae-415c-88be-64ad7b1256ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:15.569629 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cbb736-07ae-415c-88be-64ad7b1256ea None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:15.574902 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 474/950] 10.222.0.59 () {56 vars in 1122 bytes} [Tue Oct 4 11:41:15 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 11:41:15.576179 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030580a2-517c-44e6-81ce-96ac63261a1a None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:15.576991 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030580a2-517c-44e6-81ce-96ac63261a1a None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:15.577279 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030580a2-517c-44e6-81ce-96ac63261a1a None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:15.579221 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 475/951] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:41:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:41:15.581759 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030580a2-517c-44e6-81ce-96ac63261a1a None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:15.590181 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8630cd-f03d-43b9-9f5c-959946c3e16b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:15.590809 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8630cd-f03d-43b9-9f5c-959946c3e16b None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:15.591084 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8630cd-f03d-43b9-9f5c-959946c3e16b None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:15.591347 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8630cd-f03d-43b9-9f5c-959946c3e16b None admin] PATH_INFO: `/v3/projects/service` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:15.599271 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8630cd-f03d-43b9-9f5c-959946c3e16b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:15.600738 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8630cd-f03d-43b9-9f5c-959946c3e16b None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:15.613275 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-3e8630cd-f03d-43b9-9f5c-959946c3e16b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 11:41:15.613275 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:41:15.613275 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:41:15.613275 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:41:15.613275 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:41:15.613275 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:41:15.613275 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:41:15.613275 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:41:15.613275 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:41:15.613275 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:41:15.613275 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:41:15.613275 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:41:15.613275 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 11:41:15.613275 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 11:41:15.613275 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 11:41:15.614268 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 11:41:15.614268 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:41:15.614268 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:41:15.614268 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:41:15.614268 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:41:15.614268 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:41:15.614268 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:41:15.614268 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:41:15.614268 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:41:15.614268 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:41:15.614268 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:41:15.614268 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:41:15.614268 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:41:15.614268 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:41:15.614268 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:41:15.614268 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:41:15.614268 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:41:15.615272 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 11:41:15.615272 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 11:41:15.615272 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 11:41:15.615272 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 11:41:15.615272 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 11:41:15.615272 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 11:41:15.615272 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 11:41:15.615272 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:41:15.615272 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 477/952] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Oct 4 11:41:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:41:15.615897 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ca6551-156d-4371-9fe8-19769a7fac95 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:15.616444 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ca6551-156d-4371-9fe8-19769a7fac95 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:15.616444 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ca6551-156d-4371-9fe8-19769a7fac95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:15.635135 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-14ca6551-156d-4371-9fe8-19769a7fac95 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:41:15.636900 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-14ca6551-156d-4371-9fe8-19769a7fac95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:41:15.701689 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030580a2-517c-44e6-81ce-96ac63261a1a None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:15.715529 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 478/953] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:41:15 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 11:41:15.715529 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ca6551-156d-4371-9fe8-19769a7fac95 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:15.742189 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:15.746046 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50313606-9732-4402-a2ed-0f7281c02a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:15.747038 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50313606-9732-4402-a2ed-0f7281c02a0d None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:15.747396 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50313606-9732-4402-a2ed-0f7281c02a0d None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:15.747952 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50313606-9732-4402-a2ed-0f7281c02a0d None admin] PATH_INFO: `/v3/services` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:15.748676 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50313606-9732-4402-a2ed-0f7281c02a0d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:41:15.749062 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50313606-9732-4402-a2ed-0f7281c02a0d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:15.751220 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50313606-9732-4402-a2ed-0f7281c02a0d None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:15.762555 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 476/954] 10.222.0.59 () {56 vars in 1122 bytes} [Tue Oct 4 11:41:15 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:41:15.763801 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50313606-9732-4402-a2ed-0f7281c02a0d None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:15.822966 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:15.844534 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ca6551-156d-4371-9fe8-19769a7fac95 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:15.888852 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50313606-9732-4402-a2ed-0f7281c02a0d None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:15.889070 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23919e67-6240-492f-befd-f487d4aaba35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:15.889837 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23919e67-6240-492f-befd-f487d4aaba35 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:15.890254 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23919e67-6240-492f-befd-f487d4aaba35 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:15.891379 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23919e67-6240-492f-befd-f487d4aaba35 None admin] PATH_INFO: `/v3/projects` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:15.892943 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23919e67-6240-492f-befd-f487d4aaba35 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:41:15.893250 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23919e67-6240-492f-befd-f487d4aaba35 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:15.894685 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23919e67-6240-492f-befd-f487d4aaba35 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:15.909848 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 479/955] 10.222.0.59 () {56 vars in 1148 bytes} [Tue Oct 4 11:41:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:41:15.915822 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23919e67-6240-492f-befd-f487d4aaba35 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:15.936385 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8f54f2-76f9-49ec-acba-124db85ca1cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:15.937051 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8f54f2-76f9-49ec-acba-124db85ca1cb None admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:15.937314 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8f54f2-76f9-49ec-acba-124db85ca1cb None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:15.938141 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8f54f2-76f9-49ec-acba-124db85ca1cb None admin] PATH_INFO: `/v3/endpoints` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:15.938809 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8f54f2-76f9-49ec-acba-124db85ca1cb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:15.940272 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8f54f2-76f9-49ec-acba-124db85ca1cb None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:16.006103 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:16.016409 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 477/956] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Oct 4 11:41:15 2022] POST /identity/v3/endpoints => generated 349 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 11:41:16.017633 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8f54f2-76f9-49ec-acba-124db85ca1cb None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:16.031175 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23919e67-6240-492f-befd-f487d4aaba35 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:16.082834 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd696a56-3e98-42ee-9536-fb898cebfefe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:16.083227 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd696a56-3e98-42ee-9536-fb898cebfefe None admin] REQUEST_METHOD: `PUT` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:16.083502 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd696a56-3e98-42ee-9536-fb898cebfefe None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:16.083831 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd696a56-3e98-42ee-9536-fb898cebfefe None admin] PATH_INFO: `/v3/projects/39913dbe3e984f27a61493dd75381501/users/06d1850ea27c483780eed67ede9cc1e3/roles/c4a56aec8c5b46e995400c7a9e32f979` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:16.086512 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd696a56-3e98-42ee-9536-fb898cebfefe None admin] RBAC: Authorizing `identity:create_grant(project_id=39913dbe3e984f27a61493dd75381501, user_id=06d1850ea27c483780eed67ede9cc1e3, role_id=c4a56aec8c5b46e995400c7a9e32f979)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:16.087976 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd696a56-3e98-42ee-9536-fb898cebfefe None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:16.151419 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8f54f2-76f9-49ec-acba-124db85ca1cb None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:16.153298 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:16.184960 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 480/957] 10.222.0.59 () {58 vars in 1439 bytes} [Tue Oct 4 11:41:15 2022] PUT /identity/v3/projects/39913dbe3e984f27a61493dd75381501/users/06d1850ea27c483780eed67ede9cc1e3/roles/c4a56aec8c5b46e995400c7a9e32f979 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 11:41:16.191239 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33c03d7-9388-4d5e-8dce-ab088d1c4bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:16.192097 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33c03d7-9388-4d5e-8dce-ab088d1c4bb3 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:16.192473 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33c03d7-9388-4d5e-8dce-ab088d1c4bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:16.193416 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33c03d7-9388-4d5e-8dce-ab088d1c4bb3 None admin] PATH_INFO: `/v3/services/compute` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:16.193532 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33c03d7-9388-4d5e-8dce-ab088d1c4bb3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:16.195043 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33c03d7-9388-4d5e-8dce-ab088d1c4bb3 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:16.206496 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-c33c03d7-9388-4d5e-8dce-ab088d1c4bb3 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 04 11:41:16.206496 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:41:16.206496 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 11:41:16.206496 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 11:41:16.206496 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 11:41:16.206496 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 11:41:16.206496 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 11:41:16.206496 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 11:41:16.206496 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 04 11:41:16.206496 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:41:16.206496 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 11:41:16.206496 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:41:16.206496 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:41:16.206496 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:41:16.206496 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:41:16.206496 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:41:16.206496 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:41:16.207876 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:41:16.207876 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:41:16.207876 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:41:16.207876 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:41:16.207876 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:41:16.207876 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:41:16.207876 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 11:41:16.207876 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 11:41:16.207876 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 11:41:16.207876 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 11:41:16.207876 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:41:16.207876 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:41:16.207876 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:41:16.207876 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:41:16.207876 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:41:16.207876 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:41:16.209289 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:41:16.209289 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:41:16.209289 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:41:16.209289 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:41:16.209289 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:41:16.209289 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:41:16.209289 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:41:16.209289 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:41:16.209289 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:41:16.209289 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:41:16.209289 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 11:41:16.209289 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 11:41:16.209289 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 04 11:41:16.209289 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:41:16.210230 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 478/958] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Oct 4 11:41:16 2022] GET /identity/v3/services/compute => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:41:16.216820 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd696a56-3e98-42ee-9536-fb898cebfefe None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:16.331873 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd696a56-3e98-42ee-9536-fb898cebfefe None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:16.371118 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a007bf-2473-468b-8370-29d2a115c5c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:16.372006 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a007bf-2473-468b-8370-29d2a115c5c2 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:16.372475 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a007bf-2473-468b-8370-29d2a115c5c2 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:16.372944 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a007bf-2473-468b-8370-29d2a115c5c2 None admin] PATH_INFO: `/v3/services` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:16.373576 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a007bf-2473-468b-8370-29d2a115c5c2 None admin] RBAC: Adding query filter params (name=compute) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:41:16.373879 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a007bf-2473-468b-8370-29d2a115c5c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:16.375408 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a007bf-2473-468b-8370-29d2a115c5c2 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:16.381759 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 481/959] 10.222.0.59 () {56 vars in 1112 bytes} [Tue Oct 4 11:41:16 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 11:41:16.387635 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33c03d7-9388-4d5e-8dce-ab088d1c4bb3 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:16.502125 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33c03d7-9388-4d5e-8dce-ab088d1c4bb3 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:16.538379 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6459cc-c63b-444e-bd75-2644a8aee063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:16.538993 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6459cc-c63b-444e-bd75-2644a8aee063 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:16.539266 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6459cc-c63b-444e-bd75-2644a8aee063 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:16.539538 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6459cc-c63b-444e-bd75-2644a8aee063 None admin] PATH_INFO: `/v3/services` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:16.540164 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6459cc-c63b-444e-bd75-2644a8aee063 None admin] RBAC: Adding query filter params (type=compute) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:41:16.540462 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6459cc-c63b-444e-bd75-2644a8aee063 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:16.541845 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6459cc-c63b-444e-bd75-2644a8aee063 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:16.552754 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 479/960] 10.222.0.59 () {56 vars in 1112 bytes} [Tue Oct 4 11:41:16 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:41:16.998317 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8795ac0-edc3-448c-ac35-9c3aaa4efbca None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:16.998689 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8795ac0-edc3-448c-ac35-9c3aaa4efbca None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:16.998887 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8795ac0-edc3-448c-ac35-9c3aaa4efbca None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:17.001016 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 482/961] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:41:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:41:17.006651 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab22a3e5-ba67-49a2-8dbf-dfb52ca135cc None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:17.007102 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab22a3e5-ba67-49a2-8dbf-dfb52ca135cc None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:17.007276 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab22a3e5-ba67-49a2-8dbf-dfb52ca135cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:17.026074 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-ab22a3e5-ba67-49a2-8dbf-dfb52ca135cc None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:41:17.027269 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-ab22a3e5-ba67-49a2-8dbf-dfb52ca135cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:41:17.056820 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:17.103188 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 480/962] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:41:17 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 11:41:17.382129 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8795ac0-edc3-448c-ac35-9c3aaa4efbca None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:17.386264 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:17.497072 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8795ac0-edc3-448c-ac35-9c3aaa4efbca None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:17.534333 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddc3267-fa72-44a3-8eb3-a44c67e5bff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:17.534948 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddc3267-fa72-44a3-8eb3-a44c67e5bff0 None admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:17.535225 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddc3267-fa72-44a3-8eb3-a44c67e5bff0 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:17.535494 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddc3267-fa72-44a3-8eb3-a44c67e5bff0 None admin] PATH_INFO: `/v3/users` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:17.536151 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddc3267-fa72-44a3-8eb3-a44c67e5bff0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:17.537596 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddc3267-fa72-44a3-8eb3-a44c67e5bff0 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:17.575222 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.sql.core [None req-5ddc3267-fa72-44a3-8eb3-a44c67e5bff0 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 04 11:41:17.575222 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 04 11:41:17.575222 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [parameters: {'user_id': '4e051874c97e4758b77188052ca0d152', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 04 11:41:17.575222 dv-cinder-860212-2-smb devstack@keystone.service[98475]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=98475) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 04 11:41:17.582765 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-5ddc3267-fa72-44a3-8eb3-a44c67e5bff0 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 04 11:41:17.582765 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:41:17.582765 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 11:41:17.582765 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 04 11:41:17.582765 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 11:41:17.582765 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 04 11:41:17.582765 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 11:41:17.582765 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application result = self._query(query) Oct 04 11:41:17.582765 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 11:41:17.582765 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application conn.query(q) Oct 04 11:41:17.582765 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 11:41:17.582765 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 11:41:17.582765 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 11:41:17.582765 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application result.read() Oct 04 11:41:17.582765 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 11:41:17.583838 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 04 11:41:17.583838 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 11:41:17.583838 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 04 11:41:17.583838 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 11:41:17.583838 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 04 11:41:17.583838 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 11:41:17.583838 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 04 11:41:17.583838 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 04 11:41:17.583838 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:41:17.583838 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 04 11:41:17.583838 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:41:17.583838 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:41:17.583838 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 04 11:41:17.583838 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 04 11:41:17.583838 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Oct 04 11:41:17.583838 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Oct 04 11:41:17.583838 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 04 11:41:17.583838 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application next(self.gen) Oct 04 11:41:17.585320 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 04 11:41:17.585320 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application yield resource Oct 04 11:41:17.585320 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 04 11:41:17.585320 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application next(self.gen) Oct 04 11:41:17.585320 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 04 11:41:17.585320 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application self.session.rollback() Oct 04 11:41:17.585320 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 11:41:17.585320 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application self.force_reraise() Oct 04 11:41:17.585320 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 11:41:17.585320 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise self.value Oct 04 11:41:17.585320 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 04 11:41:17.585320 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 04 11:41:17.585320 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 04 11:41:17.585320 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application session.commit() Oct 04 11:41:17.585320 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 04 11:41:17.585320 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 04 11:41:17.585320 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 04 11:41:17.586251 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application self._prepare_impl() Oct 04 11:41:17.586251 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 04 11:41:17.586251 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application self.session.flush() Oct 04 11:41:17.586251 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 04 11:41:17.586251 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application self._flush(objects) Oct 04 11:41:17.586251 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 04 11:41:17.586251 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 04 11:41:17.586251 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 04 11:41:17.586251 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application compat.raise_( Oct 04 11:41:17.586251 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 11:41:17.586251 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception Oct 04 11:41:17.586251 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 04 11:41:17.586251 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application flush_context.execute() Oct 04 11:41:17.586251 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 04 11:41:17.586251 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rec.execute(self) Oct 04 11:41:17.586251 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 04 11:41:17.586251 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 04 11:41:17.587156 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 04 11:41:17.587156 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 04 11:41:17.587156 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 04 11:41:17.587156 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application result = connection._execute_20( Oct 04 11:41:17.587156 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 04 11:41:17.587156 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 04 11:41:17.587156 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 04 11:41:17.587156 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 04 11:41:17.587156 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 04 11:41:17.587156 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 04 11:41:17.587156 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 04 11:41:17.587156 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 04 11:41:17.587156 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 04 11:41:17.587156 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 04 11:41:17.587156 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 11:41:17.587156 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception Oct 04 11:41:17.588010 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 11:41:17.588010 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 04 11:41:17.588010 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 11:41:17.588010 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 04 11:41:17.588010 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 11:41:17.588010 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application result = self._query(query) Oct 04 11:41:17.588010 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 11:41:17.588010 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application conn.query(q) Oct 04 11:41:17.588010 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 11:41:17.588010 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 11:41:17.588010 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 11:41:17.588010 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application result.read() Oct 04 11:41:17.588010 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 11:41:17.588010 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 04 11:41:17.588010 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 11:41:17.588010 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 04 11:41:17.589969 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 11:41:17.589969 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 04 11:41:17.589969 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 11:41:17.589969 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 04 11:41:17.589969 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 04 11:41:17.589969 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 04 11:41:17.589969 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [parameters: {'user_id': '4e051874c97e4758b77188052ca0d152', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 04 11:41:17.589969 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 04 11:41:17.589969 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:41:17.589969 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 11:41:17.589969 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:41:17.589969 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:41:17.589969 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:41:17.589969 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:41:17.589969 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:41:17.591870 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:41:17.591870 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:41:17.591870 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:41:17.591870 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:41:17.591870 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:41:17.591870 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:41:17.591870 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:41:17.591870 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Oct 04 11:41:17.591870 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Oct 04 11:41:17.591870 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:41:17.591870 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:41:17.591870 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 11:41:17.591870 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 11:41:17.591870 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 11:41:17.591870 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 11:41:17.591870 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Oct 04 11:41:17.591870 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Oct 04 11:41:17.613367 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Oct 04 11:41:17.613367 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Oct 04 11:41:17.613367 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 04 11:41:17.613367 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 04 11:41:17.613367 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 04 11:41:17.613367 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:41:17.613367 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 483/963] 10.222.0.59 () {60 vars in 1131 bytes} [Tue Oct 4 11:41:17 2022] POST /identity/v3/users => generated 160 bytes in 203 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:41:17.614184 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab22a3e5-ba67-49a2-8dbf-dfb52ca135cc None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:17.699066 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab22a3e5-ba67-49a2-8dbf-dfb52ca135cc None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:17.735950 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b867dfb-a23c-4f0a-8345-7a34d351f15e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:17.736582 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b867dfb-a23c-4f0a-8345-7a34d351f15e None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:17.736896 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b867dfb-a23c-4f0a-8345-7a34d351f15e None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:17.737227 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b867dfb-a23c-4f0a-8345-7a34d351f15e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:17.744525 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b867dfb-a23c-4f0a-8345-7a34d351f15e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:17.745985 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b867dfb-a23c-4f0a-8345-7a34d351f15e None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:17.758396 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-4b867dfb-a23c-4f0a-8345-7a34d351f15e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 04 11:41:17.758396 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:41:17.758396 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:41:17.758396 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:41:17.758396 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:41:17.758396 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:41:17.758396 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:41:17.758396 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:41:17.758396 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:41:17.758396 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:41:17.758396 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:41:17.758396 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:41:17.758396 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 11:41:17.758396 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 11:41:17.758396 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 11:41:17.758396 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 11:41:17.760586 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:41:17.760586 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:41:17.760586 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 11:41:17.760586 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 11:41:17.760586 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 11:41:17.760586 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 11:41:17.760586 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:41:17.760586 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:41:17.760586 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:41:17.760586 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:41:17.760586 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:41:17.760586 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:41:17.760586 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:41:17.760586 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:41:17.760586 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:41:17.760586 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:41:17.760586 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:41:17.760586 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:41:17.762887 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:41:17.762887 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:41:17.762887 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 11:41:17.762887 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 11:41:17.762887 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 11:41:17.762887 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 11:41:17.762887 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 11:41:17.762887 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 11:41:17.762887 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 04 11:41:17.762887 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:41:17.762887 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 481/964] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Oct 4 11:41:17 2022] GET /identity/v3/users/cinder => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:41:17.768966 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddc3267-fa72-44a3-8eb3-a44c67e5bff0 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:17.839487 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:17.876472 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddc3267-fa72-44a3-8eb3-a44c67e5bff0 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:17.911509 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeba3655-5ffc-445b-99b8-d4cecff8ffa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:17.912359 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeba3655-5ffc-445b-99b8-d4cecff8ffa3 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:17.912821 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeba3655-5ffc-445b-99b8-d4cecff8ffa3 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:17.913269 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeba3655-5ffc-445b-99b8-d4cecff8ffa3 None admin] PATH_INFO: `/v3/users` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:17.914104 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeba3655-5ffc-445b-99b8-d4cecff8ffa3 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:41:17.914562 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeba3655-5ffc-445b-99b8-d4cecff8ffa3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:17.916359 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeba3655-5ffc-445b-99b8-d4cecff8ffa3 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:17.958092 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 484/965] 10.222.0.59 () {56 vars in 1101 bytes} [Tue Oct 4 11:41:17 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:41:18.394189 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee013f0-0d11-4c60-9cb3-58c5bf76ccf3 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:18.394724 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee013f0-0d11-4c60-9cb3-58c5bf76ccf3 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:18.394724 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee013f0-0d11-4c60-9cb3-58c5bf76ccf3 None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:18.396279 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 482/966] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:41:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:41:18.402216 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab95d7b-2f86-4a55-a84b-812ee697a178 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:18.402756 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab95d7b-2f86-4a55-a84b-812ee697a178 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:18.402756 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab95d7b-2f86-4a55-a84b-812ee697a178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:18.422808 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-3ab95d7b-2f86-4a55-a84b-812ee697a178 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:41:18.424304 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-3ab95d7b-2f86-4a55-a84b-812ee697a178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:41:18.501032 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 485/967] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:41:18 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 11:41:18.517235 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f125ad99-d3a2-4f42-8f23-03df5419d145 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:18.517517 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f125ad99-d3a2-4f42-8f23-03df5419d145 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:18.517797 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f125ad99-d3a2-4f42-8f23-03df5419d145 None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:18.519124 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 483/968] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:41:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:41:18.525914 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a50dd1-9081-463a-ae94-6c5f9096ab85 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:18.526201 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a50dd1-9081-463a-ae94-6c5f9096ab85 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:18.526477 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a50dd1-9081-463a-ae94-6c5f9096ab85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:18.545816 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-36a50dd1-9081-463a-ae94-6c5f9096ab85 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:41:18.547510 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-36a50dd1-9081-463a-ae94-6c5f9096ab85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:41:18.596268 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:18.614224 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 486/969] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:41:18 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 11:41:18.784863 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f125ad99-d3a2-4f42-8f23-03df5419d145 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:18.804267 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5f02ed-8aba-4437-927c-93ca719dd144 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:18.804557 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5f02ed-8aba-4437-927c-93ca719dd144 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:18.804850 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5f02ed-8aba-4437-927c-93ca719dd144 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:18.806189 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 487/970] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:41:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 11:41:18.810348 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:18.811652 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2fc513-e097-4772-836e-c6d1857d0fdb None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:18.812098 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2fc513-e097-4772-836e-c6d1857d0fdb None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:18.812436 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2fc513-e097-4772-836e-c6d1857d0fdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:18.831586 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-7c2fc513-e097-4772-836e-c6d1857d0fdb None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:41:18.835294 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-7c2fc513-e097-4772-836e-c6d1857d0fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:41:18.899311 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f125ad99-d3a2-4f42-8f23-03df5419d145 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:18.912900 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 488/971] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:41:18 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 11:41:18.913740 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2fc513-e097-4772-836e-c6d1857d0fdb None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:18.943335 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b6a525-ec01-4e4c-9557-0e7ae00f0249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:18.944457 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b6a525-ec01-4e4c-9557-0e7ae00f0249 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:18.945245 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b6a525-ec01-4e4c-9557-0e7ae00f0249 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:18.945911 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b6a525-ec01-4e4c-9557-0e7ae00f0249 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:18.946692 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b6a525-ec01-4e4c-9557-0e7ae00f0249 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:18.949225 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b6a525-ec01-4e4c-9557-0e7ae00f0249 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:18.961379 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-e3b6a525-ec01-4e4c-9557-0e7ae00f0249 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 11:41:18.961379 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:41:18.961379 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 11:41:18.961379 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 11:41:18.961379 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 11:41:18.961379 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 11:41:18.961379 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 11:41:18.961379 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 11:41:18.961379 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 11:41:18.961379 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:41:18.961379 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 11:41:18.961379 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:41:18.961379 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:41:18.961379 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:41:18.961379 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:41:18.961379 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:41:18.961379 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:41:18.962607 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:41:18.962607 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:41:18.962607 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:41:18.962607 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:41:18.962607 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:41:18.962607 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:41:18.962607 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 11:41:18.962607 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 11:41:18.962607 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 11:41:18.962607 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 11:41:18.962607 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:41:18.962607 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:41:18.962607 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:41:18.962607 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:41:18.962607 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:41:18.962607 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:41:18.963697 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:41:18.963697 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:41:18.963697 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:41:18.963697 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:41:18.963697 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:41:18.963697 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:41:18.963697 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:41:18.963697 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:41:18.963697 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:41:18.963697 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:41:18.963697 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 11:41:18.963697 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 11:41:18.963697 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 11:41:18.963697 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:41:18.966224 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 484/972] 10.222.0.59 () {56 vars in 1126 bytes} [Tue Oct 4 11:41:18 2022] GET /identity/v3/services/object-store => generated 93 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:41:18.971787 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b6a525-ec01-4e4c-9557-0e7ae00f0249 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:19.021007 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2fc513-e097-4772-836e-c6d1857d0fdb None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:19.035663 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:19.055250 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb0c501-7d76-445c-bd8b-2d6bd7b28359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:19.055880 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb0c501-7d76-445c-bd8b-2d6bd7b28359 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:19.056167 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb0c501-7d76-445c-bd8b-2d6bd7b28359 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:19.056442 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb0c501-7d76-445c-bd8b-2d6bd7b28359 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:19.067662 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb0c501-7d76-445c-bd8b-2d6bd7b28359 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 11:41:19.072711 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-edb0c501-7d76-445c-bd8b-2d6bd7b28359 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 04 11:41:19.072711 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:41:19.072711 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:41:19.072711 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:41:19.072711 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:41:19.072711 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:41:19.072711 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:41:19.072711 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:41:19.072711 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:41:19.072711 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:41:19.072711 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:41:19.072711 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:41:19.072711 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 11:41:19.072711 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 11:41:19.072711 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 11:41:19.072711 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 11:41:19.073719 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 11:41:19.073719 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 11:41:19.073719 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 11:41:19.073719 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 11:41:19.073719 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:41:19.073719 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:41:19.073719 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:41:19.073719 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:41:19.073719 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:41:19.073719 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:41:19.073719 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:41:19.073719 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:41:19.073719 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:41:19.073719 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:41:19.073719 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:41:19.073719 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:41:19.074616 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:41:19.074616 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:41:19.074616 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:41:19.074616 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:41:19.074616 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 11:41:19.074616 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 11:41:19.074616 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 11:41:19.074616 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 11:41:19.074616 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 11:41:19.074616 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 11:41:19.074616 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 04 11:41:19.074616 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:41:19.074616 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 489/973] 10.222.0.59 () {56 vars in 1120 bytes} [Tue Oct 4 11:41:18 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:41:19.079627 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:19.080936 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb0c501-7d76-445c-bd8b-2d6bd7b28359 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:19.095244 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b6a525-ec01-4e4c-9557-0e7ae00f0249 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:19.152115 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e87af5-d5da-4ff2-822f-595d6cb96ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:19.152760 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e87af5-d5da-4ff2-822f-595d6cb96ee1 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:19.153040 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e87af5-d5da-4ff2-822f-595d6cb96ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:19.153312 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e87af5-d5da-4ff2-822f-595d6cb96ee1 None admin] PATH_INFO: `/v3/services` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:19.153944 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e87af5-d5da-4ff2-822f-595d6cb96ee1 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:41:19.154244 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e87af5-d5da-4ff2-822f-595d6cb96ee1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:19.155608 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e87af5-d5da-4ff2-822f-595d6cb96ee1 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:19.161466 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 485/974] 10.222.0.59 () {56 vars in 1122 bytes} [Tue Oct 4 11:41:18 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 11:41:19.169196 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e87af5-d5da-4ff2-822f-595d6cb96ee1 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:19.215307 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb0c501-7d76-445c-bd8b-2d6bd7b28359 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:19.249198 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f444c7-4a84-4859-b500-84691c03e6c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:19.249797 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f444c7-4a84-4859-b500-84691c03e6c2 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:19.250708 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f444c7-4a84-4859-b500-84691c03e6c2 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:19.250973 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f444c7-4a84-4859-b500-84691c03e6c2 None admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:19.251635 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f444c7-4a84-4859-b500-84691c03e6c2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:41:19.251930 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f444c7-4a84-4859-b500-84691c03e6c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:19.253326 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f444c7-4a84-4859-b500-84691c03e6c2 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:19.261176 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 490/975] 10.222.0.59 () {56 vars in 1115 bytes} [Tue Oct 4 11:41:19 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:41:19.262003 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f444c7-4a84-4859-b500-84691c03e6c2 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:19.276013 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e87af5-d5da-4ff2-822f-595d6cb96ee1 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:19.295809 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:19.310116 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a962091b-f1a5-4fcd-8351-c32c3c9e1796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:19.310712 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a962091b-f1a5-4fcd-8351-c32c3c9e1796 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:19.310986 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a962091b-f1a5-4fcd-8351-c32c3c9e1796 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:19.311252 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a962091b-f1a5-4fcd-8351-c32c3c9e1796 None admin] PATH_INFO: `/v3/services` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:19.311861 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a962091b-f1a5-4fcd-8351-c32c3c9e1796 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:41:19.312155 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a962091b-f1a5-4fcd-8351-c32c3c9e1796 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:19.313641 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a962091b-f1a5-4fcd-8351-c32c3c9e1796 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:19.318299 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 486/976] 10.222.0.59 () {56 vars in 1122 bytes} [Tue Oct 4 11:41:19 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 11:41:19.321781 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a962091b-f1a5-4fcd-8351-c32c3c9e1796 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:19.337806 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:19.361228 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f444c7-4a84-4859-b500-84691c03e6c2 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:19.395544 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e14bcbd-db30-4026-be0a-305133a35c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:19.396139 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e14bcbd-db30-4026-be0a-305133a35c89 None admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:19.396414 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e14bcbd-db30-4026-be0a-305133a35c89 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:19.396710 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e14bcbd-db30-4026-be0a-305133a35c89 None admin] PATH_INFO: `/v3/services` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:19.397346 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e14bcbd-db30-4026-be0a-305133a35c89 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:19.398697 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e14bcbd-db30-4026-be0a-305133a35c89 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:19.418901 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a962091b-f1a5-4fcd-8351-c32c3c9e1796 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:19.454115 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7901bb31-c87f-4087-a8e9-5c0e9024dea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:19.454758 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7901bb31-c87f-4087-a8e9-5c0e9024dea8 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:19.455037 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7901bb31-c87f-4087-a8e9-5c0e9024dea8 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:19.455308 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7901bb31-c87f-4087-a8e9-5c0e9024dea8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:19.465866 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7901bb31-c87f-4087-a8e9-5c0e9024dea8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:19.467143 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 491/977] 10.222.0.59 () {60 vars in 1141 bytes} [Tue Oct 4 11:41:19 2022] POST /identity/v3/services => generated 242 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 11:41:19.467609 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7901bb31-c87f-4087-a8e9-5c0e9024dea8 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:19.467970 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e14bcbd-db30-4026-be0a-305133a35c89 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:19.489307 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-7901bb31-c87f-4087-a8e9-5c0e9024dea8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:41:19.489307 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:41:19.489307 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:41:19.489307 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:41:19.489307 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:41:19.489307 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:41:19.489307 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:41:19.489307 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:41:19.489307 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:41:19.489307 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:41:19.489307 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:41:19.489307 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:41:19.489307 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 11:41:19.489307 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 11:41:19.489307 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 11:41:19.489307 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 11:41:19.490408 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:41:19.490408 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:41:19.490408 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:41:19.490408 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:41:19.490408 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:41:19.490408 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:41:19.490408 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:41:19.490408 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:41:19.490408 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:41:19.490408 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:41:19.490408 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:41:19.490408 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:41:19.490408 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:41:19.490408 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:41:19.490408 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:41:19.490408 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:41:19.490408 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 11:41:19.491417 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 11:41:19.491417 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:41:19.491417 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:41:19.495600 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 487/978] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Oct 4 11:41:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:41:19.496454 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7901bb31-c87f-4087-a8e9-5c0e9024dea8 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:19.588116 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:19.591133 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:19.605119 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e14bcbd-db30-4026-be0a-305133a35c89 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:19.633781 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7901bb31-c87f-4087-a8e9-5c0e9024dea8 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:19.644738 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02083b99-4ce0-4694-82e2-cf08317ec715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:19.645625 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02083b99-4ce0-4694-82e2-cf08317ec715 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:19.645907 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02083b99-4ce0-4694-82e2-cf08317ec715 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:19.646181 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02083b99-4ce0-4694-82e2-cf08317ec715 None admin] PATH_INFO: `/v3/endpoints` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:19.646895 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02083b99-4ce0-4694-82e2-cf08317ec715 None admin] RBAC: Adding query filter params (interface=admin, service_id=fc94ff3a1a034673a17de3493a324256, region_id=RegionOne) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:41:19.647203 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02083b99-4ce0-4694-82e2-cf08317ec715 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:19.648589 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02083b99-4ce0-4694-82e2-cf08317ec715 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:19.654735 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 492/979] 10.222.0.59 () {56 vars in 1249 bytes} [Tue Oct 4 11:41:19 2022] GET /identity/v3/endpoints?service_id=fc94ff3a1a034673a17de3493a324256&interface=admin®ion_id=RegionOne => generated 193 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:41:19.661430 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02083b99-4ce0-4694-82e2-cf08317ec715 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:19.678398 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb9194e-a245-47af-93ea-170ea52724d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:19.679291 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb9194e-a245-47af-93ea-170ea52724d4 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:19.679575 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb9194e-a245-47af-93ea-170ea52724d4 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:19.680014 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb9194e-a245-47af-93ea-170ea52724d4 None admin] PATH_INFO: `/v3/domains` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:19.681283 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb9194e-a245-47af-93ea-170ea52724d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:41:19.681283 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb9194e-a245-47af-93ea-170ea52724d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:19.682566 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb9194e-a245-47af-93ea-170ea52724d4 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:19.695852 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 488/980] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Oct 4 11:41:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:41:19.701576 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb9194e-a245-47af-93ea-170ea52724d4 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:19.779197 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02083b99-4ce0-4694-82e2-cf08317ec715 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:19.807479 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb9194e-a245-47af-93ea-170ea52724d4 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:19.820553 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5150bebb-2c19-412d-8f0e-9d818c77cdd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:19.821292 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5150bebb-2c19-412d-8f0e-9d818c77cdd8 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:19.821580 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5150bebb-2c19-412d-8f0e-9d818c77cdd8 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:19.821898 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5150bebb-2c19-412d-8f0e-9d818c77cdd8 None admin] PATH_INFO: `/v3/services` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:19.822447 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5150bebb-2c19-412d-8f0e-9d818c77cdd8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:19.823812 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5150bebb-2c19-412d-8f0e-9d818c77cdd8 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:19.840715 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 493/981] 10.222.0.59 () {56 vars in 1087 bytes} [Tue Oct 4 11:41:19 2022] GET /identity/v3/services => generated 1727 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 11:41:19.846318 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:19.858231 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ee1942-264d-45a0-9b75-f9d4fa51da14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:19.858982 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ee1942-264d-45a0-9b75-f9d4fa51da14 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:19.859303 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ee1942-264d-45a0-9b75-f9d4fa51da14 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:19.859581 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ee1942-264d-45a0-9b75-f9d4fa51da14 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:19.868064 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ee1942-264d-45a0-9b75-f9d4fa51da14 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:19.869715 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ee1942-264d-45a0-9b75-f9d4fa51da14 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:19.883868 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-b5ee1942-264d-45a0-9b75-f9d4fa51da14 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 04 11:41:19.883868 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:41:19.883868 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:41:19.883868 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:41:19.883868 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:41:19.883868 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:41:19.883868 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:41:19.883868 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:41:19.883868 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:41:19.883868 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:41:19.883868 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:41:19.883868 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:41:19.883868 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 11:41:19.883868 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 11:41:19.883868 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 11:41:19.883868 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 11:41:19.890153 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:41:19.890153 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:41:19.890153 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 11:41:19.890153 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 11:41:19.890153 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 11:41:19.890153 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 11:41:19.890153 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:41:19.890153 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:41:19.890153 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:41:19.890153 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:41:19.890153 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:41:19.890153 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:41:19.890153 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:41:19.890153 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:41:19.890153 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:41:19.890153 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:41:19.890153 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:41:19.890153 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:41:19.892306 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:41:19.892306 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:41:19.892306 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 11:41:19.892306 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 11:41:19.892306 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 11:41:19.892306 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 11:41:19.892306 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 11:41:19.892306 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 11:41:19.892306 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 04 11:41:19.892306 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:41:19.892306 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 489/982] 10.222.0.59 () {56 vars in 1117 bytes} [Tue Oct 4 11:41:19 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 11:41:19.895206 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5150bebb-2c19-412d-8f0e-9d818c77cdd8 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:19.920390 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:20.014408 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5150bebb-2c19-412d-8f0e-9d818c77cdd8 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:20.051082 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274a8415-d8ac-470a-a55b-7f11604973cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:20.051693 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274a8415-d8ac-470a-a55b-7f11604973cb None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:20.051965 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274a8415-d8ac-470a-a55b-7f11604973cb None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:20.052239 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274a8415-d8ac-470a-a55b-7f11604973cb None admin] PATH_INFO: `/v3/users` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:20.053064 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274a8415-d8ac-470a-a55b-7f11604973cb None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:41:20.053367 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274a8415-d8ac-470a-a55b-7f11604973cb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:20.054790 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274a8415-d8ac-470a-a55b-7f11604973cb None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:20.076676 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 494/983] 10.222.0.59 () {56 vars in 1149 bytes} [Tue Oct 4 11:41:19 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:41:20.079391 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ee1942-264d-45a0-9b75-f9d4fa51da14 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:20.181616 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ee1942-264d-45a0-9b75-f9d4fa51da14 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:20.215101 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88270db-adfe-4feb-9ce2-0f3f86b0f939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:20.215707 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88270db-adfe-4feb-9ce2-0f3f86b0f939 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:20.215984 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88270db-adfe-4feb-9ce2-0f3f86b0f939 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:20.216250 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88270db-adfe-4feb-9ce2-0f3f86b0f939 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:20.268897 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:20.285290 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88270db-adfe-4feb-9ce2-0f3f86b0f939 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:20.286738 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88270db-adfe-4feb-9ce2-0f3f86b0f939 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:20.388657 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 490/984] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Oct 4 11:41:20 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 11:41:20.391866 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274a8415-d8ac-470a-a55b-7f11604973cb None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:20.473493 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:20.498204 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274a8415-d8ac-470a-a55b-7f11604973cb None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:20.545459 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b766ba-4d48-4257-b783-e991f4cdeeb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:20.546094 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b766ba-4d48-4257-b783-e991f4cdeeb9 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:20.546368 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b766ba-4d48-4257-b783-e991f4cdeeb9 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:20.546714 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b766ba-4d48-4257-b783-e991f4cdeeb9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:20.558003 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b766ba-4d48-4257-b783-e991f4cdeeb9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:20.559458 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b766ba-4d48-4257-b783-e991f4cdeeb9 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:20.574421 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-a1b766ba-4d48-4257-b783-e991f4cdeeb9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:41:20.574421 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:41:20.574421 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:41:20.574421 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:41:20.574421 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:41:20.574421 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:41:20.574421 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:41:20.574421 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:41:20.574421 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:41:20.574421 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:41:20.574421 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:41:20.574421 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:41:20.574421 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 11:41:20.574421 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 11:41:20.574421 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 11:41:20.574421 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 11:41:20.575435 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:41:20.575435 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:41:20.575435 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:41:20.575435 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:41:20.575435 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:41:20.575435 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:41:20.575435 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:41:20.575435 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:41:20.575435 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:41:20.575435 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:41:20.575435 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:41:20.575435 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:41:20.575435 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:41:20.575435 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:41:20.575435 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:41:20.575435 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:41:20.575435 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 11:41:20.581245 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 11:41:20.581245 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:41:20.581245 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:41:20.581245 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 495/985] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Oct 4 11:41:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:41:20.583170 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88270db-adfe-4feb-9ce2-0f3f86b0f939 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:20.670881 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:20.688238 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88270db-adfe-4feb-9ce2-0f3f86b0f939 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:20.722966 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3def6e-755a-4758-88cd-5dbba74e1b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:20.724212 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3def6e-755a-4758-88cd-5dbba74e1b15 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:20.724747 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3def6e-755a-4758-88cd-5dbba74e1b15 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:20.725216 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3def6e-755a-4758-88cd-5dbba74e1b15 None admin] PATH_INFO: `/v3/domains` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:20.726064 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3def6e-755a-4758-88cd-5dbba74e1b15 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:41:20.726559 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3def6e-755a-4758-88cd-5dbba74e1b15 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:20.728140 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3def6e-755a-4758-88cd-5dbba74e1b15 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:20.741467 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 491/986] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Oct 4 11:41:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:41:20.747541 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b766ba-4d48-4257-b783-e991f4cdeeb9 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:20.860157 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b766ba-4d48-4257-b783-e991f4cdeeb9 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:20.891984 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:20.898260 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a35c35-b1ea-402f-b9bb-673922b29c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:20.898891 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a35c35-b1ea-402f-b9bb-673922b29c8e None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:20.899173 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a35c35-b1ea-402f-b9bb-673922b29c8e None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:20.899512 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a35c35-b1ea-402f-b9bb-673922b29c8e None admin] PATH_INFO: `/v3/projects/service` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:20.906738 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a35c35-b1ea-402f-b9bb-673922b29c8e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:20.908450 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a35c35-b1ea-402f-b9bb-673922b29c8e None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:20.919567 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-06a35c35-b1ea-402f-b9bb-673922b29c8e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 11:41:20.919567 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:41:20.919567 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:41:20.919567 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:41:20.919567 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:41:20.919567 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:41:20.919567 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:41:20.919567 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:41:20.919567 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:41:20.919567 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:41:20.919567 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:41:20.919567 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:41:20.919567 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 11:41:20.919567 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 11:41:20.919567 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 11:41:20.920458 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 11:41:20.920458 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:41:20.920458 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:41:20.920458 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:41:20.920458 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:41:20.920458 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:41:20.920458 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:41:20.920458 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:41:20.920458 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:41:20.920458 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:41:20.920458 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:41:20.920458 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:41:20.920458 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:41:20.920458 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:41:20.920458 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:41:20.920458 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:41:20.920458 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:41:20.922020 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 11:41:20.922020 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 11:41:20.922020 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 11:41:20.922020 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 11:41:20.922020 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 11:41:20.922020 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 11:41:20.922020 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 11:41:20.922020 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:41:20.922020 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 496/987] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Oct 4 11:41:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:41:20.929137 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3def6e-755a-4758-88cd-5dbba74e1b15 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:21.031682 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3def6e-755a-4758-88cd-5dbba74e1b15 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:21.065598 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d8958a-503f-4fd0-9832-1392d8268189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:21.066528 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d8958a-503f-4fd0-9832-1392d8268189 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:21.067003 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d8958a-503f-4fd0-9832-1392d8268189 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:21.067472 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d8958a-503f-4fd0-9832-1392d8268189 None admin] PATH_INFO: `/v3/projects` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:21.068369 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d8958a-503f-4fd0-9832-1392d8268189 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:41:21.068906 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d8958a-503f-4fd0-9832-1392d8268189 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:21.070517 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d8958a-503f-4fd0-9832-1392d8268189 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:21.088366 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 492/988] 10.222.0.59 () {56 vars in 1148 bytes} [Tue Oct 4 11:41:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:41:21.089974 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a35c35-b1ea-402f-b9bb-673922b29c8e None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:21.201286 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a35c35-b1ea-402f-b9bb-673922b29c8e None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:21.239981 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faef31bd-2519-47b3-ad52-e50a84e1b95b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:21.240611 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faef31bd-2519-47b3-ad52-e50a84e1b95b None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:21.240895 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faef31bd-2519-47b3-ad52-e50a84e1b95b None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:21.241169 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faef31bd-2519-47b3-ad52-e50a84e1b95b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:21.241887 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faef31bd-2519-47b3-ad52-e50a84e1b95b None admin] RBAC: Adding query filter params (role.id=c4a56aec8c5b46e995400c7a9e32f979, scope.project.id=39913dbe3e984f27a61493dd75381501, user.id=06d1850ea27c483780eed67ede9cc1e3) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:41:21.242189 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faef31bd-2519-47b3-ad52-e50a84e1b95b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:21.243601 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faef31bd-2519-47b3-ad52-e50a84e1b95b None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:21.256869 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 497/989] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Oct 4 11:41:21 2022] GET /identity/v3/role_assignments?user.id=06d1850ea27c483780eed67ede9cc1e3&scope.project.id=39913dbe3e984f27a61493dd75381501&role.id=c4a56aec8c5b46e995400c7a9e32f979 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:41:21.737849 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b39ec-f26f-435a-934a-8f8f3e98647f None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:21.738371 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b39ec-f26f-435a-934a-8f8f3e98647f None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:21.738450 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b39ec-f26f-435a-934a-8f8f3e98647f None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:21.739769 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 493/990] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:41:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:41:21.744968 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c289f1-356e-4bdf-8d07-d8dbb65c0edc None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:21.745544 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c289f1-356e-4bdf-8d07-d8dbb65c0edc None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:21.745544 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c289f1-356e-4bdf-8d07-d8dbb65c0edc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:21.766984 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-08c289f1-356e-4bdf-8d07-d8dbb65c0edc None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:41:21.768179 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-08c289f1-356e-4bdf-8d07-d8dbb65c0edc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:41:21.819717 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:21.838099 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 498/991] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:41:21 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 11:41:22.091853 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8e22a9-b3c6-4422-aa0a-0d317b60e183 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:22.092195 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8e22a9-b3c6-4422-aa0a-0d317b60e183 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:22.092376 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8e22a9-b3c6-4422-aa0a-0d317b60e183 None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:22.094909 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 494/992] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:41:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:41:22.100172 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529286eb-5042-4ea5-8e24-a0ed70f22c7e None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:22.100464 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529286eb-5042-4ea5-8e24-a0ed70f22c7e None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:22.100775 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529286eb-5042-4ea5-8e24-a0ed70f22c7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:22.105871 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8e22a9-b3c6-4422-aa0a-0d317b60e183 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:22.109653 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:22.119563 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-529286eb-5042-4ea5-8e24-a0ed70f22c7e None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:41:22.120770 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-529286eb-5042-4ea5-8e24-a0ed70f22c7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:41:22.206291 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 499/993] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:41:22 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 11:41:22.217412 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8e22a9-b3c6-4422-aa0a-0d317b60e183 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:22.253252 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba461f5-9163-471a-8843-04e16289fa7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:22.253884 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba461f5-9163-471a-8843-04e16289fa7d None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:22.254161 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba461f5-9163-471a-8843-04e16289fa7d None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:22.254431 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba461f5-9163-471a-8843-04e16289fa7d None admin] PATH_INFO: `/v3/services/compute` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:22.255007 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba461f5-9163-471a-8843-04e16289fa7d None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:22.256354 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba461f5-9163-471a-8843-04e16289fa7d None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:22.265209 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-eba461f5-9163-471a-8843-04e16289fa7d None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 04 11:41:22.265209 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:41:22.265209 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 11:41:22.265209 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 11:41:22.265209 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 11:41:22.265209 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 11:41:22.265209 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 11:41:22.265209 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 11:41:22.265209 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 04 11:41:22.265209 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:41:22.265209 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 11:41:22.265209 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:41:22.265209 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:41:22.265209 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:41:22.265209 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:41:22.265209 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:41:22.265209 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:41:22.266444 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:41:22.266444 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:41:22.266444 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:41:22.266444 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:41:22.266444 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:41:22.266444 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:41:22.266444 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 11:41:22.266444 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 11:41:22.266444 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 11:41:22.266444 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 11:41:22.266444 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:41:22.266444 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:41:22.266444 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:41:22.266444 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:41:22.266444 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:41:22.266444 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:41:22.267770 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:41:22.267770 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:41:22.267770 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:41:22.267770 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:41:22.267770 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:41:22.267770 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:41:22.267770 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:41:22.267770 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:41:22.267770 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:41:22.267770 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:41:22.267770 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 11:41:22.267770 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 11:41:22.267770 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 04 11:41:22.267770 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:41:22.271276 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 495/994] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Oct 4 11:41:22 2022] GET /identity/v3/services/compute => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 11:41:22.272470 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529286eb-5042-4ea5-8e24-a0ed70f22c7e None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:22.374124 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529286eb-5042-4ea5-8e24-a0ed70f22c7e None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:22.388624 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:22.409534 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558db45d-b657-46aa-a1b7-8f37ab8360e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:22.410134 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558db45d-b657-46aa-a1b7-8f37ab8360e4 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:22.410409 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558db45d-b657-46aa-a1b7-8f37ab8360e4 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:22.410682 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558db45d-b657-46aa-a1b7-8f37ab8360e4 None admin] PATH_INFO: `/v3/services` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:22.411311 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558db45d-b657-46aa-a1b7-8f37ab8360e4 None admin] RBAC: Adding query filter params (name=compute) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:41:22.411607 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558db45d-b657-46aa-a1b7-8f37ab8360e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:22.412999 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558db45d-b657-46aa-a1b7-8f37ab8360e4 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:22.417594 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 500/995] 10.222.0.59 () {56 vars in 1112 bytes} [Tue Oct 4 11:41:22 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:41:22.423351 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba461f5-9163-471a-8843-04e16289fa7d None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:22.487614 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558db45d-b657-46aa-a1b7-8f37ab8360e4 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:22.496649 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:22.537377 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba461f5-9163-471a-8843-04e16289fa7d None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:22.574232 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ea790d-a707-4848-b64f-215b61bbb2aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:22.574850 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ea790d-a707-4848-b64f-215b61bbb2aa None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:22.575129 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ea790d-a707-4848-b64f-215b61bbb2aa None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:22.575400 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ea790d-a707-4848-b64f-215b61bbb2aa None admin] PATH_INFO: `/v3/services` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:22.576027 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ea790d-a707-4848-b64f-215b61bbb2aa None admin] RBAC: Adding query filter params (type=compute) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:41:22.576326 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ea790d-a707-4848-b64f-215b61bbb2aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:22.578289 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ea790d-a707-4848-b64f-215b61bbb2aa None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:22.583716 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 496/996] 10.222.0.59 () {56 vars in 1112 bytes} [Tue Oct 4 11:41:22 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 11:41:22.589424 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ea790d-a707-4848-b64f-215b61bbb2aa None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:22.606012 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558db45d-b657-46aa-a1b7-8f37ab8360e4 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:22.645717 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7453c6a0-fa11-4ff0-90ef-85f89a27a9c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:22.646686 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7453c6a0-fa11-4ff0-90ef-85f89a27a9c9 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:22.647429 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7453c6a0-fa11-4ff0-90ef-85f89a27a9c9 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:22.648122 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7453c6a0-fa11-4ff0-90ef-85f89a27a9c9 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:22.648876 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7453c6a0-fa11-4ff0-90ef-85f89a27a9c9 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:22.650936 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7453c6a0-fa11-4ff0-90ef-85f89a27a9c9 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:22.662769 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-7453c6a0-fa11-4ff0-90ef-85f89a27a9c9 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 11:41:22.662769 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:41:22.662769 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 11:41:22.662769 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 11:41:22.662769 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 11:41:22.662769 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 11:41:22.662769 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 11:41:22.662769 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 11:41:22.662769 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 11:41:22.662769 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:41:22.662769 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 11:41:22.662769 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:41:22.662769 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:41:22.662769 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:41:22.662769 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:41:22.662769 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:41:22.662769 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:41:22.663981 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:41:22.663981 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:41:22.663981 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:41:22.663981 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:41:22.663981 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:41:22.663981 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:41:22.663981 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 11:41:22.663981 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 11:41:22.663981 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 11:41:22.663981 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 11:41:22.663981 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:41:22.663981 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:41:22.663981 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:41:22.663981 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:41:22.663981 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:41:22.663981 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:41:22.665034 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:41:22.665034 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:41:22.665034 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:41:22.665034 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:41:22.665034 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:41:22.665034 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:41:22.665034 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:41:22.665034 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:41:22.665034 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:41:22.665034 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:41:22.665034 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 11:41:22.665034 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 11:41:22.665034 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 11:41:22.665034 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:41:22.665802 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 501/997] 10.222.0.59 () {56 vars in 1126 bytes} [Tue Oct 4 11:41:22 2022] GET /identity/v3/services/object-store => generated 93 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 11:41:22.672072 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7453c6a0-fa11-4ff0-90ef-85f89a27a9c9 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:22.709875 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ea790d-a707-4848-b64f-215b61bbb2aa None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:22.717175 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:22.741332 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:22.746581 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f538a948-cc06-4261-b1d3-60c3820748d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:22.747182 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f538a948-cc06-4261-b1d3-60c3820748d5 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:22.747459 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f538a948-cc06-4261-b1d3-60c3820748d5 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:22.747723 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f538a948-cc06-4261-b1d3-60c3820748d5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:22.748410 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f538a948-cc06-4261-b1d3-60c3820748d5 None admin] RBAC: Adding query filter params (interface=public, service_id=571d3dd9808a4faa94e690abb4390ee0, region_id=RegionOne) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:41:22.748740 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f538a948-cc06-4261-b1d3-60c3820748d5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:22.750618 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f538a948-cc06-4261-b1d3-60c3820748d5 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:22.755856 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 497/998] 10.222.0.59 () {56 vars in 1251 bytes} [Tue Oct 4 11:41:22 2022] GET /identity/v3/endpoints?service_id=571d3dd9808a4faa94e690abb4390ee0&interface=public®ion_id=RegionOne => generated 194 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 11:41:22.761648 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f538a948-cc06-4261-b1d3-60c3820748d5 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:22.784388 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7453c6a0-fa11-4ff0-90ef-85f89a27a9c9 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:22.823328 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa41869a-ee49-469d-b068-75791345d286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:22.824092 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa41869a-ee49-469d-b068-75791345d286 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:22.824213 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa41869a-ee49-469d-b068-75791345d286 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:22.824469 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa41869a-ee49-469d-b068-75791345d286 None admin] PATH_INFO: `/v3/services` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:22.825126 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa41869a-ee49-469d-b068-75791345d286 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:41:22.825417 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa41869a-ee49-469d-b068-75791345d286 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:22.826790 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa41869a-ee49-469d-b068-75791345d286 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:22.832097 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 502/999] 10.222.0.59 () {56 vars in 1122 bytes} [Tue Oct 4 11:41:22 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 11:41:22.837799 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa41869a-ee49-469d-b068-75791345d286 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:22.879961 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f538a948-cc06-4261-b1d3-60c3820748d5 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:22.916966 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62c300d-d032-4ade-a693-022478b61752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:22.917501 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62c300d-d032-4ade-a693-022478b61752 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:22.917780 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62c300d-d032-4ade-a693-022478b61752 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:22.918053 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62c300d-d032-4ade-a693-022478b61752 None admin] PATH_INFO: `/v3/services` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:22.918654 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62c300d-d032-4ade-a693-022478b61752 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:22.920016 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62c300d-d032-4ade-a693-022478b61752 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:22.927018 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 498/1000] 10.222.0.59 () {56 vars in 1087 bytes} [Tue Oct 4 11:41:22 2022] GET /identity/v3/services => generated 1727 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 11:41:22.963271 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa41869a-ee49-469d-b068-75791345d286 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:22.975240 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:23.007754 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6ab796-a777-451d-903f-aa483ce6f387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:23.008461 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6ab796-a777-451d-903f-aa483ce6f387 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:23.009240 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6ab796-a777-451d-903f-aa483ce6f387 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:23.009947 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6ab796-a777-451d-903f-aa483ce6f387 None admin] PATH_INFO: `/v3/services` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:23.010831 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6ab796-a777-451d-903f-aa483ce6f387 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:41:23.011622 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6ab796-a777-451d-903f-aa483ce6f387 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:23.013071 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6ab796-a777-451d-903f-aa483ce6f387 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:23.023727 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 503/1001] 10.222.0.59 () {56 vars in 1122 bytes} [Tue Oct 4 11:41:22 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:41:23.025285 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62c300d-d032-4ade-a693-022478b61752 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:23.094247 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:23.139251 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62c300d-d032-4ade-a693-022478b61752 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:23.179416 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463aa412-6bd9-4b2e-9cbd-a781a2932fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:23.179944 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463aa412-6bd9-4b2e-9cbd-a781a2932fde None admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:23.180220 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463aa412-6bd9-4b2e-9cbd-a781a2932fde None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:23.180496 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463aa412-6bd9-4b2e-9cbd-a781a2932fde None admin] PATH_INFO: `/v3/endpoints` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:23.181199 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463aa412-6bd9-4b2e-9cbd-a781a2932fde None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:23.182558 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463aa412-6bd9-4b2e-9cbd-a781a2932fde None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:23.261578 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 499/1002] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Oct 4 11:41:23 2022] POST /identity/v3/endpoints => generated 325 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 11:41:23.490908 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be16220-fa71-4812-8e2d-88bc4d18a930 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:23.491257 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be16220-fa71-4812-8e2d-88bc4d18a930 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:23.491509 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be16220-fa71-4812-8e2d-88bc4d18a930 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:23.493041 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 504/1003] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:41:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:41:23.498261 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21015bb-7656-4a14-83a5-d1218f943a0c None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:23.498567 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21015bb-7656-4a14-83a5-d1218f943a0c None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:23.498847 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21015bb-7656-4a14-83a5-d1218f943a0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:23.518452 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-a21015bb-7656-4a14-83a5-d1218f943a0c None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:41:23.519662 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-a21015bb-7656-4a14-83a5-d1218f943a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:41:23.599273 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 500/1004] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:41:23 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 11:41:23.892403 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be16220-fa71-4812-8e2d-88bc4d18a930 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:23.999417 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be16220-fa71-4812-8e2d-88bc4d18a930 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:24.035267 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4278469-c1b9-4687-88f8-52be11951faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:24.035901 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4278469-c1b9-4687-88f8-52be11951faa None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:24.036180 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4278469-c1b9-4687-88f8-52be11951faa None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:24.036513 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4278469-c1b9-4687-88f8-52be11951faa None admin] PATH_INFO: `/v3/services/image` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:24.037174 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4278469-c1b9-4687-88f8-52be11951faa None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:24.038597 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4278469-c1b9-4687-88f8-52be11951faa None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:24.048144 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-b4278469-c1b9-4687-88f8-52be11951faa None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 04 11:41:24.048144 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:41:24.048144 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 11:41:24.048144 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 11:41:24.048144 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 11:41:24.048144 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 11:41:24.048144 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 11:41:24.048144 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 11:41:24.048144 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 04 11:41:24.048144 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:41:24.048144 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 11:41:24.048144 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:41:24.048144 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:41:24.048144 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:41:24.048144 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:41:24.048144 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:41:24.048144 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:41:24.049258 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:41:24.049258 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:41:24.049258 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:41:24.049258 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:41:24.049258 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:41:24.049258 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:41:24.049258 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 11:41:24.049258 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 11:41:24.049258 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 11:41:24.049258 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 11:41:24.049258 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:41:24.049258 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:41:24.049258 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:41:24.049258 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:41:24.049258 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:41:24.049258 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:41:24.053747 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:41:24.053747 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:41:24.053747 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:41:24.053747 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:41:24.053747 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:41:24.053747 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:41:24.053747 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:41:24.053747 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:41:24.053747 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:41:24.053747 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:41:24.053747 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 11:41:24.053747 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 11:41:24.053747 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 04 11:41:24.053747 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:41:24.053747 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 505/1005] 10.222.0.59 () {56 vars in 1105 bytes} [Tue Oct 4 11:41:23 2022] GET /identity/v3/services/image => generated 86 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:41:24.055722 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21015bb-7656-4a14-83a5-d1218f943a0c None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:24.104289 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:24.161208 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21015bb-7656-4a14-83a5-d1218f943a0c None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:24.198885 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b1287f-4b13-44dc-99d8-a33a7f4ee0be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:24.199536 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b1287f-4b13-44dc-99d8-a33a7f4ee0be None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:24.199812 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b1287f-4b13-44dc-99d8-a33a7f4ee0be None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:24.200077 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b1287f-4b13-44dc-99d8-a33a7f4ee0be None admin] PATH_INFO: `/v3/services` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:24.200797 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b1287f-4b13-44dc-99d8-a33a7f4ee0be None admin] RBAC: Adding query filter params (name=image) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:41:24.201098 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b1287f-4b13-44dc-99d8-a33a7f4ee0be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:24.202442 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b1287f-4b13-44dc-99d8-a33a7f4ee0be None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:24.207389 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 501/1006] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Oct 4 11:41:24 2022] GET /identity/v3/services?name=image => generated 122 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:41:24.212837 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4278469-c1b9-4687-88f8-52be11951faa None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:24.248354 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:24.313782 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4278469-c1b9-4687-88f8-52be11951faa None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:24.346695 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74171fe-a5f3-4ff2-90ae-e9d4450d0c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:24.347286 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74171fe-a5f3-4ff2-90ae-e9d4450d0c96 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:24.347557 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74171fe-a5f3-4ff2-90ae-e9d4450d0c96 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:24.347821 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74171fe-a5f3-4ff2-90ae-e9d4450d0c96 None admin] PATH_INFO: `/v3/services` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:24.348436 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74171fe-a5f3-4ff2-90ae-e9d4450d0c96 None admin] RBAC: Adding query filter params (type=image) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:41:24.349009 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74171fe-a5f3-4ff2-90ae-e9d4450d0c96 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:24.350351 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74171fe-a5f3-4ff2-90ae-e9d4450d0c96 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:24.354775 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 506/1007] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Oct 4 11:41:24 2022] GET /identity/v3/services?type=image => generated 122 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:41:25.109253 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ded507-1fc8-4e9e-8183-9473e3c362f3 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:25.109817 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ded507-1fc8-4e9e-8183-9473e3c362f3 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:25.110058 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ded507-1fc8-4e9e-8183-9473e3c362f3 None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:25.111434 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 502/1008] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:41:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:41:25.116423 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f251f18e-102f-4e07-b709-0ab491f93291 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:25.116892 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f251f18e-102f-4e07-b709-0ab491f93291 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:25.116983 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f251f18e-102f-4e07-b709-0ab491f93291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:25.136832 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-f251f18e-102f-4e07-b709-0ab491f93291 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:41:25.138003 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-f251f18e-102f-4e07-b709-0ab491f93291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:41:25.205356 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 507/1009] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:41:25 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 11:41:25.466915 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4899e905-a293-4cf9-9028-94b8d06adfa3 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:25.467254 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4899e905-a293-4cf9-9028-94b8d06adfa3 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:25.467468 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4899e905-a293-4cf9-9028-94b8d06adfa3 None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:25.469251 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 503/1010] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:41:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:41:25.474705 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d83af6-3410-4288-9920-cf010386607a None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:25.475087 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d83af6-3410-4288-9920-cf010386607a None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:25.475367 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d83af6-3410-4288-9920-cf010386607a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:25.475972 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4899e905-a293-4cf9-9028-94b8d06adfa3 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:25.498569 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-a4d83af6-3410-4288-9920-cf010386607a None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:41:25.500302 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-a4d83af6-3410-4288-9920-cf010386607a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:41:25.530364 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:25.579210 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 508/1011] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:41:25 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 11:41:25.590254 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4899e905-a293-4cf9-9028-94b8d06adfa3 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:25.602233 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:25.626590 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892d9165-ef65-4f5a-858f-146e787da06e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:25.627230 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892d9165-ef65-4f5a-858f-146e787da06e None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:25.627507 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892d9165-ef65-4f5a-858f-146e787da06e None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:25.627781 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892d9165-ef65-4f5a-858f-146e787da06e None admin] PATH_INFO: `/v3/services/compute` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:25.628360 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892d9165-ef65-4f5a-858f-146e787da06e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:25.629745 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892d9165-ef65-4f5a-858f-146e787da06e None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:25.638830 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-892d9165-ef65-4f5a-858f-146e787da06e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 04 11:41:25.638830 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:41:25.638830 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 11:41:25.638830 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 11:41:25.638830 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 11:41:25.638830 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 11:41:25.638830 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 11:41:25.638830 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 11:41:25.638830 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 04 11:41:25.638830 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:41:25.638830 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 11:41:25.638830 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:41:25.638830 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:41:25.638830 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:41:25.638830 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:41:25.638830 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:41:25.638830 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:41:25.640025 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:41:25.640025 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:41:25.640025 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:41:25.640025 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:41:25.640025 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:41:25.640025 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:41:25.640025 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 11:41:25.640025 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 11:41:25.640025 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 11:41:25.640025 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 11:41:25.640025 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:41:25.640025 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:41:25.640025 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:41:25.640025 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:41:25.640025 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:41:25.640025 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:41:25.641237 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:41:25.641237 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:41:25.641237 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:41:25.641237 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:41:25.641237 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:41:25.641237 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:41:25.641237 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:41:25.641237 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:41:25.641237 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:41:25.641237 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:41:25.641237 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 11:41:25.641237 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 11:41:25.641237 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 04 11:41:25.641237 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:41:25.648625 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 504/1012] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Oct 4 11:41:25 2022] GET /identity/v3/services/compute => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:41:25.650651 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d83af6-3410-4288-9920-cf010386607a None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:25.753219 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d83af6-3410-4288-9920-cf010386607a None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:25.786870 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e65135-be6c-4307-a494-6c28a4d17dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:25.787461 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e65135-be6c-4307-a494-6c28a4d17dfe None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:25.787735 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e65135-be6c-4307-a494-6c28a4d17dfe None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:25.788003 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e65135-be6c-4307-a494-6c28a4d17dfe None admin] PATH_INFO: `/v3/services` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:25.788639 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e65135-be6c-4307-a494-6c28a4d17dfe None admin] RBAC: Adding query filter params (name=compute) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:41:25.788937 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e65135-be6c-4307-a494-6c28a4d17dfe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:25.790416 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e65135-be6c-4307-a494-6c28a4d17dfe None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:25.800492 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 509/1013] 10.222.0.59 () {56 vars in 1112 bytes} [Tue Oct 4 11:41:25 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:41:25.801570 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892d9165-ef65-4f5a-858f-146e787da06e None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:25.854706 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e65135-be6c-4307-a494-6c28a4d17dfe None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:25.880484 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:25.909235 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892d9165-ef65-4f5a-858f-146e787da06e None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:25.946816 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758a2ae3-6bc3-45fa-9c8d-80967a7e474a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:25.947435 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758a2ae3-6bc3-45fa-9c8d-80967a7e474a None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:25.947717 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758a2ae3-6bc3-45fa-9c8d-80967a7e474a None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:25.947992 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758a2ae3-6bc3-45fa-9c8d-80967a7e474a None admin] PATH_INFO: `/v3/services` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:25.948652 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758a2ae3-6bc3-45fa-9c8d-80967a7e474a None admin] RBAC: Adding query filter params (type=compute) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:41:25.948951 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758a2ae3-6bc3-45fa-9c8d-80967a7e474a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:25.950546 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758a2ae3-6bc3-45fa-9c8d-80967a7e474a None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:25.956341 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 505/1014] 10.222.0.59 () {56 vars in 1112 bytes} [Tue Oct 4 11:41:25 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 11:41:25.961533 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758a2ae3-6bc3-45fa-9c8d-80967a7e474a None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:25.963245 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e65135-be6c-4307-a494-6c28a4d17dfe None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:26.000673 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2772fb5e-e953-44fe-b97e-6c1426198e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:26.001361 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2772fb5e-e953-44fe-b97e-6c1426198e37 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:26.001646 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2772fb5e-e953-44fe-b97e-6c1426198e37 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:26.001919 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2772fb5e-e953-44fe-b97e-6c1426198e37 None admin] PATH_INFO: `/v3/domains/default` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:26.003014 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2772fb5e-e953-44fe-b97e-6c1426198e37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:26.004175 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:26.005258 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2772fb5e-e953-44fe-b97e-6c1426198e37 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:26.008701 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 510/1015] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Oct 4 11:41:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 11:41:26.012670 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2772fb5e-e953-44fe-b97e-6c1426198e37 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:26.067911 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758a2ae3-6bc3-45fa-9c8d-80967a7e474a None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:26.107840 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ff8805-910a-492e-a0f3-7c147a437d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:26.108444 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ff8805-910a-492e-a0f3-7c147a437d50 None admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:26.108752 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ff8805-910a-492e-a0f3-7c147a437d50 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:26.109150 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ff8805-910a-492e-a0f3-7c147a437d50 None admin] PATH_INFO: `/v3/endpoints` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:26.109819 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ff8805-910a-492e-a0f3-7c147a437d50 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:26.111225 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ff8805-910a-492e-a0f3-7c147a437d50 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:26.113471 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:26.123259 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2772fb5e-e953-44fe-b97e-6c1426198e37 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:26.158127 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0f7d5b-d264-4e29-b94c-d5ad81ff0f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:26.158733 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f7d5b-d264-4e29-b94c-d5ad81ff0f4b None admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:26.159012 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f7d5b-d264-4e29-b94c-d5ad81ff0f4b None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:26.159282 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f7d5b-d264-4e29-b94c-d5ad81ff0f4b None admin] PATH_INFO: `/v3/projects` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:26.159918 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0f7d5b-d264-4e29-b94c-d5ad81ff0f4b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:26.161371 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0f7d5b-d264-4e29-b94c-d5ad81ff0f4b None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:26.226798 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 506/1016] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Oct 4 11:41:25 2022] POST /identity/v3/endpoints => generated 334 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 11:41:26.246246 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 511/1017] 10.222.0.59 () {60 vars in 1141 bytes} [Tue Oct 4 11:41:26 2022] POST /identity/v3/projects => generated 311 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 11:41:26.595663 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3bf2ec-c9fa-4b1a-ac29-2d0f812c113d None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:26.595991 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3bf2ec-c9fa-4b1a-ac29-2d0f812c113d None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:26.596221 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3bf2ec-c9fa-4b1a-ac29-2d0f812c113d None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:26.597903 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 507/1018] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:41:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:41:26.603332 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e09a7d-362a-44af-a174-b323ce549fe0 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:26.603626 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e09a7d-362a-44af-a174-b323ce549fe0 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:26.603903 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e09a7d-362a-44af-a174-b323ce549fe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:26.623650 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-75e09a7d-362a-44af-a174-b323ce549fe0 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:41:26.624897 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-75e09a7d-362a-44af-a174-b323ce549fe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:41:26.703114 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 512/1019] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:41:26 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 11:41:26.986266 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3bf2ec-c9fa-4b1a-ac29-2d0f812c113d None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:27.086518 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:27.094707 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3bf2ec-c9fa-4b1a-ac29-2d0f812c113d None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:27.130158 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80715189-e3f0-45a4-b599-c90fae03c6b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:27.130845 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80715189-e3f0-45a4-b599-c90fae03c6b6 None admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:27.131091 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80715189-e3f0-45a4-b599-c90fae03c6b6 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:27.131300 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80715189-e3f0-45a4-b599-c90fae03c6b6 None admin] PATH_INFO: `/v3/services` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:27.131964 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80715189-e3f0-45a4-b599-c90fae03c6b6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:27.133345 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80715189-e3f0-45a4-b599-c90fae03c6b6 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:27.234849 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 508/1020] 10.222.0.59 () {60 vars in 1141 bytes} [Tue Oct 4 11:41:26 2022] POST /identity/v3/services => generated 242 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 11:41:28.500926 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc04a0fa-703a-49dc-a31f-da494b130726 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:28.501456 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc04a0fa-703a-49dc-a31f-da494b130726 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:28.501456 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc04a0fa-703a-49dc-a31f-da494b130726 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:28.505329 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 513/1021] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:41:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:41:28.505444 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ed5f5d-872a-481e-b818-72cf5924dd5b None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:28.505444 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ed5f5d-872a-481e-b818-72cf5924dd5b None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:28.505444 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ed5f5d-872a-481e-b818-72cf5924dd5b None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:28.505444 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 509/1022] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:41:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 11:41:28.509934 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c99aa-9e30-4fff-a2c2-4f8f9c818c1a None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:28.509934 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c99aa-9e30-4fff-a2c2-4f8f9c818c1a None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:28.509934 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c99aa-9e30-4fff-a2c2-4f8f9c818c1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:28.513778 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839d5585-cf38-43df-af6b-816bd27e4128 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:28.514067 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839d5585-cf38-43df-af6b-816bd27e4128 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:28.514346 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839d5585-cf38-43df-af6b-816bd27e4128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:28.527745 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-ae4c99aa-9e30-4fff-a2c2-4f8f9c818c1a None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:41:28.529130 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-ae4c99aa-9e30-4fff-a2c2-4f8f9c818c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:41:28.543570 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-839d5585-cf38-43df-af6b-816bd27e4128 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:41:28.544807 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-839d5585-cf38-43df-af6b-816bd27e4128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:41:28.597717 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:28.611886 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 514/1023] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:41:28 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 11:41:28.632635 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 510/1024] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:41:28 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 11:41:28.886663 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4c99aa-9e30-4fff-a2c2-4f8f9c818c1a None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:28.889208 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839d5585-cf38-43df-af6b-816bd27e4128 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:28.977055 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:28.993266 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4c99aa-9e30-4fff-a2c2-4f8f9c818c1a None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:28.993470 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839d5585-cf38-43df-af6b-816bd27e4128 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:29.028703 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5766dda3-0f83-466e-9482-9b6a17644140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:29.029338 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5766dda3-0f83-466e-9482-9b6a17644140 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:29.029611 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5766dda3-0f83-466e-9482-9b6a17644140 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:29.029883 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5766dda3-0f83-466e-9482-9b6a17644140 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:29.031740 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060bf53a-c44c-4131-b62e-41526dcc2aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:29.032713 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060bf53a-c44c-4131-b62e-41526dcc2aa4 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:29.033415 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060bf53a-c44c-4131-b62e-41526dcc2aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:29.033833 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060bf53a-c44c-4131-b62e-41526dcc2aa4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:29.035234 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060bf53a-c44c-4131-b62e-41526dcc2aa4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:29.037056 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060bf53a-c44c-4131-b62e-41526dcc2aa4 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:29.039190 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 515/1025] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Oct 4 11:41:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:41:29.041360 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5766dda3-0f83-466e-9482-9b6a17644140 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 11:41:29.044634 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060bf53a-c44c-4131-b62e-41526dcc2aa4 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:29.046512 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-5766dda3-0f83-466e-9482-9b6a17644140 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 04 11:41:29.046512 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:41:29.046512 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:41:29.046512 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:41:29.046512 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:41:29.046512 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:41:29.046512 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:41:29.046512 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:41:29.046512 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:41:29.046512 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:41:29.046512 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:41:29.046512 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:41:29.046512 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 11:41:29.046512 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 11:41:29.046512 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 11:41:29.046512 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 11:41:29.047558 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 11:41:29.047558 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 11:41:29.047558 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 11:41:29.047558 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 11:41:29.047558 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:41:29.047558 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:41:29.047558 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:41:29.047558 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:41:29.047558 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:41:29.047558 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:41:29.047558 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:41:29.047558 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:41:29.047558 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:41:29.047558 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:41:29.047558 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:41:29.047558 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:41:29.048439 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:41:29.048439 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:41:29.048439 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:41:29.048439 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:41:29.048439 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 11:41:29.048439 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 11:41:29.048439 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 11:41:29.048439 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 11:41:29.048439 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 11:41:29.048439 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 11:41:29.048439 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 04 11:41:29.048439 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:41:29.048439 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 511/1026] 10.222.0.59 () {56 vars in 1120 bytes} [Tue Oct 4 11:41:28 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 11:41:29.053317 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5766dda3-0f83-466e-9482-9b6a17644140 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:29.111680 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:29.152445 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060bf53a-c44c-4131-b62e-41526dcc2aa4 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:29.164155 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5766dda3-0f83-466e-9482-9b6a17644140 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:29.187157 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2097348-fc6c-40e5-bef4-c6e425984741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:29.187985 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2097348-fc6c-40e5-bef4-c6e425984741 None admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:29.188403 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2097348-fc6c-40e5-bef4-c6e425984741 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:29.188875 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2097348-fc6c-40e5-bef4-c6e425984741 None admin] PATH_INFO: `/v3/users` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:29.189666 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2097348-fc6c-40e5-bef4-c6e425984741 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:29.191224 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2097348-fc6c-40e5-bef4-c6e425984741 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:29.199086 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1dfd19-92d0-4975-a8cf-6d6cb138fa1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:29.199687 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1dfd19-92d0-4975-a8cf-6d6cb138fa1e None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:29.199969 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1dfd19-92d0-4975-a8cf-6d6cb138fa1e None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:29.200243 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1dfd19-92d0-4975-a8cf-6d6cb138fa1e None admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:29.200923 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1dfd19-92d0-4975-a8cf-6d6cb138fa1e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:41:29.201223 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1dfd19-92d0-4975-a8cf-6d6cb138fa1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:29.203256 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1dfd19-92d0-4975-a8cf-6d6cb138fa1e None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:29.211270 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 512/1027] 10.222.0.59 () {56 vars in 1115 bytes} [Tue Oct 4 11:41:29 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 11:41:29.216929 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1dfd19-92d0-4975-a8cf-6d6cb138fa1e None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:29.226128 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:29.289407 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 516/1028] 10.222.0.59 () {60 vars in 1132 bytes} [Tue Oct 4 11:41:29 2022] POST /identity/v3/users => generated 285 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 11:41:29.326076 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1dfd19-92d0-4975-a8cf-6d6cb138fa1e None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:29.365462 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83e5cfb-42fc-4dbb-bcbb-c1dfa9cae371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:29.366110 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83e5cfb-42fc-4dbb-bcbb-c1dfa9cae371 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:29.366384 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83e5cfb-42fc-4dbb-bcbb-c1dfa9cae371 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:29.366652 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83e5cfb-42fc-4dbb-bcbb-c1dfa9cae371 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:29.379128 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83e5cfb-42fc-4dbb-bcbb-c1dfa9cae371 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:29.380573 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83e5cfb-42fc-4dbb-bcbb-c1dfa9cae371 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:29.396026 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-f83e5cfb-42fc-4dbb-bcbb-c1dfa9cae371 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:41:29.396026 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:41:29.396026 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:41:29.396026 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:41:29.396026 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:41:29.396026 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:41:29.396026 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:41:29.396026 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:41:29.396026 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:41:29.396026 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:41:29.396026 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:41:29.396026 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:41:29.396026 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 11:41:29.396026 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 11:41:29.396026 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 11:41:29.396026 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 11:41:29.397113 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:41:29.397113 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:41:29.397113 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:41:29.397113 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:41:29.397113 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:41:29.397113 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:41:29.397113 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:41:29.397113 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:41:29.397113 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:41:29.397113 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:41:29.397113 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:41:29.397113 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:41:29.397113 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:41:29.397113 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:41:29.397113 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:41:29.397113 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:41:29.397113 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 11:41:29.403390 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 11:41:29.403390 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:41:29.403390 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:41:29.403390 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 513/1029] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Oct 4 11:41:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 11:41:29.403638 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2097348-fc6c-40e5-bef4-c6e425984741 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:29.445823 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb208bdb-4990-4df1-b347-90eea5919aa8 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:29.446164 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb208bdb-4990-4df1-b347-90eea5919aa8 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:29.446387 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb208bdb-4990-4df1-b347-90eea5919aa8 None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:29.447892 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 514/1030] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:41:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 11:41:29.453673 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1341ddd-b22c-45e5-9b4a-17b603ce8b90 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:29.453994 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1341ddd-b22c-45e5-9b4a-17b603ce8b90 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:29.454227 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1341ddd-b22c-45e5-9b4a-17b603ce8b90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:29.473345 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-f1341ddd-b22c-45e5-9b4a-17b603ce8b90 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:41:29.475183 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-f1341ddd-b22c-45e5-9b4a-17b603ce8b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:41:29.519105 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2097348-fc6c-40e5-bef4-c6e425984741 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:29.542191 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:29.542717 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:29.558610 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 515/1031] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:41:29 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 11:41:29.562929 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf6206b-f7d2-4135-b4de-aab531cf27d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:29.563544 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf6206b-f7d2-4135-b4de-aab531cf27d4 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:29.563824 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf6206b-f7d2-4135-b4de-aab531cf27d4 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:29.564099 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf6206b-f7d2-4135-b4de-aab531cf27d4 None admin] PATH_INFO: `/v3/domains` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:29.564852 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf6206b-f7d2-4135-b4de-aab531cf27d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:41:29.565157 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf6206b-f7d2-4135-b4de-aab531cf27d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:29.566534 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf6206b-f7d2-4135-b4de-aab531cf27d4 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:29.579515 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 517/1032] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Oct 4 11:41:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:41:29.585119 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1341ddd-b22c-45e5-9b4a-17b603ce8b90 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:29.687541 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1341ddd-b22c-45e5-9b4a-17b603ce8b90 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:29.724194 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4ecc2c-d6fc-482e-ac57-29c8ba22a693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:29.724856 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4ecc2c-d6fc-482e-ac57-29c8ba22a693 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:29.725136 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4ecc2c-d6fc-482e-ac57-29c8ba22a693 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:29.725403 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4ecc2c-d6fc-482e-ac57-29c8ba22a693 None admin] PATH_INFO: `/v3/users/nova` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:29.732749 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4ecc2c-d6fc-482e-ac57-29c8ba22a693 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:29.734378 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4ecc2c-d6fc-482e-ac57-29c8ba22a693 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:29.746012 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-fd4ecc2c-d6fc-482e-ac57-29c8ba22a693 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 04 11:41:29.746012 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:41:29.746012 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:41:29.746012 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:41:29.746012 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:41:29.746012 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:41:29.746012 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:41:29.746012 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:41:29.746012 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:41:29.746012 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:41:29.746012 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:41:29.746012 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:41:29.746012 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 11:41:29.746012 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 11:41:29.746012 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 11:41:29.746012 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 11:41:29.747040 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:41:29.747040 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:41:29.747040 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 11:41:29.747040 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 11:41:29.747040 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 11:41:29.747040 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 11:41:29.747040 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:41:29.747040 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:41:29.747040 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:41:29.747040 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:41:29.747040 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:41:29.747040 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:41:29.747040 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:41:29.747040 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:41:29.747040 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:41:29.747040 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:41:29.747040 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:41:29.747040 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:41:29.748797 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:41:29.748797 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:41:29.748797 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 11:41:29.748797 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 11:41:29.748797 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 11:41:29.748797 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 11:41:29.748797 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 11:41:29.748797 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 11:41:29.748797 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 04 11:41:29.748797 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:41:29.750679 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 516/1033] 10.222.0.59 () {56 vars in 1093 bytes} [Tue Oct 4 11:41:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:41:29.753604 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf6206b-f7d2-4135-b4de-aab531cf27d4 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:29.832491 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4ecc2c-d6fc-482e-ac57-29c8ba22a693 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:29.861140 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf6206b-f7d2-4135-b4de-aab531cf27d4 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:29.889220 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:29.898404 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354106dd-8c57-4f5e-878c-ad970e6edaec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:29.899493 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354106dd-8c57-4f5e-878c-ad970e6edaec None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:29.899493 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354106dd-8c57-4f5e-878c-ad970e6edaec None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:29.899687 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354106dd-8c57-4f5e-878c-ad970e6edaec None admin] PATH_INFO: `/v3/users` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:29.900297 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354106dd-8c57-4f5e-878c-ad970e6edaec None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:41:29.900631 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354106dd-8c57-4f5e-878c-ad970e6edaec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:29.902054 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354106dd-8c57-4f5e-878c-ad970e6edaec None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:29.920372 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 518/1034] 10.222.0.59 () {56 vars in 1133 bytes} [Tue Oct 4 11:41:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:41:29.926210 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354106dd-8c57-4f5e-878c-ad970e6edaec None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:29.954564 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4ecc2c-d6fc-482e-ac57-29c8ba22a693 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:29.964217 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:29.994497 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d39959-cacf-4ec4-8e28-8cafe87a6446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:29.995131 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d39959-cacf-4ec4-8e28-8cafe87a6446 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:29.995410 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d39959-cacf-4ec4-8e28-8cafe87a6446 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:29.995682 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d39959-cacf-4ec4-8e28-8cafe87a6446 None admin] PATH_INFO: `/v3/services/image` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:29.996337 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d39959-cacf-4ec4-8e28-8cafe87a6446 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:29.997726 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d39959-cacf-4ec4-8e28-8cafe87a6446 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:30.006704 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-38d39959-cacf-4ec4-8e28-8cafe87a6446 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 04 11:41:30.006704 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:41:30.006704 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 11:41:30.006704 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 11:41:30.006704 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 11:41:30.006704 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 11:41:30.006704 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 11:41:30.006704 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 11:41:30.006704 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 04 11:41:30.006704 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:41:30.006704 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 11:41:30.006704 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:41:30.006704 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:41:30.006704 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:41:30.006704 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:41:30.006704 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:41:30.006704 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:41:30.007849 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:41:30.007849 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:41:30.007849 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:41:30.007849 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:41:30.007849 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:41:30.007849 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:41:30.007849 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 11:41:30.007849 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 11:41:30.007849 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 11:41:30.007849 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 11:41:30.007849 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:41:30.007849 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:41:30.007849 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:41:30.007849 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:41:30.007849 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:41:30.007849 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:41:30.009095 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:41:30.009095 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:41:30.009095 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:41:30.009095 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:41:30.009095 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:41:30.009095 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:41:30.009095 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:41:30.009095 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:41:30.009095 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:41:30.009095 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:41:30.009095 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 11:41:30.009095 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 11:41:30.009095 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 04 11:41:30.009095 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:41:30.009095 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 517/1035] 10.222.0.59 () {56 vars in 1105 bytes} [Tue Oct 4 11:41:29 2022] GET /identity/v3/services/image => generated 86 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 11:41:30.013627 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d39959-cacf-4ec4-8e28-8cafe87a6446 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:30.039545 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354106dd-8c57-4f5e-878c-ad970e6edaec None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:30.076265 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858d453f-d27a-4982-a298-d49fe630e85b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:30.077008 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858d453f-d27a-4982-a298-d49fe630e85b None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:30.077805 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858d453f-d27a-4982-a298-d49fe630e85b None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:30.078452 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858d453f-d27a-4982-a298-d49fe630e85b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:30.119277 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d39959-cacf-4ec4-8e28-8cafe87a6446 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:30.132658 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:30.151028 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858d453f-d27a-4982-a298-d49fe630e85b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:30.152486 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858d453f-d27a-4982-a298-d49fe630e85b None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:30.154660 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3066ef02-7d4b-4282-b37c-76e85f0b3864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:30.155274 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3066ef02-7d4b-4282-b37c-76e85f0b3864 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:30.156186 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3066ef02-7d4b-4282-b37c-76e85f0b3864 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:30.156574 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3066ef02-7d4b-4282-b37c-76e85f0b3864 None admin] PATH_INFO: `/v3/services` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:30.157230 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3066ef02-7d4b-4282-b37c-76e85f0b3864 None admin] RBAC: Adding query filter params (name=image) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:41:30.157531 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3066ef02-7d4b-4282-b37c-76e85f0b3864 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:30.158885 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3066ef02-7d4b-4282-b37c-76e85f0b3864 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:30.168931 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 518/1036] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Oct 4 11:41:30 2022] GET /identity/v3/services?name=image => generated 122 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 11:41:30.169778 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3066ef02-7d4b-4282-b37c-76e85f0b3864 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:30.190726 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:30.268282 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 519/1037] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Oct 4 11:41:29 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 04 11:41:30.271111 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858d453f-d27a-4982-a298-d49fe630e85b None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:30.279387 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3066ef02-7d4b-4282-b37c-76e85f0b3864 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:30.319419 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e4b057-4a2a-483a-855d-575eb41c5e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:30.320028 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e4b057-4a2a-483a-855d-575eb41c5e31 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:30.320306 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e4b057-4a2a-483a-855d-575eb41c5e31 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:30.320625 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e4b057-4a2a-483a-855d-575eb41c5e31 None admin] PATH_INFO: `/v3/services` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:30.321290 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e4b057-4a2a-483a-855d-575eb41c5e31 None admin] RBAC: Adding query filter params (type=image) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:41:30.321589 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e4b057-4a2a-483a-855d-575eb41c5e31 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:30.322955 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e4b057-4a2a-483a-855d-575eb41c5e31 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:30.327995 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 519/1038] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Oct 4 11:41:30 2022] GET /identity/v3/services?type=image => generated 350 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:41:30.333686 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e4b057-4a2a-483a-855d-575eb41c5e31 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:30.379955 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:30.381904 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858d453f-d27a-4982-a298-d49fe630e85b None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:30.417086 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d079dfb0-4c74-4ec1-8161-a90b95274f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:30.417711 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d079dfb0-4c74-4ec1-8161-a90b95274f35 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:30.417988 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d079dfb0-4c74-4ec1-8161-a90b95274f35 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:30.418254 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d079dfb0-4c74-4ec1-8161-a90b95274f35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:30.420920 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:30.429696 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d079dfb0-4c74-4ec1-8161-a90b95274f35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:30.431168 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d079dfb0-4c74-4ec1-8161-a90b95274f35 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:30.441858 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e4b057-4a2a-483a-855d-575eb41c5e31 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:30.446763 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-d079dfb0-4c74-4ec1-8161-a90b95274f35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:41:30.446763 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:41:30.446763 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:41:30.446763 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:41:30.446763 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:41:30.446763 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:41:30.446763 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:41:30.446763 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:41:30.446763 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:41:30.446763 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:41:30.446763 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:41:30.446763 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:41:30.446763 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 11:41:30.446763 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 11:41:30.446763 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 11:41:30.446763 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 11:41:30.447726 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:41:30.447726 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:41:30.447726 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:41:30.447726 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:41:30.447726 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:41:30.447726 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:41:30.447726 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:41:30.447726 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:41:30.447726 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:41:30.447726 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:41:30.447726 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:41:30.447726 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:41:30.447726 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:41:30.447726 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:41:30.447726 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:41:30.447726 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:41:30.447726 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 11:41:30.448690 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 11:41:30.448690 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:41:30.448690 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:41:30.453346 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 520/1039] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Oct 4 11:41:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 11:41:30.454122 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d079dfb0-4c74-4ec1-8161-a90b95274f35 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:30.481024 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ba70ec-5284-4cdb-a25e-b51fb98dbbfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:30.481638 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ba70ec-5284-4cdb-a25e-b51fb98dbbfc None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:30.481918 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ba70ec-5284-4cdb-a25e-b51fb98dbbfc None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:30.482190 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ba70ec-5284-4cdb-a25e-b51fb98dbbfc None admin] PATH_INFO: `/v3/endpoints` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:30.483048 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ba70ec-5284-4cdb-a25e-b51fb98dbbfc None admin] RBAC: Adding query filter params (interface=public, service_id=893b72ebf4c94594a7b9f53e4f7ea2d2, region_id=RegionOne) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:41:30.483355 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ba70ec-5284-4cdb-a25e-b51fb98dbbfc None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:30.485174 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ba70ec-5284-4cdb-a25e-b51fb98dbbfc None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:30.490294 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 520/1040] 10.222.0.59 () {56 vars in 1251 bytes} [Tue Oct 4 11:41:30 2022] GET /identity/v3/endpoints?service_id=893b72ebf4c94594a7b9f53e4f7ea2d2&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:41:30.495853 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ba70ec-5284-4cdb-a25e-b51fb98dbbfc None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:30.579481 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d079dfb0-4c74-4ec1-8161-a90b95274f35 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:30.611017 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ba70ec-5284-4cdb-a25e-b51fb98dbbfc None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:30.614317 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:30.614691 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5905bb84-6ee8-449f-a3f5-3219018dce0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:30.615465 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5905bb84-6ee8-449f-a3f5-3219018dce0d None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:30.615579 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5905bb84-6ee8-449f-a3f5-3219018dce0d None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:30.615927 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5905bb84-6ee8-449f-a3f5-3219018dce0d None admin] PATH_INFO: `/v3/domains` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:30.616464 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5905bb84-6ee8-449f-a3f5-3219018dce0d None admin] RBAC: Adding query filter params (name=Default) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:41:30.616790 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5905bb84-6ee8-449f-a3f5-3219018dce0d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:30.618164 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5905bb84-6ee8-449f-a3f5-3219018dce0d None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:30.631180 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 521/1041] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Oct 4 11:41:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:41:30.636640 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5905bb84-6ee8-449f-a3f5-3219018dce0d None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:30.648135 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d4fe58-674e-426c-bf2d-56cdd0f2376e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:30.648785 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d4fe58-674e-426c-bf2d-56cdd0f2376e None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:30.649069 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d4fe58-674e-426c-bf2d-56cdd0f2376e None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:30.649345 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d4fe58-674e-426c-bf2d-56cdd0f2376e None admin] PATH_INFO: `/v3/services` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:30.649951 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d4fe58-674e-426c-bf2d-56cdd0f2376e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:30.651339 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d4fe58-674e-426c-bf2d-56cdd0f2376e None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:30.660073 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 521/1042] 10.222.0.59 () {56 vars in 1087 bytes} [Tue Oct 4 11:41:30 2022] GET /identity/v3/services => generated 1957 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 11:41:30.691408 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:30.747577 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5905bb84-6ee8-449f-a3f5-3219018dce0d None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:30.784260 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e88aea-0cfd-4a1f-b94a-4d4edbf2ec19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:30.784860 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e88aea-0cfd-4a1f-b94a-4d4edbf2ec19 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:30.785142 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e88aea-0cfd-4a1f-b94a-4d4edbf2ec19 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:30.785415 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e88aea-0cfd-4a1f-b94a-4d4edbf2ec19 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:30.793042 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e88aea-0cfd-4a1f-b94a-4d4edbf2ec19 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:30.794502 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e88aea-0cfd-4a1f-b94a-4d4edbf2ec19 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:30.807259 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-e5e88aea-0cfd-4a1f-b94a-4d4edbf2ec19 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 11:41:30.807259 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:41:30.807259 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:41:30.807259 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:41:30.807259 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:41:30.807259 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:41:30.807259 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:41:30.807259 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:41:30.807259 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:41:30.807259 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:41:30.807259 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:41:30.807259 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:41:30.807259 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 11:41:30.807259 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 11:41:30.807259 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 11:41:30.808285 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 11:41:30.808285 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:41:30.808285 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:41:30.808285 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:41:30.808285 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:41:30.808285 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:41:30.808285 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:41:30.808285 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:41:30.808285 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:41:30.808285 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:41:30.808285 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:41:30.808285 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:41:30.808285 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:41:30.808285 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:41:30.808285 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:41:30.808285 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:41:30.808285 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:41:30.809254 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 11:41:30.809254 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 11:41:30.809254 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 11:41:30.809254 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 11:41:30.809254 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 11:41:30.809254 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 11:41:30.809254 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 11:41:30.809254 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:41:30.809254 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 522/1043] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Oct 4 11:41:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 11:41:30.814750 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d4fe58-674e-426c-bf2d-56cdd0f2376e None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:30.922205 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d4fe58-674e-426c-bf2d-56cdd0f2376e None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:30.957223 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caef29c-e31d-46fe-92ae-78a0fda0d05d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:30.957839 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caef29c-e31d-46fe-92ae-78a0fda0d05d None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:30.958118 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caef29c-e31d-46fe-92ae-78a0fda0d05d None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:30.958388 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caef29c-e31d-46fe-92ae-78a0fda0d05d None admin] PATH_INFO: `/v3/projects` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:30.959077 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caef29c-e31d-46fe-92ae-78a0fda0d05d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:41:30.959382 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caef29c-e31d-46fe-92ae-78a0fda0d05d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:30.961649 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caef29c-e31d-46fe-92ae-78a0fda0d05d None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:30.974787 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 522/1044] 10.222.0.59 () {56 vars in 1148 bytes} [Tue Oct 4 11:41:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 11:41:30.980761 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e88aea-0cfd-4a1f-b94a-4d4edbf2ec19 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:31.082686 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e88aea-0cfd-4a1f-b94a-4d4edbf2ec19 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:31.091655 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:31.117355 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1272044-6cfc-46a0-9138-0b23e22e0109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:31.117963 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1272044-6cfc-46a0-9138-0b23e22e0109 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:31.118246 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1272044-6cfc-46a0-9138-0b23e22e0109 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:31.118522 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1272044-6cfc-46a0-9138-0b23e22e0109 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:31.119240 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1272044-6cfc-46a0-9138-0b23e22e0109 None admin] RBAC: Adding query filter params (role.id=c4a56aec8c5b46e995400c7a9e32f979, scope.project.id=39913dbe3e984f27a61493dd75381501, user.id=a8e23d1d2fe24bdf9552e7c2f0ae3424) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:41:31.119550 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1272044-6cfc-46a0-9138-0b23e22e0109 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:31.121006 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1272044-6cfc-46a0-9138-0b23e22e0109 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:31.134253 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 523/1045] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Oct 4 11:41:30 2022] GET /identity/v3/role_assignments?user.id=a8e23d1d2fe24bdf9552e7c2f0ae3424&scope.project.id=39913dbe3e984f27a61493dd75381501&role.id=c4a56aec8c5b46e995400c7a9e32f979 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:41:31.548762 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7474a3e6-935c-403e-b361-0a888d3e11b7 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:31.549092 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7474a3e6-935c-403e-b361-0a888d3e11b7 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:31.549316 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7474a3e6-935c-403e-b361-0a888d3e11b7 None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:31.550815 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 523/1046] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:41:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:41:31.556100 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbdbbf5-29d3-46f1-8b8e-62a0355757a8 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:31.556389 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbdbbf5-29d3-46f1-8b8e-62a0355757a8 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:31.556701 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbdbbf5-29d3-46f1-8b8e-62a0355757a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:31.575759 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-7dbdbbf5-29d3-46f1-8b8e-62a0355757a8 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:41:31.576973 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-7dbdbbf5-29d3-46f1-8b8e-62a0355757a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:41:31.645057 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 524/1047] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:41:31 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 11:41:31.919671 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7474a3e6-935c-403e-b361-0a888d3e11b7 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:31.949695 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:32.025443 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7474a3e6-935c-403e-b361-0a888d3e11b7 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:32.059943 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778ba74b-e00d-4882-91c5-f07c0d633ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:32.060509 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778ba74b-e00d-4882-91c5-f07c0d633ec8 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:32.060828 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778ba74b-e00d-4882-91c5-f07c0d633ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:32.061105 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778ba74b-e00d-4882-91c5-f07c0d633ec8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:32.071266 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778ba74b-e00d-4882-91c5-f07c0d633ec8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 11:41:32.075986 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-778ba74b-e00d-4882-91c5-f07c0d633ec8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 11:41:32.075986 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:41:32.075986 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:41:32.075986 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:41:32.075986 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:41:32.075986 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:41:32.075986 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:41:32.075986 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:41:32.075986 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:41:32.075986 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:41:32.075986 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:41:32.075986 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:41:32.075986 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 11:41:32.075986 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 11:41:32.075986 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 11:41:32.075986 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 11:41:32.076943 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 11:41:32.076943 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 11:41:32.076943 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 11:41:32.076943 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 11:41:32.076943 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:41:32.076943 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:41:32.076943 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:41:32.076943 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:41:32.076943 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:41:32.076943 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:41:32.076943 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:41:32.076943 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:41:32.076943 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:41:32.076943 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:41:32.076943 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:41:32.076943 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:41:32.081687 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:41:32.081687 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:41:32.081687 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:41:32.081687 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:41:32.081687 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 11:41:32.081687 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 11:41:32.081687 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 11:41:32.081687 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 11:41:32.081687 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 11:41:32.081687 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 11:41:32.081687 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 11:41:32.081687 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:41:32.081687 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 524/1048] 10.222.0.59 () {56 vars in 1096 bytes} [Tue Oct 4 11:41:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:41:32.083788 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbdbbf5-29d3-46f1-8b8e-62a0355757a8 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:32.182695 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbdbbf5-29d3-46f1-8b8e-62a0355757a8 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:32.184113 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:32.217842 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bf6f19-cf17-444c-91c1-bd3c0fc3b08a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:32.218978 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bf6f19-cf17-444c-91c1-bd3c0fc3b08a None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:32.219257 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bf6f19-cf17-444c-91c1-bd3c0fc3b08a None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:32.219530 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bf6f19-cf17-444c-91c1-bd3c0fc3b08a None admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:32.220181 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bf6f19-cf17-444c-91c1-bd3c0fc3b08a None admin] RBAC: Adding query filter params (name=admin) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:41:32.220483 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bf6f19-cf17-444c-91c1-bd3c0fc3b08a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:32.221875 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bf6f19-cf17-444c-91c1-bd3c0fc3b08a None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:32.235116 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 525/1049] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Oct 4 11:41:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:41:32.236147 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778ba74b-e00d-4882-91c5-f07c0d633ec8 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:32.323250 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:32.337947 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778ba74b-e00d-4882-91c5-f07c0d633ec8 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:32.381070 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0469da3d-99fb-4d4e-8932-141a372376cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:32.381722 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0469da3d-99fb-4d4e-8932-141a372376cb None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:32.381998 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0469da3d-99fb-4d4e-8932-141a372376cb None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:32.382271 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0469da3d-99fb-4d4e-8932-141a372376cb None admin] PATH_INFO: `/v3/users/6b456428783c41ae8d011b95c034c037` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:32.397139 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0469da3d-99fb-4d4e-8932-141a372376cb None admin] RBAC: Authorizing `identity:get_user(user_id=6b456428783c41ae8d011b95c034c037)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:32.398678 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0469da3d-99fb-4d4e-8932-141a372376cb None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:32.404981 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 525/1050] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Oct 4 11:41:32 2022] GET /identity/v3/users/6b456428783c41ae8d011b95c034c037 => generated 285 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 11:41:32.407426 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bf6f19-cf17-444c-91c1-bd3c0fc3b08a None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:32.521821 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bf6f19-cf17-444c-91c1-bd3c0fc3b08a None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:32.558397 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259688d9-2545-4f31-8944-7e2771de6fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:32.559019 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259688d9-2545-4f31-8944-7e2771de6fff None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:32.559286 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259688d9-2545-4f31-8944-7e2771de6fff None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:32.559556 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259688d9-2545-4f31-8944-7e2771de6fff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:32.591599 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:32.634852 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259688d9-2545-4f31-8944-7e2771de6fff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:32.638243 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259688d9-2545-4f31-8944-7e2771de6fff None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:32.751389 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 526/1051] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Oct 4 11:41:32 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 11:41:32.757297 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0469da3d-99fb-4d4e-8932-141a372376cb None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:32.864406 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0469da3d-99fb-4d4e-8932-141a372376cb None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:32.867781 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c573820a-344a-4711-aad0-f3bec901bd5b None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:32.868067 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c573820a-344a-4711-aad0-f3bec901bd5b None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:32.868341 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c573820a-344a-4711-aad0-f3bec901bd5b None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:32.869853 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 527/1052] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:41:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 11:41:32.875452 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65004bc5-2da9-4e53-9563-9ecd8bf7fc68 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:32.875733 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65004bc5-2da9-4e53-9563-9ecd8bf7fc68 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:32.876004 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65004bc5-2da9-4e53-9563-9ecd8bf7fc68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:32.894110 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-65004bc5-2da9-4e53-9563-9ecd8bf7fc68 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:41:32.895276 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-65004bc5-2da9-4e53-9563-9ecd8bf7fc68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:41:32.900511 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdfb387-b96d-409a-a682-068294db047a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:32.901172 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdfb387-b96d-409a-a682-068294db047a None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:32.901452 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdfb387-b96d-409a-a682-068294db047a None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:32.901726 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdfb387-b96d-409a-a682-068294db047a None admin] PATH_INFO: `/v3/projects/30707f010d67441d960612533eabceac` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:32.902864 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdfb387-b96d-409a-a682-068294db047a None admin] RBAC: Authorizing `identity:get_project(project_id=30707f010d67441d960612533eabceac)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:32.904295 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdfb387-b96d-409a-a682-068294db047a None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:32.906178 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 526/1053] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Oct 4 11:41:32 2022] GET /identity/v3/projects/30707f010d67441d960612533eabceac => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:41:32.912759 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdfb387-b96d-409a-a682-068294db047a None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:32.929632 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:32.960489 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:32.970113 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 528/1054] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:41:32 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 11:41:33.029531 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdfb387-b96d-409a-a682-068294db047a None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:33.066830 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d722765-05cb-44d2-a297-ab372aaeb451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:33.067435 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d722765-05cb-44d2-a297-ab372aaeb451 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:33.067709 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d722765-05cb-44d2-a297-ab372aaeb451 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:33.067973 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d722765-05cb-44d2-a297-ab372aaeb451 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:33.068711 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d722765-05cb-44d2-a297-ab372aaeb451 None admin] RBAC: Adding query filter params (role.id=d6e7421d1ff9451c808004b818354550, scope.project.id=30707f010d67441d960612533eabceac, user.id=6b456428783c41ae8d011b95c034c037) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:41:33.069017 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d722765-05cb-44d2-a297-ab372aaeb451 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:33.070421 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d722765-05cb-44d2-a297-ab372aaeb451 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:33.076139 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 527/1055] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Oct 4 11:41:32 2022] GET /identity/v3/role_assignments?user.id=6b456428783c41ae8d011b95c034c037&scope.project.id=30707f010d67441d960612533eabceac&role.id=d6e7421d1ff9451c808004b818354550 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:41:33.240152 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65004bc5-2da9-4e53-9563-9ecd8bf7fc68 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:33.315519 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0172c073-5293-47e7-90a0-0e9edd666b88 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:33.315781 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0172c073-5293-47e7-90a0-0e9edd666b88 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:33.316068 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0172c073-5293-47e7-90a0-0e9edd666b88 None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:33.317884 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 528/1056] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:41:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 11:41:33.325511 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ed86b6-bd36-4bdb-9055-3323eb689024 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:33.325511 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ed86b6-bd36-4bdb-9055-3323eb689024 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:33.325511 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ed86b6-bd36-4bdb-9055-3323eb689024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:33.344400 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-75ed86b6-bd36-4bdb-9055-3323eb689024 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:41:33.345189 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65004bc5-2da9-4e53-9563-9ecd8bf7fc68 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:33.345606 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-75ed86b6-bd36-4bdb-9055-3323eb689024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:41:33.382478 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf3c2c6-f4f6-48db-afbc-02a1ba66b364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:33.383108 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf3c2c6-f4f6-48db-afbc-02a1ba66b364 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:33.383386 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf3c2c6-f4f6-48db-afbc-02a1ba66b364 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:33.383658 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf3c2c6-f4f6-48db-afbc-02a1ba66b364 None admin] PATH_INFO: `/v3/services/image` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:33.384231 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf3c2c6-f4f6-48db-afbc-02a1ba66b364 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:33.385624 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf3c2c6-f4f6-48db-afbc-02a1ba66b364 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:33.395047 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-dbf3c2c6-f4f6-48db-afbc-02a1ba66b364 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 04 11:41:33.395047 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:41:33.395047 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 11:41:33.395047 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 11:41:33.395047 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 11:41:33.395047 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 11:41:33.395047 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 11:41:33.395047 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 11:41:33.395047 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 04 11:41:33.395047 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:41:33.395047 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 11:41:33.395047 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:41:33.395047 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:41:33.395047 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:41:33.395047 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:41:33.395047 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:41:33.395047 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:41:33.396090 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:41:33.396090 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:41:33.396090 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:41:33.396090 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:41:33.396090 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:41:33.396090 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:41:33.396090 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 11:41:33.396090 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 11:41:33.396090 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 11:41:33.396090 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 11:41:33.396090 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:41:33.396090 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:41:33.396090 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:41:33.396090 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:41:33.396090 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:41:33.396090 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:41:33.396998 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:41:33.396998 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:41:33.396998 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:41:33.396998 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:41:33.396998 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:41:33.396998 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:41:33.396998 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:41:33.396998 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:41:33.396998 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:41:33.396998 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:41:33.396998 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 11:41:33.396998 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 11:41:33.396998 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 04 11:41:33.396998 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:41:33.396998 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 529/1057] 10.222.0.59 () {56 vars in 1105 bytes} [Tue Oct 4 11:41:33 2022] GET /identity/v3/services/image => generated 86 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:41:33.401976 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf3c2c6-f4f6-48db-afbc-02a1ba66b364 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:33.420266 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 529/1058] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:41:33 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 11:41:33.463503 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:33.506192 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf3c2c6-f4f6-48db-afbc-02a1ba66b364 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:33.544024 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39a6f5e-99a3-48c8-b798-bf6fd5f3425d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:33.544639 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39a6f5e-99a3-48c8-b798-bf6fd5f3425d None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:33.544919 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39a6f5e-99a3-48c8-b798-bf6fd5f3425d None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:33.545187 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39a6f5e-99a3-48c8-b798-bf6fd5f3425d None admin] PATH_INFO: `/v3/services` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:33.545819 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39a6f5e-99a3-48c8-b798-bf6fd5f3425d None admin] RBAC: Adding query filter params (name=image) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:41:33.546642 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39a6f5e-99a3-48c8-b798-bf6fd5f3425d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:33.548178 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39a6f5e-99a3-48c8-b798-bf6fd5f3425d None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:33.553313 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 530/1059] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Oct 4 11:41:33 2022] GET /identity/v3/services?name=image => generated 122 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 11:41:33.558846 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ed86b6-bd36-4bdb-9055-3323eb689024 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:33.569834 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:33.663142 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ed86b6-bd36-4bdb-9055-3323eb689024 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:33.694246 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39a6f5e-99a3-48c8-b798-bf6fd5f3425d None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:33.698955 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acb4cb6-5fec-4aa7-b696-293149ede2e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:33.699581 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acb4cb6-5fec-4aa7-b696-293149ede2e9 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:33.699859 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acb4cb6-5fec-4aa7-b696-293149ede2e9 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:33.700129 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acb4cb6-5fec-4aa7-b696-293149ede2e9 None admin] PATH_INFO: `/v3/services` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:33.700803 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acb4cb6-5fec-4aa7-b696-293149ede2e9 None admin] RBAC: Adding query filter params (type=image) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:41:33.701110 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acb4cb6-5fec-4aa7-b696-293149ede2e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:33.703096 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acb4cb6-5fec-4aa7-b696-293149ede2e9 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:33.709918 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 530/1060] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Oct 4 11:41:33 2022] GET /identity/v3/services?type=image => generated 350 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 11:41:33.715128 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acb4cb6-5fec-4aa7-b696-293149ede2e9 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:33.790976 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:33.817883 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39a6f5e-99a3-48c8-b798-bf6fd5f3425d None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:33.824192 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acb4cb6-5fec-4aa7-b696-293149ede2e9 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:33.841633 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:33.853385 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f7069f-b15c-4454-99ad-7943eaa1c1c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:33.854009 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f7069f-b15c-4454-99ad-7943eaa1c1c4 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:33.855099 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f7069f-b15c-4454-99ad-7943eaa1c1c4 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:33.855099 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f7069f-b15c-4454-99ad-7943eaa1c1c4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:33.863119 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8dd8cf-4c3b-45f5-aff3-f9bf6ef7cf0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:33.863735 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8dd8cf-4c3b-45f5-aff3-f9bf6ef7cf0b None admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:33.864016 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8dd8cf-4c3b-45f5-aff3-f9bf6ef7cf0b None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:33.864289 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8dd8cf-4c3b-45f5-aff3-f9bf6ef7cf0b None admin] PATH_INFO: `/v3/endpoints` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:33.865003 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8dd8cf-4c3b-45f5-aff3-f9bf6ef7cf0b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:33.866365 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8dd8cf-4c3b-45f5-aff3-f9bf6ef7cf0b None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:33.867611 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f7069f-b15c-4454-99ad-7943eaa1c1c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 11:41:33.872700 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-c3f7069f-b15c-4454-99ad-7943eaa1c1c4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 04 11:41:33.872700 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:41:33.872700 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:41:33.872700 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:41:33.872700 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:41:33.872700 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:41:33.872700 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:41:33.872700 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:41:33.872700 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:41:33.872700 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:41:33.872700 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:41:33.872700 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:41:33.872700 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 11:41:33.872700 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 11:41:33.872700 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 11:41:33.872700 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 11:41:33.873824 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 11:41:33.873824 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 11:41:33.873824 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 11:41:33.873824 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 11:41:33.873824 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:41:33.873824 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:41:33.873824 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:41:33.873824 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:41:33.873824 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:41:33.873824 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:41:33.873824 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:41:33.873824 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:41:33.873824 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:41:33.873824 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:41:33.873824 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:41:33.873824 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:41:33.875023 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:41:33.875023 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:41:33.875023 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:41:33.875023 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:41:33.875023 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 11:41:33.875023 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 11:41:33.875023 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 11:41:33.875023 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 11:41:33.875023 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 11:41:33.875023 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 11:41:33.875023 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 04 11:41:33.875023 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:41:33.877338 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 531/1061] 10.222.0.59 () {56 vars in 1120 bytes} [Tue Oct 4 11:41:33 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 11:41:33.882824 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f7069f-b15c-4454-99ad-7943eaa1c1c4 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:33.947587 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 531/1062] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Oct 4 11:41:33 2022] POST /identity/v3/endpoints => generated 327 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 11:41:34.003891 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f7069f-b15c-4454-99ad-7943eaa1c1c4 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:34.048760 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266a7576-e05d-4417-9a7c-a07de2c8b1c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:34.049290 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266a7576-e05d-4417-9a7c-a07de2c8b1c6 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:34.049575 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266a7576-e05d-4417-9a7c-a07de2c8b1c6 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:34.049830 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266a7576-e05d-4417-9a7c-a07de2c8b1c6 None admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:34.050493 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266a7576-e05d-4417-9a7c-a07de2c8b1c6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:41:34.050789 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266a7576-e05d-4417-9a7c-a07de2c8b1c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:34.052308 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266a7576-e05d-4417-9a7c-a07de2c8b1c6 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:34.064648 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 532/1063] 10.222.0.59 () {56 vars in 1115 bytes} [Tue Oct 4 11:41:33 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 11:41:34.067555 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8dd8cf-4c3b-45f5-aff3-f9bf6ef7cf0b None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:34.177837 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8dd8cf-4c3b-45f5-aff3-f9bf6ef7cf0b None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:34.206530 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:34.214747 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e5ab7e-3082-42e0-af95-2d8ec60d0236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:34.220246 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e5ab7e-3082-42e0-af95-2d8ec60d0236 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:34.220246 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e5ab7e-3082-42e0-af95-2d8ec60d0236 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:34.220246 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e5ab7e-3082-42e0-af95-2d8ec60d0236 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:34.227598 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e5ab7e-3082-42e0-af95-2d8ec60d0236 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:34.229260 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e5ab7e-3082-42e0-af95-2d8ec60d0236 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:34.244592 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-73e5ab7e-3082-42e0-af95-2d8ec60d0236 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:41:34.244592 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:41:34.244592 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:41:34.244592 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:41:34.244592 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:41:34.244592 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:41:34.244592 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:41:34.244592 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:41:34.244592 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:41:34.244592 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:41:34.244592 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:41:34.244592 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:41:34.244592 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 11:41:34.244592 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 11:41:34.244592 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 11:41:34.244592 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 11:41:34.245611 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:41:34.245611 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:41:34.245611 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:41:34.245611 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:41:34.245611 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:41:34.245611 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:41:34.245611 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:41:34.245611 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:41:34.245611 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:41:34.245611 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:41:34.245611 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:41:34.245611 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:41:34.245611 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:41:34.245611 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:41:34.245611 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:41:34.245611 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:41:34.245611 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 11:41:34.246584 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 11:41:34.246584 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:41:34.246584 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:41:34.246584 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 532/1064] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Oct 4 11:41:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 11:41:34.252962 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266a7576-e05d-4417-9a7c-a07de2c8b1c6 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:34.298759 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:34.363218 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266a7576-e05d-4417-9a7c-a07de2c8b1c6 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:34.398959 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754cc80b-2cf3-4028-80e3-4b2be4dcac9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:34.399570 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754cc80b-2cf3-4028-80e3-4b2be4dcac9a None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:34.399848 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754cc80b-2cf3-4028-80e3-4b2be4dcac9a None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:34.400120 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754cc80b-2cf3-4028-80e3-4b2be4dcac9a None admin] PATH_INFO: `/v3/domains` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:34.400781 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754cc80b-2cf3-4028-80e3-4b2be4dcac9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:41:34.401084 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754cc80b-2cf3-4028-80e3-4b2be4dcac9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:34.402452 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754cc80b-2cf3-4028-80e3-4b2be4dcac9a None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:34.419070 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 533/1065] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Oct 4 11:41:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 11:41:34.421394 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e5ab7e-3082-42e0-af95-2d8ec60d0236 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:34.533006 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e5ab7e-3082-42e0-af95-2d8ec60d0236 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:34.569096 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d003e7f-1a03-4669-bb65-000c1202b3bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:34.569725 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d003e7f-1a03-4669-bb65-000c1202b3bb None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:34.570006 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d003e7f-1a03-4669-bb65-000c1202b3bb None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:34.570271 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d003e7f-1a03-4669-bb65-000c1202b3bb None admin] PATH_INFO: `/v3/users/nova` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:34.578621 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d003e7f-1a03-4669-bb65-000c1202b3bb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:34.580079 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d003e7f-1a03-4669-bb65-000c1202b3bb None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:34.591100 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-1d003e7f-1a03-4669-bb65-000c1202b3bb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 04 11:41:34.591100 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:41:34.591100 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:41:34.591100 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:41:34.591100 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:41:34.591100 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:41:34.591100 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:41:34.591100 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:41:34.591100 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:41:34.591100 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:41:34.591100 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:41:34.591100 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:41:34.591100 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 11:41:34.591100 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 11:41:34.591100 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 11:41:34.591100 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 11:41:34.592048 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:41:34.592048 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:41:34.592048 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 11:41:34.592048 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 11:41:34.592048 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 11:41:34.592048 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 11:41:34.592048 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:41:34.592048 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:41:34.592048 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:41:34.592048 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:41:34.592048 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:41:34.592048 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:41:34.592048 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:41:34.592048 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:41:34.592048 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:41:34.592048 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:41:34.592048 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:41:34.592048 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:41:34.594037 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:41:34.594037 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:41:34.594037 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 11:41:34.594037 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 11:41:34.594037 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 11:41:34.594037 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 11:41:34.594037 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 11:41:34.594037 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 11:41:34.594037 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 04 11:41:34.594037 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:41:34.597150 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 533/1066] 10.222.0.59 () {56 vars in 1093 bytes} [Tue Oct 4 11:41:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 11:41:34.598092 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754cc80b-2cf3-4028-80e3-4b2be4dcac9a None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:34.699893 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:34.703882 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754cc80b-2cf3-4028-80e3-4b2be4dcac9a None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:34.742484 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182b620b-3179-44c4-af99-46595d3be268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:34.743095 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b620b-3179-44c4-af99-46595d3be268 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:34.743383 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b620b-3179-44c4-af99-46595d3be268 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:34.743657 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b620b-3179-44c4-af99-46595d3be268 None admin] PATH_INFO: `/v3/users` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:34.744385 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182b620b-3179-44c4-af99-46595d3be268 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:41:34.744719 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182b620b-3179-44c4-af99-46595d3be268 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:34.746156 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182b620b-3179-44c4-af99-46595d3be268 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:34.771176 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 534/1067] 10.222.0.59 () {56 vars in 1133 bytes} [Tue Oct 4 11:41:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:41:34.772853 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d003e7f-1a03-4669-bb65-000c1202b3bb None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:34.817080 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:34.878161 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d003e7f-1a03-4669-bb65-000c1202b3bb None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:34.912813 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff84ec2f-4186-4d42-9d52-17e25bf44e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:34.913447 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff84ec2f-4186-4d42-9d52-17e25bf44e2d None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:34.913721 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff84ec2f-4186-4d42-9d52-17e25bf44e2d None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:34.913990 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff84ec2f-4186-4d42-9d52-17e25bf44e2d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:34.925384 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff84ec2f-4186-4d42-9d52-17e25bf44e2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:34.926826 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff84ec2f-4186-4d42-9d52-17e25bf44e2d None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:34.941369 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-ff84ec2f-4186-4d42-9d52-17e25bf44e2d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:41:34.941369 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:41:34.941369 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:41:34.941369 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:41:34.941369 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:41:34.941369 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:41:34.941369 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:41:34.941369 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:41:34.941369 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:41:34.941369 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:41:34.941369 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:41:34.941369 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:41:34.941369 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 11:41:34.941369 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 11:41:34.941369 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 11:41:34.941369 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 11:41:34.942335 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:41:34.942335 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:41:34.942335 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:41:34.942335 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:41:34.942335 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:41:34.942335 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:41:34.942335 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:41:34.942335 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:41:34.942335 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:41:34.942335 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:41:34.942335 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:41:34.942335 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:41:34.942335 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:41:34.942335 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:41:34.942335 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:41:34.942335 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:41:34.942335 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 11:41:34.943260 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 11:41:34.943260 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:41:34.943260 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:41:34.944917 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 534/1068] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Oct 4 11:41:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:41:34.948253 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182b620b-3179-44c4-af99-46595d3be268 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:35.055880 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182b620b-3179-44c4-af99-46595d3be268 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:35.096716 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c2605a-7a9e-475e-8fef-71de8505921c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:35.097331 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c2605a-7a9e-475e-8fef-71de8505921c None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:35.097612 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c2605a-7a9e-475e-8fef-71de8505921c None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:35.097886 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c2605a-7a9e-475e-8fef-71de8505921c None admin] PATH_INFO: `/v3/domains` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:35.098782 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c2605a-7a9e-475e-8fef-71de8505921c None admin] RBAC: Adding query filter params (name=Default) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:41:35.099087 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c2605a-7a9e-475e-8fef-71de8505921c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:35.100468 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c2605a-7a9e-475e-8fef-71de8505921c None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:35.112873 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 535/1069] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Oct 4 11:41:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:41:35.118249 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff84ec2f-4186-4d42-9d52-17e25bf44e2d None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:35.215000 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:35.226296 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff84ec2f-4186-4d42-9d52-17e25bf44e2d None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:35.260453 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542822ba-6415-4179-a4d8-34b1534bf6e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:35.261303 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542822ba-6415-4179-a4d8-34b1534bf6e8 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:35.261587 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542822ba-6415-4179-a4d8-34b1534bf6e8 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:35.261863 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542822ba-6415-4179-a4d8-34b1534bf6e8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:35.269321 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542822ba-6415-4179-a4d8-34b1534bf6e8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:35.270763 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542822ba-6415-4179-a4d8-34b1534bf6e8 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:35.283478 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-542822ba-6415-4179-a4d8-34b1534bf6e8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 11:41:35.283478 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:41:35.283478 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:41:35.283478 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:41:35.283478 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:41:35.283478 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:41:35.283478 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:41:35.283478 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:41:35.283478 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:41:35.283478 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:41:35.283478 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:41:35.283478 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:41:35.283478 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 11:41:35.283478 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 11:41:35.283478 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 11:41:35.284427 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 11:41:35.284427 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:41:35.284427 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:41:35.284427 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:41:35.284427 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:41:35.284427 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:41:35.284427 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:41:35.284427 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:41:35.284427 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:41:35.284427 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:41:35.284427 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:41:35.284427 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:41:35.284427 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:41:35.284427 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:41:35.284427 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:41:35.284427 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:41:35.284427 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:41:35.285912 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 11:41:35.285912 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 11:41:35.285912 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 11:41:35.285912 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 11:41:35.285912 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 11:41:35.285912 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 11:41:35.285912 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 11:41:35.285912 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:41:35.288966 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 535/1070] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Oct 4 11:41:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:41:35.290376 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c2605a-7a9e-475e-8fef-71de8505921c None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:35.310321 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:35.320113 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67277189-4553-41d7-8f47-714d35578461 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:35.320398 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67277189-4553-41d7-8f47-714d35578461 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:35.320726 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67277189-4553-41d7-8f47-714d35578461 None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:35.322108 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 536/1071] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:41:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 11:41:35.327546 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e001071c-1bd3-443c-80c6-ef19eefaa146 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:35.327911 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e001071c-1bd3-443c-80c6-ef19eefaa146 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:35.328191 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e001071c-1bd3-443c-80c6-ef19eefaa146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:35.346840 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-e001071c-1bd3-443c-80c6-ef19eefaa146 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:41:35.348013 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-e001071c-1bd3-443c-80c6-ef19eefaa146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:41:35.397314 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c2605a-7a9e-475e-8fef-71de8505921c None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:35.421238 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 537/1072] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:41:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 11:41:35.444345 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215195dd-82a0-4280-92ee-360d64fd0dde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:35.445385 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215195dd-82a0-4280-92ee-360d64fd0dde None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:35.445873 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215195dd-82a0-4280-92ee-360d64fd0dde None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:35.446350 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215195dd-82a0-4280-92ee-360d64fd0dde None admin] PATH_INFO: `/v3/projects` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:35.447261 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215195dd-82a0-4280-92ee-360d64fd0dde None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:41:35.447770 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215195dd-82a0-4280-92ee-360d64fd0dde None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:35.449440 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215195dd-82a0-4280-92ee-360d64fd0dde None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:35.461947 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 536/1073] 10.222.0.59 () {56 vars in 1148 bytes} [Tue Oct 4 11:41:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:41:35.468179 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e001071c-1bd3-443c-80c6-ef19eefaa146 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:35.557235 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:35.578629 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e001071c-1bd3-443c-80c6-ef19eefaa146 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:35.611016 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4ed062-396d-4348-bfb8-49c9c90d04df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:35.611679 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4ed062-396d-4348-bfb8-49c9c90d04df None admin] REQUEST_METHOD: `PUT` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:35.611958 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4ed062-396d-4348-bfb8-49c9c90d04df None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:35.612233 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4ed062-396d-4348-bfb8-49c9c90d04df None admin] PATH_INFO: `/v3/projects/39913dbe3e984f27a61493dd75381501/users/a8e23d1d2fe24bdf9552e7c2f0ae3424/roles/c4a56aec8c5b46e995400c7a9e32f979` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:35.614402 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4ed062-396d-4348-bfb8-49c9c90d04df None admin] RBAC: Authorizing `identity:create_grant(project_id=39913dbe3e984f27a61493dd75381501, user_id=a8e23d1d2fe24bdf9552e7c2f0ae3424, role_id=c4a56aec8c5b46e995400c7a9e32f979)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:35.615829 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4ed062-396d-4348-bfb8-49c9c90d04df None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:35.691621 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215195dd-82a0-4280-92ee-360d64fd0dde None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:35.700863 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 538/1074] 10.222.0.59 () {58 vars in 1439 bytes} [Tue Oct 4 11:41:35 2022] PUT /identity/v3/projects/39913dbe3e984f27a61493dd75381501/users/a8e23d1d2fe24bdf9552e7c2f0ae3424/roles/c4a56aec8c5b46e995400c7a9e32f979 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 11:41:35.791588 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:35.817429 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215195dd-82a0-4280-92ee-360d64fd0dde None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:35.855179 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6eb456-e59c-4ff5-ba66-978d916707a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:35.855732 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6eb456-e59c-4ff5-ba66-978d916707a3 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:35.856008 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6eb456-e59c-4ff5-ba66-978d916707a3 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:35.856273 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6eb456-e59c-4ff5-ba66-978d916707a3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:35.868198 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6eb456-e59c-4ff5-ba66-978d916707a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 11:41:35.874629 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-ba6eb456-e59c-4ff5-ba66-978d916707a3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 11:41:35.874629 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:41:35.874629 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:41:35.874629 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:41:35.874629 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:41:35.874629 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:41:35.874629 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:41:35.874629 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:41:35.874629 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:41:35.874629 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:41:35.874629 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:41:35.874629 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:41:35.874629 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 11:41:35.874629 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 11:41:35.874629 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 11:41:35.874629 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 11:41:35.875760 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 11:41:35.875760 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 11:41:35.875760 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 11:41:35.875760 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 11:41:35.875760 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:41:35.875760 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:41:35.875760 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:41:35.875760 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:41:35.875760 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:41:35.875760 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:41:35.875760 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:41:35.875760 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:41:35.875760 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:41:35.875760 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:41:35.875760 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:41:35.875760 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:41:35.877141 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:41:35.877141 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:41:35.877141 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:41:35.877141 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:41:35.877141 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 11:41:35.877141 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 11:41:35.877141 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 11:41:35.877141 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 11:41:35.877141 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 11:41:35.877141 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 11:41:35.877141 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 11:41:35.877141 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:41:35.877141 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 537/1075] 10.222.0.59 () {56 vars in 1096 bytes} [Tue Oct 4 11:41:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 11:41:35.882219 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4ed062-396d-4348-bfb8-49c9c90d04df None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:35.987651 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4ed062-396d-4348-bfb8-49c9c90d04df None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:36.022557 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cf0253-a83b-4f1f-a851-4ac1e8848c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:36.023169 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cf0253-a83b-4f1f-a851-4ac1e8848c3b None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:36.023450 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cf0253-a83b-4f1f-a851-4ac1e8848c3b None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:36.023722 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cf0253-a83b-4f1f-a851-4ac1e8848c3b None admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:36.024384 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cf0253-a83b-4f1f-a851-4ac1e8848c3b None admin] RBAC: Adding query filter params (name=admin) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:41:36.024714 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cf0253-a83b-4f1f-a851-4ac1e8848c3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:36.026082 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cf0253-a83b-4f1f-a851-4ac1e8848c3b None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:36.034602 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 539/1076] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Oct 4 11:41:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:41:36.040170 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6eb456-e59c-4ff5-ba66-978d916707a3 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:36.147755 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6eb456-e59c-4ff5-ba66-978d916707a3 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:36.181650 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7098de81-137d-41e3-93e6-d38fae8a5e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:36.182285 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7098de81-137d-41e3-93e6-d38fae8a5e7e None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:36.182564 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7098de81-137d-41e3-93e6-d38fae8a5e7e None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:36.182840 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7098de81-137d-41e3-93e6-d38fae8a5e7e None admin] PATH_INFO: `/v3/users/6b456428783c41ae8d011b95c034c037` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:36.183959 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7098de81-137d-41e3-93e6-d38fae8a5e7e None admin] RBAC: Authorizing `identity:get_user(user_id=6b456428783c41ae8d011b95c034c037)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:36.185428 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7098de81-137d-41e3-93e6-d38fae8a5e7e None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:36.187070 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 538/1077] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Oct 4 11:41:36 2022] GET /identity/v3/users/6b456428783c41ae8d011b95c034c037 => generated 285 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:41:36.192830 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cf0253-a83b-4f1f-a851-4ac1e8848c3b None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:36.196744 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:36.218562 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6546747-716e-49de-a29b-ca3f81f2f44e None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:36.219041 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6546747-716e-49de-a29b-ca3f81f2f44e None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:36.219219 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6546747-716e-49de-a29b-ca3f81f2f44e None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:36.220644 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 539/1078] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:41:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 11:41:36.226420 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c400a3-6501-4f2e-853b-feb78a50157b None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:36.227099 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c400a3-6501-4f2e-853b-feb78a50157b None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:36.227579 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c400a3-6501-4f2e-853b-feb78a50157b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:36.242077 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:36.247439 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-64c400a3-6501-4f2e-853b-feb78a50157b None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:41:36.248687 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-64c400a3-6501-4f2e-853b-feb78a50157b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:41:36.301469 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cf0253-a83b-4f1f-a851-4ac1e8848c3b None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:36.324695 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 540/1079] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:41:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 11:41:36.339431 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6453037-c680-4a61-926e-4863c02dd986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:36.340253 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6453037-c680-4a61-926e-4863c02dd986 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:36.340527 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6453037-c680-4a61-926e-4863c02dd986 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:36.340824 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6453037-c680-4a61-926e-4863c02dd986 None admin] PATH_INFO: `/v3/projects/30707f010d67441d960612533eabceac` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:36.341926 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6453037-c680-4a61-926e-4863c02dd986 None admin] RBAC: Authorizing `identity:get_project(project_id=30707f010d67441d960612533eabceac)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:36.344085 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6453037-c680-4a61-926e-4863c02dd986 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:36.345837 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 540/1080] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Oct 4 11:41:36 2022] GET /identity/v3/projects/30707f010d67441d960612533eabceac => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:41:36.351782 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c400a3-6501-4f2e-853b-feb78a50157b None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:36.457598 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c400a3-6501-4f2e-853b-feb78a50157b None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:36.496017 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd4f3aa-c649-49d2-9b65-dc23857fe20b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:36.496706 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd4f3aa-c649-49d2-9b65-dc23857fe20b None admin] REQUEST_METHOD: `PUT` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:36.496997 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd4f3aa-c649-49d2-9b65-dc23857fe20b None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:36.497274 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd4f3aa-c649-49d2-9b65-dc23857fe20b None admin] PATH_INFO: `/v3/projects/30707f010d67441d960612533eabceac/users/6b456428783c41ae8d011b95c034c037/roles/d6e7421d1ff9451c808004b818354550` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:36.499433 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd4f3aa-c649-49d2-9b65-dc23857fe20b None admin] RBAC: Authorizing `identity:create_grant(project_id=30707f010d67441d960612533eabceac, user_id=6b456428783c41ae8d011b95c034c037, role_id=d6e7421d1ff9451c808004b818354550)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:36.500903 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd4f3aa-c649-49d2-9b65-dc23857fe20b None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:36.503957 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:36.608275 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6453037-c680-4a61-926e-4863c02dd986 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:36.622117 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 541/1081] 10.222.0.59 () {58 vars in 1439 bytes} [Tue Oct 4 11:41:36 2022] PUT /identity/v3/projects/30707f010d67441d960612533eabceac/users/6b456428783c41ae8d011b95c034c037/roles/d6e7421d1ff9451c808004b818354550 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 11:41:36.695580 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:36.730284 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6453037-c680-4a61-926e-4863c02dd986 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:36.772988 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798a0f91-5451-4952-b6e9-622e1761972c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:36.773621 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798a0f91-5451-4952-b6e9-622e1761972c None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:36.773898 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798a0f91-5451-4952-b6e9-622e1761972c None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:36.774167 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798a0f91-5451-4952-b6e9-622e1761972c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:36.854678 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798a0f91-5451-4952-b6e9-622e1761972c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:36.856132 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798a0f91-5451-4952-b6e9-622e1761972c None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:36.924845 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:36.960634 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 541/1082] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Oct 4 11:41:36 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 04 11:41:36.962173 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd4f3aa-c649-49d2-9b65-dc23857fe20b None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:37.066670 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd4f3aa-c649-49d2-9b65-dc23857fe20b None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:37.101734 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c9da1b-ba43-46cd-a1c8-f1f00c026738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:37.102365 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c9da1b-ba43-46cd-a1c8-f1f00c026738 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:37.102644 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c9da1b-ba43-46cd-a1c8-f1f00c026738 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:37.102914 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c9da1b-ba43-46cd-a1c8-f1f00c026738 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:37.122229 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c9da1b-ba43-46cd-a1c8-f1f00c026738 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:37.123798 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c9da1b-ba43-46cd-a1c8-f1f00c026738 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:37.140321 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-c8c9da1b-ba43-46cd-a1c8-f1f00c026738 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:41:37.140321 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:41:37.140321 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:41:37.140321 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:41:37.140321 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:41:37.140321 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:41:37.140321 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:41:37.140321 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:41:37.140321 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:41:37.140321 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:41:37.140321 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:41:37.140321 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:41:37.140321 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 11:41:37.140321 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 11:41:37.140321 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 11:41:37.140321 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 11:41:37.141474 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:41:37.141474 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:41:37.141474 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:41:37.141474 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:41:37.141474 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:41:37.141474 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:41:37.141474 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:41:37.141474 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:41:37.141474 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:41:37.141474 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:41:37.141474 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:41:37.141474 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:41:37.141474 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:41:37.141474 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:41:37.141474 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:41:37.141474 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:41:37.141474 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 11:41:37.150471 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 11:41:37.150471 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:41:37.150471 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:41:37.150471 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 542/1083] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Oct 4 11:41:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:41:37.150715 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798a0f91-5451-4952-b6e9-622e1761972c None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:37.253087 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798a0f91-5451-4952-b6e9-622e1761972c None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:37.287656 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dba6f5-4e9e-4521-93dc-94e62c9e913a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:37.288641 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dba6f5-4e9e-4521-93dc-94e62c9e913a None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:37.289142 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dba6f5-4e9e-4521-93dc-94e62c9e913a None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:37.289615 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dba6f5-4e9e-4521-93dc-94e62c9e913a None admin] PATH_INFO: `/v3/domains` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:37.290451 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dba6f5-4e9e-4521-93dc-94e62c9e913a None admin] RBAC: Adding query filter params (name=Default) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:41:37.290971 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dba6f5-4e9e-4521-93dc-94e62c9e913a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:37.292529 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dba6f5-4e9e-4521-93dc-94e62c9e913a None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:37.305155 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 542/1084] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Oct 4 11:41:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:41:37.907164 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bab106f-bb31-4698-aec6-e49c92b60870 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:37.907470 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bab106f-bb31-4698-aec6-e49c92b60870 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:37.907749 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bab106f-bb31-4698-aec6-e49c92b60870 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:37.909133 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 543/1085] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:41:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:41:37.923518 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db522ae-2e52-463b-80fc-579bb245d2dd None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:37.923518 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db522ae-2e52-463b-80fc-579bb245d2dd None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:37.923518 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db522ae-2e52-463b-80fc-579bb245d2dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:37.933402 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-6db522ae-2e52-463b-80fc-579bb245d2dd None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:41:37.934568 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-6db522ae-2e52-463b-80fc-579bb245d2dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:41:37.961143 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:38.002741 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 543/1086] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:41:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 11:41:38.271407 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bab106f-bb31-4698-aec6-e49c92b60870 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:38.321957 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:38.375810 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bab106f-bb31-4698-aec6-e49c92b60870 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:38.409041 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b72033-d179-47ed-b1e2-0caa327b9321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:38.409674 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b72033-d179-47ed-b1e2-0caa327b9321 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:38.409954 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b72033-d179-47ed-b1e2-0caa327b9321 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:38.410224 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b72033-d179-47ed-b1e2-0caa327b9321 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:38.421334 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b72033-d179-47ed-b1e2-0caa327b9321 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 11:41:38.425995 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-54b72033-d179-47ed-b1e2-0caa327b9321 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 04 11:41:38.425995 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:41:38.425995 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:41:38.425995 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:41:38.425995 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:41:38.425995 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:41:38.425995 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:41:38.425995 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:41:38.425995 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:41:38.425995 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:41:38.425995 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:41:38.425995 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:41:38.425995 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 11:41:38.425995 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 11:41:38.425995 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 11:41:38.425995 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 11:41:38.427041 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 11:41:38.427041 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 11:41:38.427041 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 11:41:38.427041 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 11:41:38.427041 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:41:38.427041 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:41:38.427041 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:41:38.427041 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:41:38.427041 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:41:38.427041 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:41:38.427041 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:41:38.427041 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:41:38.427041 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:41:38.427041 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:41:38.427041 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:41:38.427041 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:41:38.427931 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:41:38.427931 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:41:38.427931 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:41:38.427931 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:41:38.427931 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 11:41:38.427931 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 11:41:38.427931 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 11:41:38.427931 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 11:41:38.427931 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 11:41:38.427931 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 11:41:38.427931 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 04 11:41:38.427931 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:41:38.432016 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 544/1087] 10.222.0.59 () {56 vars in 1120 bytes} [Tue Oct 4 11:41:38 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:41:38.433245 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db522ae-2e52-463b-80fc-579bb245d2dd None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:38.530978 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db522ae-2e52-463b-80fc-579bb245d2dd None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:38.565498 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ecc8e5-aa89-4994-b0df-a202abc1f1b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:38.566104 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ecc8e5-aa89-4994-b0df-a202abc1f1b8 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:38.566379 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ecc8e5-aa89-4994-b0df-a202abc1f1b8 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:38.566646 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ecc8e5-aa89-4994-b0df-a202abc1f1b8 None admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:38.567301 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ecc8e5-aa89-4994-b0df-a202abc1f1b8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:41:38.567602 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ecc8e5-aa89-4994-b0df-a202abc1f1b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:38.568981 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ecc8e5-aa89-4994-b0df-a202abc1f1b8 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:38.576949 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 544/1088] 10.222.0.59 () {56 vars in 1115 bytes} [Tue Oct 4 11:41:38 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:41:38.582844 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b72033-d179-47ed-b1e2-0caa327b9321 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:38.682677 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b72033-d179-47ed-b1e2-0caa327b9321 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:38.691901 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:38.715689 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891b886e-9d6d-4415-bc25-d795b9216c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:38.716308 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891b886e-9d6d-4415-bc25-d795b9216c95 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:38.716585 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891b886e-9d6d-4415-bc25-d795b9216c95 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:38.716886 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891b886e-9d6d-4415-bc25-d795b9216c95 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:38.729174 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891b886e-9d6d-4415-bc25-d795b9216c95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:38.730664 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891b886e-9d6d-4415-bc25-d795b9216c95 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:38.748434 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-891b886e-9d6d-4415-bc25-d795b9216c95 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:41:38.748434 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:41:38.748434 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:41:38.748434 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:41:38.748434 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:41:38.748434 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:41:38.748434 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:41:38.748434 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:41:38.748434 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:41:38.748434 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:41:38.748434 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:41:38.748434 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:41:38.748434 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 11:41:38.748434 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 11:41:38.748434 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 11:41:38.748434 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 11:41:38.750437 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:41:38.750437 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:41:38.750437 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:41:38.750437 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:41:38.750437 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:41:38.750437 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:41:38.750437 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:41:38.750437 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:41:38.750437 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:41:38.750437 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:41:38.750437 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:41:38.750437 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:41:38.750437 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:41:38.750437 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:41:38.750437 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:41:38.750437 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:41:38.750437 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 11:41:38.751843 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 11:41:38.751843 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:41:38.751843 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:41:38.751843 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 545/1089] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Oct 4 11:41:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 11:41:38.755706 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ecc8e5-aa89-4994-b0df-a202abc1f1b8 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:38.782306 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:38.854939 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdc1a36-3b37-4a27-b233-3f56f115500f None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:38.855219 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdc1a36-3b37-4a27-b233-3f56f115500f None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:38.855490 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdc1a36-3b37-4a27-b233-3f56f115500f None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:38.856979 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 546/1090] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:41:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 11:41:38.859107 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ecc8e5-aa89-4994-b0df-a202abc1f1b8 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:38.862850 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25ba842-8db4-4a95-b87f-4fd99f162b89 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:38.863135 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25ba842-8db4-4a95-b87f-4fd99f162b89 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:38.863411 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25ba842-8db4-4a95-b87f-4fd99f162b89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:38.881777 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-f25ba842-8db4-4a95-b87f-4fd99f162b89 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:41:38.882959 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-f25ba842-8db4-4a95-b87f-4fd99f162b89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:41:38.892929 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a0fa78-3171-4508-8206-dfedba105398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:38.893540 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a0fa78-3171-4508-8206-dfedba105398 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:38.893818 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a0fa78-3171-4508-8206-dfedba105398 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:38.894092 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a0fa78-3171-4508-8206-dfedba105398 None admin] PATH_INFO: `/v3/domains` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:38.894732 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a0fa78-3171-4508-8206-dfedba105398 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:41:38.895031 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a0fa78-3171-4508-8206-dfedba105398 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:38.896376 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a0fa78-3171-4508-8206-dfedba105398 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:38.908342 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 545/1091] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Oct 4 11:41:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:41:38.913865 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a0fa78-3171-4508-8206-dfedba105398 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:38.952376 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 547/1092] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:41:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 11:41:38.996407 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:39.011640 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a0fa78-3171-4508-8206-dfedba105398 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:39.045330 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0ed1ac-48d6-49b8-b21b-9701ba24946f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:39.046365 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0ed1ac-48d6-49b8-b21b-9701ba24946f None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:39.046636 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0ed1ac-48d6-49b8-b21b-9701ba24946f None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:39.046900 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0ed1ac-48d6-49b8-b21b-9701ba24946f None admin] PATH_INFO: `/v3/users/nova` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:39.053604 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0ed1ac-48d6-49b8-b21b-9701ba24946f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:39.055020 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0ed1ac-48d6-49b8-b21b-9701ba24946f None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:39.066752 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-dd0ed1ac-48d6-49b8-b21b-9701ba24946f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 04 11:41:39.066752 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:41:39.066752 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:41:39.066752 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:41:39.066752 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:41:39.066752 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:41:39.066752 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:41:39.066752 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:41:39.066752 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:41:39.066752 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:41:39.066752 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:41:39.066752 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:41:39.066752 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 11:41:39.066752 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 11:41:39.066752 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 11:41:39.066752 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 11:41:39.067882 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:41:39.067882 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:41:39.067882 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 11:41:39.067882 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 11:41:39.067882 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 11:41:39.067882 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 11:41:39.067882 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:41:39.067882 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:41:39.067882 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:41:39.067882 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:41:39.067882 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:41:39.067882 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:41:39.067882 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:41:39.067882 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:41:39.067882 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:41:39.067882 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:41:39.067882 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:41:39.067882 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:41:39.068870 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:41:39.068870 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:41:39.068870 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 11:41:39.068870 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 11:41:39.068870 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 11:41:39.068870 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 11:41:39.068870 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 11:41:39.068870 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 11:41:39.068870 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 04 11:41:39.068870 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:41:39.068870 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 546/1093] 10.222.0.59 () {56 vars in 1093 bytes} [Tue Oct 4 11:41:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:41:39.073935 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25ba842-8db4-4a95-b87f-4fd99f162b89 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:39.163482 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:39.173884 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25ba842-8db4-4a95-b87f-4fd99f162b89 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:39.208005 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49912403-4e28-41f6-b604-246d1bcfe572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:39.208625 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49912403-4e28-41f6-b604-246d1bcfe572 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:39.208912 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49912403-4e28-41f6-b604-246d1bcfe572 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:39.209184 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49912403-4e28-41f6-b604-246d1bcfe572 None admin] PATH_INFO: `/v3/users` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:39.209900 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49912403-4e28-41f6-b604-246d1bcfe572 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:41:39.210204 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49912403-4e28-41f6-b604-246d1bcfe572 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:39.211632 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49912403-4e28-41f6-b604-246d1bcfe572 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:39.222581 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0ed1ac-48d6-49b8-b21b-9701ba24946f None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:39.230767 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 548/1094] 10.222.0.59 () {56 vars in 1133 bytes} [Tue Oct 4 11:41:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:41:39.237436 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49912403-4e28-41f6-b604-246d1bcfe572 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:39.323619 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0ed1ac-48d6-49b8-b21b-9701ba24946f None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:39.335218 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49912403-4e28-41f6-b604-246d1bcfe572 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:39.357464 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0364d7f-ab06-4ee5-bce7-b6ab561d20b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:39.358718 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0364d7f-ab06-4ee5-bce7-b6ab561d20b4 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:39.359113 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0364d7f-ab06-4ee5-bce7-b6ab561d20b4 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:39.359483 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0364d7f-ab06-4ee5-bce7-b6ab561d20b4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:39.370258 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0364d7f-ab06-4ee5-bce7-b6ab561d20b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 11:41:39.370571 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a705590-12f5-4275-bac9-25f2011c40c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:39.371180 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a705590-12f5-4275-bac9-25f2011c40c7 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:39.371457 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a705590-12f5-4275-bac9-25f2011c40c7 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:39.371726 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a705590-12f5-4275-bac9-25f2011c40c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:39.375513 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-b0364d7f-ab06-4ee5-bce7-b6ab561d20b4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 11:41:39.375513 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:41:39.375513 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:41:39.375513 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:41:39.375513 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:41:39.375513 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:41:39.375513 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:41:39.375513 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:41:39.375513 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:41:39.375513 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:41:39.375513 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:41:39.375513 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:41:39.375513 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 11:41:39.375513 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 11:41:39.375513 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 11:41:39.375513 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 11:41:39.376462 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 11:41:39.376462 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 11:41:39.376462 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 11:41:39.376462 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 11:41:39.376462 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:41:39.376462 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:41:39.376462 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:41:39.376462 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:41:39.376462 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:41:39.376462 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:41:39.376462 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:41:39.376462 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:41:39.376462 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:41:39.376462 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:41:39.376462 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:41:39.376462 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:41:39.377380 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:41:39.377380 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:41:39.377380 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:41:39.377380 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:41:39.377380 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 11:41:39.377380 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 11:41:39.377380 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 11:41:39.377380 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 11:41:39.377380 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 11:41:39.377380 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 11:41:39.377380 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 11:41:39.377380 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:41:39.377380 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 547/1095] 10.222.0.59 () {56 vars in 1096 bytes} [Tue Oct 4 11:41:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 11:41:39.382535 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0364d7f-ab06-4ee5-bce7-b6ab561d20b4 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:39.386030 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:39.390494 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:39.440659 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a705590-12f5-4275-bac9-25f2011c40c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:39.442110 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a705590-12f5-4275-bac9-25f2011c40c7 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:39.485100 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0364d7f-ab06-4ee5-bce7-b6ab561d20b4 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:39.520961 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb94977-9542-4f92-9827-93eb318a0366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:39.521562 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb94977-9542-4f92-9827-93eb318a0366 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:39.521834 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb94977-9542-4f92-9827-93eb318a0366 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:39.522101 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb94977-9542-4f92-9827-93eb318a0366 None admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:39.522766 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb94977-9542-4f92-9827-93eb318a0366 None admin] RBAC: Adding query filter params (name=admin) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:41:39.523065 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb94977-9542-4f92-9827-93eb318a0366 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:39.524961 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb94977-9542-4f92-9827-93eb318a0366 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:39.533101 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 548/1096] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Oct 4 11:41:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 11:41:39.538876 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb94977-9542-4f92-9827-93eb318a0366 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:39.549824 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 549/1097] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Oct 4 11:41:39 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 04 11:41:39.555291 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a705590-12f5-4275-bac9-25f2011c40c7 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:39.602513 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:39.604779 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:39.637882 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb94977-9542-4f92-9827-93eb318a0366 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:39.652049 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a705590-12f5-4275-bac9-25f2011c40c7 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:39.670981 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3eeff0-c4ee-4220-a88e-275dce12f3a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:39.671601 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3eeff0-c4ee-4220-a88e-275dce12f3a2 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:39.671882 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3eeff0-c4ee-4220-a88e-275dce12f3a2 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:39.672148 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3eeff0-c4ee-4220-a88e-275dce12f3a2 None admin] PATH_INFO: `/v3/users/6b456428783c41ae8d011b95c034c037` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:39.673295 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3eeff0-c4ee-4220-a88e-275dce12f3a2 None admin] RBAC: Authorizing `identity:get_user(user_id=6b456428783c41ae8d011b95c034c037)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:39.674713 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3eeff0-c4ee-4220-a88e-275dce12f3a2 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:39.676417 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 549/1098] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Oct 4 11:41:39 2022] GET /identity/v3/users/6b456428783c41ae8d011b95c034c037 => generated 285 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 11:41:39.682054 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3eeff0-c4ee-4220-a88e-275dce12f3a2 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:39.685399 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e90ec4c-ad44-41ff-abde-732a810adfd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:39.686048 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e90ec4c-ad44-41ff-abde-732a810adfd2 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:39.686371 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e90ec4c-ad44-41ff-abde-732a810adfd2 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:39.686696 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e90ec4c-ad44-41ff-abde-732a810adfd2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:39.697166 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e90ec4c-ad44-41ff-abde-732a810adfd2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:39.698599 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e90ec4c-ad44-41ff-abde-732a810adfd2 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:39.713101 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-7e90ec4c-ad44-41ff-abde-732a810adfd2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:41:39.713101 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:41:39.713101 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:41:39.713101 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:41:39.713101 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:41:39.713101 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:41:39.713101 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:41:39.713101 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:41:39.713101 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:41:39.713101 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:41:39.713101 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:41:39.713101 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:41:39.713101 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 11:41:39.713101 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 11:41:39.713101 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 11:41:39.713101 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 11:41:39.714182 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:41:39.714182 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:41:39.714182 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:41:39.714182 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:41:39.714182 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:41:39.714182 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:41:39.714182 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:41:39.714182 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:41:39.714182 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:41:39.714182 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:41:39.714182 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:41:39.714182 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:41:39.714182 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:41:39.714182 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:41:39.714182 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:41:39.714182 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:41:39.714182 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 11:41:39.715100 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 11:41:39.715100 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:41:39.715100 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:41:39.715100 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 550/1099] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Oct 4 11:41:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:41:39.720447 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e90ec4c-ad44-41ff-abde-732a810adfd2 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:39.784497 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3eeff0-c4ee-4220-a88e-275dce12f3a2 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:39.815747 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:39.817861 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b22f26a-e1e6-46d2-9dc0-e3f01901090f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:39.818471 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e90ec4c-ad44-41ff-abde-732a810adfd2 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:39.818575 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b22f26a-e1e6-46d2-9dc0-e3f01901090f None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:39.818749 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b22f26a-e1e6-46d2-9dc0-e3f01901090f None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:39.819025 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b22f26a-e1e6-46d2-9dc0-e3f01901090f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:39.821667 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:39.855815 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0c9b19-e8e3-4b82-b9e6-c5b8062ff744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:39.856319 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0c9b19-e8e3-4b82-b9e6-c5b8062ff744 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:39.856622 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0c9b19-e8e3-4b82-b9e6-c5b8062ff744 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:39.856890 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0c9b19-e8e3-4b82-b9e6-c5b8062ff744 None admin] PATH_INFO: `/v3/domains` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:39.857524 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0c9b19-e8e3-4b82-b9e6-c5b8062ff744 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:41:39.857823 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0c9b19-e8e3-4b82-b9e6-c5b8062ff744 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:39.859458 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0c9b19-e8e3-4b82-b9e6-c5b8062ff744 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:39.870520 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 551/1100] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Oct 4 11:41:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 11:41:39.876168 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0c9b19-e8e3-4b82-b9e6-c5b8062ff744 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:39.891581 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b22f26a-e1e6-46d2-9dc0-e3f01901090f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:39.893070 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b22f26a-e1e6-46d2-9dc0-e3f01901090f None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:39.977199 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0c9b19-e8e3-4b82-b9e6-c5b8062ff744 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:39.996007 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 550/1101] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Oct 4 11:41:39 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 04 11:41:40.001915 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b22f26a-e1e6-46d2-9dc0-e3f01901090f None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:40.014883 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0cc9b2-e8d9-456f-a48f-331076b9516a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:40.015512 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0cc9b2-e8d9-456f-a48f-331076b9516a None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:40.015782 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0cc9b2-e8d9-456f-a48f-331076b9516a None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:40.016053 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0cc9b2-e8d9-456f-a48f-331076b9516a None admin] PATH_INFO: `/v3/projects/service` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:40.022497 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0cc9b2-e8d9-456f-a48f-331076b9516a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:40.023911 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0cc9b2-e8d9-456f-a48f-331076b9516a None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:40.035117 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:40.035245 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-ec0cc9b2-e8d9-456f-a48f-331076b9516a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 11:41:40.035245 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:41:40.035245 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:41:40.035245 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:41:40.035245 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:41:40.035245 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:41:40.035245 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:41:40.035245 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:41:40.035245 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:41:40.035245 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:41:40.035245 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:41:40.035245 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:41:40.035245 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 11:41:40.035245 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 11:41:40.035245 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 11:41:40.036239 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 11:41:40.036239 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:41:40.036239 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:41:40.036239 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:41:40.036239 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:41:40.036239 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:41:40.036239 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:41:40.036239 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:41:40.036239 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:41:40.036239 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:41:40.036239 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:41:40.036239 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:41:40.036239 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:41:40.036239 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:41:40.036239 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:41:40.036239 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:41:40.036239 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:41:40.037218 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 11:41:40.037218 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 11:41:40.037218 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 11:41:40.037218 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 11:41:40.037218 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 11:41:40.037218 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 11:41:40.037218 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 11:41:40.037218 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:41:40.037218 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 552/1102] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Oct 4 11:41:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 11:41:40.042099 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0cc9b2-e8d9-456f-a48f-331076b9516a None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:40.064990 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:40.099488 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b22f26a-e1e6-46d2-9dc0-e3f01901090f None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:40.133666 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c2fdc6-efb5-4910-89d5-5c57576da4a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:40.134238 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c2fdc6-efb5-4910-89d5-5c57576da4a0 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:40.134514 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c2fdc6-efb5-4910-89d5-5c57576da4a0 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:40.134784 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c2fdc6-efb5-4910-89d5-5c57576da4a0 None admin] PATH_INFO: `/v3/projects/30707f010d67441d960612533eabceac` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:40.135883 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c2fdc6-efb5-4910-89d5-5c57576da4a0 None admin] RBAC: Authorizing `identity:get_project(project_id=30707f010d67441d960612533eabceac)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:40.137319 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c2fdc6-efb5-4910-89d5-5c57576da4a0 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:40.138915 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 551/1103] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Oct 4 11:41:40 2022] GET /identity/v3/projects/30707f010d67441d960612533eabceac => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 11:41:40.142448 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0cc9b2-e8d9-456f-a48f-331076b9516a None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:40.145711 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c2fdc6-efb5-4910-89d5-5c57576da4a0 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:40.177424 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0907cbb-9add-4e51-bd87-a26da728f54d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:40.178024 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0907cbb-9add-4e51-bd87-a26da728f54d None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:40.178301 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0907cbb-9add-4e51-bd87-a26da728f54d None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:40.178573 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0907cbb-9add-4e51-bd87-a26da728f54d None admin] PATH_INFO: `/v3/projects` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:40.179249 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0907cbb-9add-4e51-bd87-a26da728f54d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:41:40.179550 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0907cbb-9add-4e51-bd87-a26da728f54d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:40.180999 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0907cbb-9add-4e51-bd87-a26da728f54d None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:40.192753 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 553/1104] 10.222.0.59 () {56 vars in 1148 bytes} [Tue Oct 4 11:41:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 11:41:40.199386 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0907cbb-9add-4e51-bd87-a26da728f54d None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:40.242978 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c2fdc6-efb5-4910-89d5-5c57576da4a0 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:40.244504 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:40.278023 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05552254-cb8c-4bf9-b888-77487028928c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:40.278620 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05552254-cb8c-4bf9-b888-77487028928c None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:40.278895 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05552254-cb8c-4bf9-b888-77487028928c None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:40.279166 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05552254-cb8c-4bf9-b888-77487028928c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:40.279930 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05552254-cb8c-4bf9-b888-77487028928c None admin] RBAC: Adding query filter params (role.id=d6e7421d1ff9451c808004b818354550, scope.project.id=30707f010d67441d960612533eabceac, user.id=6b456428783c41ae8d011b95c034c037) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:41:40.280227 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05552254-cb8c-4bf9-b888-77487028928c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:40.281221 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:40.281925 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05552254-cb8c-4bf9-b888-77487028928c None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:40.287324 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 552/1105] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Oct 4 11:41:40 2022] GET /identity/v3/role_assignments?user.id=6b456428783c41ae8d011b95c034c037&scope.project.id=30707f010d67441d960612533eabceac&role.id=d6e7421d1ff9451c808004b818354550 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 11:41:40.300456 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0907cbb-9add-4e51-bd87-a26da728f54d None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:40.337744 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f122f7-4a86-4edd-a0a8-c3517c747965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:40.338435 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f122f7-4a86-4edd-a0a8-c3517c747965 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:40.338622 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f122f7-4a86-4edd-a0a8-c3517c747965 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:40.338887 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f122f7-4a86-4edd-a0a8-c3517c747965 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:40.339620 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f122f7-4a86-4edd-a0a8-c3517c747965 None admin] RBAC: Adding query filter params (role.id=c4a56aec8c5b46e995400c7a9e32f979, scope.project.id=39913dbe3e984f27a61493dd75381501, user.id=a8e23d1d2fe24bdf9552e7c2f0ae3424) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:41:40.339926 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f122f7-4a86-4edd-a0a8-c3517c747965 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:40.341442 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f122f7-4a86-4edd-a0a8-c3517c747965 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:40.348281 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 554/1106] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Oct 4 11:41:40 2022] GET /identity/v3/role_assignments?user.id=a8e23d1d2fe24bdf9552e7c2f0ae3424&scope.project.id=39913dbe3e984f27a61493dd75381501&role.id=c4a56aec8c5b46e995400c7a9e32f979 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 11:41:42.499348 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ae2be2-f849-46cf-bfa8-a1500cbc2090 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:42.499883 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ae2be2-f849-46cf-bfa8-a1500cbc2090 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:42.499883 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ae2be2-f849-46cf-bfa8-a1500cbc2090 None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:42.501223 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 553/1107] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:41:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:41:42.506494 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a598d9-a06c-4990-b9cd-7a248a8cac3a None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:42.506878 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a598d9-a06c-4990-b9cd-7a248a8cac3a None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:42.507047 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a598d9-a06c-4990-b9cd-7a248a8cac3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:42.525498 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-d3a598d9-a06c-4990-b9cd-7a248a8cac3a None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:41:42.526675 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-d3a598d9-a06c-4990-b9cd-7a248a8cac3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:41:42.593548 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 555/1108] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:41:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 11:41:42.881902 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ae2be2-f849-46cf-bfa8-a1500cbc2090 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:42.981669 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ae2be2-f849-46cf-bfa8-a1500cbc2090 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:43.015325 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfff27d4-b76e-4c88-95c4-e25e4612f08d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:43.015940 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfff27d4-b76e-4c88-95c4-e25e4612f08d None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:43.016214 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfff27d4-b76e-4c88-95c4-e25e4612f08d None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:43.016482 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfff27d4-b76e-4c88-95c4-e25e4612f08d None admin] PATH_INFO: `/v3/domains/default` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:43.017601 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfff27d4-b76e-4c88-95c4-e25e4612f08d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:43.019002 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfff27d4-b76e-4c88-95c4-e25e4612f08d None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:43.020533 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 554/1109] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Oct 4 11:41:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:41:43.026283 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a598d9-a06c-4990-b9cd-7a248a8cac3a None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:43.099264 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:43.124479 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a598d9-a06c-4990-b9cd-7a248a8cac3a None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:43.157751 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bdf389-c26e-4c05-8dd6-33ca7eb60a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:43.158284 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bdf389-c26e-4c05-8dd6-33ca7eb60a67 None admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:43.158564 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bdf389-c26e-4c05-8dd6-33ca7eb60a67 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:43.158837 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bdf389-c26e-4c05-8dd6-33ca7eb60a67 None admin] PATH_INFO: `/v3/users` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:43.159476 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bdf389-c26e-4c05-8dd6-33ca7eb60a67 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:43.160930 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bdf389-c26e-4c05-8dd6-33ca7eb60a67 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:43.242847 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 556/1110] 10.222.0.59 () {60 vars in 1132 bytes} [Tue Oct 4 11:41:43 2022] POST /identity/v3/users => generated 286 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 11:41:45.403246 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13438f10-2298-4b28-9184-9e93b0c0da1f None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:45.403784 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13438f10-2298-4b28-9184-9e93b0c0da1f None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:45.403784 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13438f10-2298-4b28-9184-9e93b0c0da1f None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:45.405630 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 555/1111] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:41:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:41:45.410795 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a57b5d-dc59-4efe-a231-f3030b3b1fd0 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:45.411224 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a57b5d-dc59-4efe-a231-f3030b3b1fd0 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:45.411351 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a57b5d-dc59-4efe-a231-f3030b3b1fd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:45.429706 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-40a57b5d-dc59-4efe-a231-f3030b3b1fd0 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:41:45.430884 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-40a57b5d-dc59-4efe-a231-f3030b3b1fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:41:45.495666 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 557/1112] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:41:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 11:41:45.762643 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13438f10-2298-4b28-9184-9e93b0c0da1f None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:45.797449 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:45.861079 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13438f10-2298-4b28-9184-9e93b0c0da1f None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:45.901689 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc644bd-63d6-4e1f-9193-6d581606bd66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:45.902313 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc644bd-63d6-4e1f-9193-6d581606bd66 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:45.902585 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc644bd-63d6-4e1f-9193-6d581606bd66 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:45.902849 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc644bd-63d6-4e1f-9193-6d581606bd66 None admin] PATH_INFO: `/v3/roles/b6018afb40c74d19b8cadc402256f23d` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:45.904213 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc644bd-63d6-4e1f-9193-6d581606bd66 None admin] RBAC: Authorizing `identity:get_role(role_id=b6018afb40c74d19b8cadc402256f23d)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:45.905615 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc644bd-63d6-4e1f-9193-6d581606bd66 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:45.906905 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 556/1113] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Oct 4 11:41:45 2022] GET /identity/v3/roles/b6018afb40c74d19b8cadc402256f23d => generated 223 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:41:45.912743 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a57b5d-dc59-4efe-a231-f3030b3b1fd0 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:45.971364 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:46.011278 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a57b5d-dc59-4efe-a231-f3030b3b1fd0 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:46.051123 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6055ce-483c-4a0f-bda3-ac39cdb2081c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:46.051708 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6055ce-483c-4a0f-bda3-ac39cdb2081c None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:46.051985 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6055ce-483c-4a0f-bda3-ac39cdb2081c None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:46.052251 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6055ce-483c-4a0f-bda3-ac39cdb2081c None admin] PATH_INFO: `/v3/users/2de510d3e3a44ed9b9c4f399dd835e58` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:46.065910 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6055ce-483c-4a0f-bda3-ac39cdb2081c None admin] RBAC: Authorizing `identity:get_user(user_id=2de510d3e3a44ed9b9c4f399dd835e58)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:46.067357 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6055ce-483c-4a0f-bda3-ac39cdb2081c None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:46.069002 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 558/1114] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Oct 4 11:41:45 2022] GET /identity/v3/users/2de510d3e3a44ed9b9c4f399dd835e58 => generated 286 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:41:46.074804 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc644bd-63d6-4e1f-9193-6d581606bd66 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:46.169671 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc644bd-63d6-4e1f-9193-6d581606bd66 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:46.171684 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:46.202356 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dda81d3-1e5c-493b-a862-19a9512d6b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:46.203157 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dda81d3-1e5c-493b-a862-19a9512d6b46 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:46.203719 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dda81d3-1e5c-493b-a862-19a9512d6b46 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:46.203989 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dda81d3-1e5c-493b-a862-19a9512d6b46 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:46.267251 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dda81d3-1e5c-493b-a862-19a9512d6b46 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:46.268693 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dda81d3-1e5c-493b-a862-19a9512d6b46 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:46.361625 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 557/1115] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Oct 4 11:41:46 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 11:41:46.367374 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6055ce-483c-4a0f-bda3-ac39cdb2081c None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:46.464192 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6055ce-483c-4a0f-bda3-ac39cdb2081c None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:46.481261 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:46.497697 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6727465-8419-4fbc-bd1c-1ec8ea42cd18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:46.499941 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6727465-8419-4fbc-bd1c-1ec8ea42cd18 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:46.499941 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6727465-8419-4fbc-bd1c-1ec8ea42cd18 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:46.499941 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6727465-8419-4fbc-bd1c-1ec8ea42cd18 None admin] PATH_INFO: `/v3/projects/30707f010d67441d960612533eabceac` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:46.500739 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6727465-8419-4fbc-bd1c-1ec8ea42cd18 None admin] RBAC: Authorizing `identity:get_project(project_id=30707f010d67441d960612533eabceac)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:46.502161 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6727465-8419-4fbc-bd1c-1ec8ea42cd18 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:46.503761 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 559/1116] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Oct 4 11:41:46 2022] GET /identity/v3/projects/30707f010d67441d960612533eabceac => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:41:46.509889 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dda81d3-1e5c-493b-a862-19a9512d6b46 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:46.512051 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:46.615284 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dda81d3-1e5c-493b-a862-19a9512d6b46 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:46.648084 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3c2c6d-b328-4a54-ab25-41dad5660976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:46.648701 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3c2c6d-b328-4a54-ab25-41dad5660976 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:46.648977 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3c2c6d-b328-4a54-ab25-41dad5660976 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:46.649245 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3c2c6d-b328-4a54-ab25-41dad5660976 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:46.649947 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3c2c6d-b328-4a54-ab25-41dad5660976 None admin] RBAC: Adding query filter params (role.id=b6018afb40c74d19b8cadc402256f23d, scope.project.id=30707f010d67441d960612533eabceac, user.id=2de510d3e3a44ed9b9c4f399dd835e58) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:41:46.650248 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3c2c6d-b328-4a54-ab25-41dad5660976 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:46.651660 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3c2c6d-b328-4a54-ab25-41dad5660976 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:46.656955 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 558/1117] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Oct 4 11:41:46 2022] GET /identity/v3/role_assignments?user.id=2de510d3e3a44ed9b9c4f399dd835e58&scope.project.id=30707f010d67441d960612533eabceac&role.id=b6018afb40c74d19b8cadc402256f23d => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:41:48.848941 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177beaa0-aeca-4367-b2a4-3c99f10790f5 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:48.849464 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177beaa0-aeca-4367-b2a4-3c99f10790f5 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:48.849464 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177beaa0-aeca-4367-b2a4-3c99f10790f5 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:48.850740 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 560/1118] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:41:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:41:48.855909 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2436a8c7-2c2c-4fa1-a50e-1a0d97d1e016 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:48.856333 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2436a8c7-2c2c-4fa1-a50e-1a0d97d1e016 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:48.856438 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2436a8c7-2c2c-4fa1-a50e-1a0d97d1e016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:48.874349 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-2436a8c7-2c2c-4fa1-a50e-1a0d97d1e016 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:41:48.875505 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-2436a8c7-2c2c-4fa1-a50e-1a0d97d1e016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:41:48.933481 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:48.940992 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 559/1119] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:41:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 11:41:49.211513 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177beaa0-aeca-4367-b2a4-3c99f10790f5 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:49.312461 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177beaa0-aeca-4367-b2a4-3c99f10790f5 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:49.346428 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e09e7b3-e1e3-47b8-91cb-2e24be7dae66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:49.347034 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e09e7b3-e1e3-47b8-91cb-2e24be7dae66 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:49.347313 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e09e7b3-e1e3-47b8-91cb-2e24be7dae66 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:49.347585 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e09e7b3-e1e3-47b8-91cb-2e24be7dae66 None admin] PATH_INFO: `/v3/roles/b6018afb40c74d19b8cadc402256f23d` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:49.349233 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e09e7b3-e1e3-47b8-91cb-2e24be7dae66 None admin] RBAC: Authorizing `identity:get_role(role_id=b6018afb40c74d19b8cadc402256f23d)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:49.350595 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e09e7b3-e1e3-47b8-91cb-2e24be7dae66 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:49.351887 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 561/1120] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Oct 4 11:41:49 2022] GET /identity/v3/roles/b6018afb40c74d19b8cadc402256f23d => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:41:49.357642 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2436a8c7-2c2c-4fa1-a50e-1a0d97d1e016 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:49.451003 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2436a8c7-2c2c-4fa1-a50e-1a0d97d1e016 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:49.483955 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f0a298-5615-4c59-af44-578510b1d00a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:49.484495 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f0a298-5615-4c59-af44-578510b1d00a None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:49.484799 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f0a298-5615-4c59-af44-578510b1d00a None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:49.485065 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f0a298-5615-4c59-af44-578510b1d00a None admin] PATH_INFO: `/v3/users/2de510d3e3a44ed9b9c4f399dd835e58` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:49.486153 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f0a298-5615-4c59-af44-578510b1d00a None admin] RBAC: Authorizing `identity:get_user(user_id=2de510d3e3a44ed9b9c4f399dd835e58)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:49.487541 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f0a298-5615-4c59-af44-578510b1d00a None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:49.489102 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 560/1121] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Oct 4 11:41:49 2022] GET /identity/v3/users/2de510d3e3a44ed9b9c4f399dd835e58 => generated 286 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:41:49.494877 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e09e7b3-e1e3-47b8-91cb-2e24be7dae66 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:49.549445 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:49.592908 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e09e7b3-e1e3-47b8-91cb-2e24be7dae66 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:49.625942 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640e21d2-d842-4601-80a9-bc1d9ddf5fee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:49.626547 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640e21d2-d842-4601-80a9-bc1d9ddf5fee None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:49.626824 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640e21d2-d842-4601-80a9-bc1d9ddf5fee None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:49.627091 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640e21d2-d842-4601-80a9-bc1d9ddf5fee None admin] PATH_INFO: `/v3/projects/30707f010d67441d960612533eabceac` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:49.628182 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640e21d2-d842-4601-80a9-bc1d9ddf5fee None admin] RBAC: Authorizing `identity:get_project(project_id=30707f010d67441d960612533eabceac)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:49.629619 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640e21d2-d842-4601-80a9-bc1d9ddf5fee None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:49.631214 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 562/1122] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Oct 4 11:41:49 2022] GET /identity/v3/projects/30707f010d67441d960612533eabceac => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:41:49.637192 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f0a298-5615-4c59-af44-578510b1d00a None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:49.697974 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:49.734584 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f0a298-5615-4c59-af44-578510b1d00a None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:49.766589 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a24e6c-6125-4578-a051-df43be44673e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:49.767222 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a24e6c-6125-4578-a051-df43be44673e None admin] REQUEST_METHOD: `PUT` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:49.767499 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a24e6c-6125-4578-a051-df43be44673e None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:49.767768 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a24e6c-6125-4578-a051-df43be44673e None admin] PATH_INFO: `/v3/projects/30707f010d67441d960612533eabceac/users/2de510d3e3a44ed9b9c4f399dd835e58/roles/b6018afb40c74d19b8cadc402256f23d` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:49.769899 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a24e6c-6125-4578-a051-df43be44673e None admin] RBAC: Authorizing `identity:create_grant(project_id=30707f010d67441d960612533eabceac, user_id=2de510d3e3a44ed9b9c4f399dd835e58, role_id=b6018afb40c74d19b8cadc402256f23d)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:49.771313 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a24e6c-6125-4578-a051-df43be44673e None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:49.848069 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 561/1123] 10.222.0.59 () {58 vars in 1439 bytes} [Tue Oct 4 11:41:49 2022] PUT /identity/v3/projects/30707f010d67441d960612533eabceac/users/2de510d3e3a44ed9b9c4f399dd835e58/roles/b6018afb40c74d19b8cadc402256f23d => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 11:41:52.041197 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b543572-4e31-44f0-8ee3-dd948d3cd822 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:52.041759 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b543572-4e31-44f0-8ee3-dd948d3cd822 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:52.041759 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b543572-4e31-44f0-8ee3-dd948d3cd822 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:52.043106 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 563/1124] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:41:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:41:52.049458 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b98a92-7932-4a7b-8c8a-9fc73e890d24 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:52.049894 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b98a92-7932-4a7b-8c8a-9fc73e890d24 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:52.050010 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b98a92-7932-4a7b-8c8a-9fc73e890d24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:52.071467 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-c2b98a92-7932-4a7b-8c8a-9fc73e890d24 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:41:52.072674 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-c2b98a92-7932-4a7b-8c8a-9fc73e890d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:41:52.138235 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 562/1125] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:41:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 11:41:52.451783 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b543572-4e31-44f0-8ee3-dd948d3cd822 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:52.552647 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b543572-4e31-44f0-8ee3-dd948d3cd822 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:52.575138 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:52.587264 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04700ffa-64af-4ed2-b244-0be1808a338a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:52.591125 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04700ffa-64af-4ed2-b244-0be1808a338a None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:52.591125 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04700ffa-64af-4ed2-b244-0be1808a338a None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:52.591125 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04700ffa-64af-4ed2-b244-0be1808a338a None admin] PATH_INFO: `/v3/roles/b6018afb40c74d19b8cadc402256f23d` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:52.591125 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04700ffa-64af-4ed2-b244-0be1808a338a None admin] RBAC: Authorizing `identity:get_role(role_id=b6018afb40c74d19b8cadc402256f23d)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:52.591566 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04700ffa-64af-4ed2-b244-0be1808a338a None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:52.593670 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 564/1126] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Oct 4 11:41:52 2022] GET /identity/v3/roles/b6018afb40c74d19b8cadc402256f23d => generated 223 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:41:52.600085 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b98a92-7932-4a7b-8c8a-9fc73e890d24 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:52.660299 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:52.709482 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b98a92-7932-4a7b-8c8a-9fc73e890d24 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:52.748762 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9b5804-a2ed-437f-865e-c9081ae72f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:52.749460 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9b5804-a2ed-437f-865e-c9081ae72f9b None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:52.749875 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9b5804-a2ed-437f-865e-c9081ae72f9b None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:52.750275 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9b5804-a2ed-437f-865e-c9081ae72f9b None admin] PATH_INFO: `/v3/users/2de510d3e3a44ed9b9c4f399dd835e58` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:52.751465 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9b5804-a2ed-437f-865e-c9081ae72f9b None admin] RBAC: Authorizing `identity:get_user(user_id=2de510d3e3a44ed9b9c4f399dd835e58)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:52.753263 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9b5804-a2ed-437f-865e-c9081ae72f9b None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:52.754896 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 563/1127] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Oct 4 11:41:52 2022] GET /identity/v3/users/2de510d3e3a44ed9b9c4f399dd835e58 => generated 286 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:41:52.760833 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04700ffa-64af-4ed2-b244-0be1808a338a None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:52.860449 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04700ffa-64af-4ed2-b244-0be1808a338a None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:52.893589 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d9b2fa-c9c3-4681-aed9-dec851834c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:52.894183 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d9b2fa-c9c3-4681-aed9-dec851834c74 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:52.894464 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d9b2fa-c9c3-4681-aed9-dec851834c74 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:52.894733 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d9b2fa-c9c3-4681-aed9-dec851834c74 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:52.949997 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:52.961756 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d9b2fa-c9c3-4681-aed9-dec851834c74 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:52.961997 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d9b2fa-c9c3-4681-aed9-dec851834c74 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:53.077593 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 565/1128] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Oct 4 11:41:52 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 04 11:41:53.083665 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9b5804-a2ed-437f-865e-c9081ae72f9b None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:53.194374 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9b5804-a2ed-437f-865e-c9081ae72f9b None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:53.219164 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:53.231856 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682cc997-737f-4ec5-ae90-0a8f9e986022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:53.233161 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682cc997-737f-4ec5-ae90-0a8f9e986022 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:53.233489 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682cc997-737f-4ec5-ae90-0a8f9e986022 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:53.233827 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682cc997-737f-4ec5-ae90-0a8f9e986022 None admin] PATH_INFO: `/v3/projects/30707f010d67441d960612533eabceac` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:53.235057 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682cc997-737f-4ec5-ae90-0a8f9e986022 None admin] RBAC: Authorizing `identity:get_project(project_id=30707f010d67441d960612533eabceac)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:53.236734 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682cc997-737f-4ec5-ae90-0a8f9e986022 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:53.238630 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 564/1129] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Oct 4 11:41:53 2022] GET /identity/v3/projects/30707f010d67441d960612533eabceac => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:41:53.245102 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d9b2fa-c9c3-4681-aed9-dec851834c74 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:53.344329 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:53.354110 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d9b2fa-c9c3-4681-aed9-dec851834c74 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:53.389141 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264951aa-7051-4d3f-b920-21da60761d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:53.389834 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264951aa-7051-4d3f-b920-21da60761d3a None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:53.390122 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264951aa-7051-4d3f-b920-21da60761d3a None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:53.390388 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264951aa-7051-4d3f-b920-21da60761d3a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:53.391106 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264951aa-7051-4d3f-b920-21da60761d3a None admin] RBAC: Adding query filter params (role.id=b6018afb40c74d19b8cadc402256f23d, scope.project.id=30707f010d67441d960612533eabceac, user.id=2de510d3e3a44ed9b9c4f399dd835e58) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:41:53.391412 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264951aa-7051-4d3f-b920-21da60761d3a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:53.392857 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264951aa-7051-4d3f-b920-21da60761d3a None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:53.398654 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 566/1130] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Oct 4 11:41:53 2022] GET /identity/v3/role_assignments?user.id=2de510d3e3a44ed9b9c4f399dd835e58&scope.project.id=30707f010d67441d960612533eabceac&role.id=b6018afb40c74d19b8cadc402256f23d => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:41:55.779838 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e01e94-7ac6-4105-8be1-e9c3a0f6c0aa None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:55.780391 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e01e94-7ac6-4105-8be1-e9c3a0f6c0aa None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:55.780391 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e01e94-7ac6-4105-8be1-e9c3a0f6c0aa None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:55.781653 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 565/1131] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:41:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:41:55.786773 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659b7511-1fda-4394-aafa-cb6e04562e3e None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:55.787198 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659b7511-1fda-4394-aafa-cb6e04562e3e None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:55.787321 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659b7511-1fda-4394-aafa-cb6e04562e3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:55.805498 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-659b7511-1fda-4394-aafa-cb6e04562e3e None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:41:55.806656 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-659b7511-1fda-4394-aafa-cb6e04562e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:41:55.871533 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 567/1132] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:41:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 11:41:56.137611 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e01e94-7ac6-4105-8be1-e9c3a0f6c0aa None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:56.236678 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e01e94-7ac6-4105-8be1-e9c3a0f6c0aa None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:56.270005 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe577e0f-a8e4-4394-abb1-90b6d9148a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:56.270620 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe577e0f-a8e4-4394-abb1-90b6d9148a40 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:56.270896 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe577e0f-a8e4-4394-abb1-90b6d9148a40 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:56.271164 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe577e0f-a8e4-4394-abb1-90b6d9148a40 None admin] PATH_INFO: `/v3/domains/default` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:56.272248 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe577e0f-a8e4-4394-abb1-90b6d9148a40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:56.273680 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe577e0f-a8e4-4394-abb1-90b6d9148a40 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:56.275193 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 566/1133] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Oct 4 11:41:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:41:56.281080 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659b7511-1fda-4394-aafa-cb6e04562e3e None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:56.360715 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:56.375662 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659b7511-1fda-4394-aafa-cb6e04562e3e None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:56.409067 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c3c12e-83e1-42a4-84f1-c05518c8c04b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:56.409593 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c3c12e-83e1-42a4-84f1-c05518c8c04b None admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:56.409914 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c3c12e-83e1-42a4-84f1-c05518c8c04b None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:56.410182 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c3c12e-83e1-42a4-84f1-c05518c8c04b None admin] PATH_INFO: `/v3/projects` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:56.410811 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c3c12e-83e1-42a4-84f1-c05518c8c04b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:56.412226 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c3c12e-83e1-42a4-84f1-c05518c8c04b None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:56.494028 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 568/1134] 10.222.0.59 () {60 vars in 1141 bytes} [Tue Oct 4 11:41:56 2022] POST /identity/v3/projects => generated 311 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 11:41:58.656129 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7112f8f-4c14-4f54-b4c8-bbc9ae3111aa None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:58.656708 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7112f8f-4c14-4f54-b4c8-bbc9ae3111aa None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:58.656708 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7112f8f-4c14-4f54-b4c8-bbc9ae3111aa None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:58.658016 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 567/1135] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:41:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:41:58.663188 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55445bdd-b567-4254-bfc8-569becb67533 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:58.663564 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55445bdd-b567-4254-bfc8-569becb67533 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:58.663749 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55445bdd-b567-4254-bfc8-569becb67533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:58.681659 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-55445bdd-b567-4254-bfc8-569becb67533 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:41:58.682835 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-55445bdd-b567-4254-bfc8-569becb67533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:41:58.750892 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 569/1136] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:41:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 11:41:59.023811 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7112f8f-4c14-4f54-b4c8-bbc9ae3111aa None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:59.083621 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:59.124742 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7112f8f-4c14-4f54-b4c8-bbc9ae3111aa None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:59.156476 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f996b0-31d6-453f-b00a-24a095c9f783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:59.157116 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f996b0-31d6-453f-b00a-24a095c9f783 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:59.157392 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f996b0-31d6-453f-b00a-24a095c9f783 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:59.157663 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f996b0-31d6-453f-b00a-24a095c9f783 None admin] PATH_INFO: `/v3/domains/default` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:59.158742 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f996b0-31d6-453f-b00a-24a095c9f783 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:59.160142 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f996b0-31d6-453f-b00a-24a095c9f783 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:59.161682 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 568/1137] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Oct 4 11:41:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:41:59.167430 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55445bdd-b567-4254-bfc8-569becb67533 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:41:59.230758 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:59.265277 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55445bdd-b567-4254-bfc8-569becb67533 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:41:59.298385 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05e0917-36e4-4f9f-b0ab-6bf509fea807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:41:59.298919 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05e0917-36e4-4f9f-b0ab-6bf509fea807 None admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:41:59.299198 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05e0917-36e4-4f9f-b0ab-6bf509fea807 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:41:59.299470 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05e0917-36e4-4f9f-b0ab-6bf509fea807 None admin] PATH_INFO: `/v3/users` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:41:59.300111 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05e0917-36e4-4f9f-b0ab-6bf509fea807 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:41:59.301563 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05e0917-36e4-4f9f-b0ab-6bf509fea807 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:41:59.379268 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 570/1138] 10.222.0.59 () {60 vars in 1132 bytes} [Tue Oct 4 11:41:59 2022] POST /identity/v3/users => generated 286 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 11:42:01.602810 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ee2170-4690-4b6b-a0fa-07c222a0abb1 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:42:01.603353 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ee2170-4690-4b6b-a0fa-07c222a0abb1 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:42:01.603353 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ee2170-4690-4b6b-a0fa-07c222a0abb1 None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:42:01.604671 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 569/1139] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:42:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:42:01.610637 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab563ce-1933-48da-b1c2-ec1ad08fc754 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:42:01.611079 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab563ce-1933-48da-b1c2-ec1ad08fc754 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:42:01.611216 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab563ce-1933-48da-b1c2-ec1ad08fc754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:42:01.629504 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-1ab563ce-1933-48da-b1c2-ec1ad08fc754 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:42:01.630676 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-1ab563ce-1933-48da-b1c2-ec1ad08fc754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:42:01.694995 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 571/1140] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:42:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 11:42:01.968963 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ee2170-4690-4b6b-a0fa-07c222a0abb1 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:42:02.134617 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ee2170-4690-4b6b-a0fa-07c222a0abb1 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:42:02.159579 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:42:02.167726 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae1ead3-6051-413a-a3f1-74454875d8da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:42:02.168343 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae1ead3-6051-413a-a3f1-74454875d8da None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:42:02.172027 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae1ead3-6051-413a-a3f1-74454875d8da None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:42:02.172027 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae1ead3-6051-413a-a3f1-74454875d8da None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:42:02.178561 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae1ead3-6051-413a-a3f1-74454875d8da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 11:42:02.183208 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-fae1ead3-6051-413a-a3f1-74454875d8da None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 11:42:02.183208 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:42:02.183208 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:42:02.183208 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:42:02.183208 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:42:02.183208 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:42:02.183208 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:42:02.183208 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:42:02.183208 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:42:02.183208 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:42:02.183208 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:42:02.183208 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:42:02.183208 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 11:42:02.183208 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 11:42:02.183208 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 11:42:02.183208 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 11:42:02.184391 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 11:42:02.184391 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 11:42:02.184391 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 11:42:02.184391 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 11:42:02.184391 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:42:02.184391 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:42:02.184391 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:42:02.184391 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:42:02.184391 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:42:02.184391 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:42:02.184391 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:42:02.184391 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:42:02.184391 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:42:02.184391 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:42:02.184391 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:42:02.184391 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:42:02.185767 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:42:02.185767 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:42:02.185767 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:42:02.185767 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:42:02.185767 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 11:42:02.185767 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 11:42:02.185767 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 11:42:02.185767 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 11:42:02.185767 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 11:42:02.185767 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 11:42:02.185767 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 11:42:02.185767 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:42:02.185767 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 570/1141] 10.222.0.59 () {56 vars in 1096 bytes} [Tue Oct 4 11:42:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:42:02.190426 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab563ce-1933-48da-b1c2-ec1ad08fc754 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:42:02.242134 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:42:02.288021 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab563ce-1933-48da-b1c2-ec1ad08fc754 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:42:02.320796 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381799c2-824e-4296-93b1-8491fc6df910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:42:02.321385 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381799c2-824e-4296-93b1-8491fc6df910 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:42:02.321659 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381799c2-824e-4296-93b1-8491fc6df910 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:42:02.321926 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381799c2-824e-4296-93b1-8491fc6df910 None admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:42:02.322568 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381799c2-824e-4296-93b1-8491fc6df910 None admin] RBAC: Adding query filter params (name=admin) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:42:02.322864 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381799c2-824e-4296-93b1-8491fc6df910 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:42:02.324220 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381799c2-824e-4296-93b1-8491fc6df910 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:42:02.332738 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 572/1142] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Oct 4 11:42:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:42:02.338848 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae1ead3-6051-413a-a3f1-74454875d8da None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:42:02.438401 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae1ead3-6051-413a-a3f1-74454875d8da None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:42:02.471686 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33aec3e-06f4-498c-a461-ddd423f0ba2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:42:02.472298 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33aec3e-06f4-498c-a461-ddd423f0ba2d None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:42:02.472573 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33aec3e-06f4-498c-a461-ddd423f0ba2d None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:42:02.472874 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33aec3e-06f4-498c-a461-ddd423f0ba2d None admin] PATH_INFO: `/v3/users/2754bdc9097245c98fab6d9135f21cf7` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:42:02.486559 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33aec3e-06f4-498c-a461-ddd423f0ba2d None admin] RBAC: Authorizing `identity:get_user(user_id=2754bdc9097245c98fab6d9135f21cf7)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:42:02.487980 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33aec3e-06f4-498c-a461-ddd423f0ba2d None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:42:02.489559 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 571/1143] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Oct 4 11:42:02 2022] GET /identity/v3/users/2754bdc9097245c98fab6d9135f21cf7 => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:42:02.495393 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381799c2-824e-4296-93b1-8491fc6df910 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:42:02.592208 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381799c2-824e-4296-93b1-8491fc6df910 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:42:02.605407 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:42:02.626803 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13446a0-4f1d-497f-9f05-73465ad15215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:42:02.627407 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13446a0-4f1d-497f-9f05-73465ad15215 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:42:02.627685 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13446a0-4f1d-497f-9f05-73465ad15215 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:42:02.627951 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13446a0-4f1d-497f-9f05-73465ad15215 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:42:02.693443 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13446a0-4f1d-497f-9f05-73465ad15215 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:42:02.694868 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13446a0-4f1d-497f-9f05-73465ad15215 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:42:02.791487 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 573/1144] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Oct 4 11:42:02 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 11:42:02.798234 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33aec3e-06f4-498c-a461-ddd423f0ba2d None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:42:02.842585 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:42:02.895139 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33aec3e-06f4-498c-a461-ddd423f0ba2d None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:42:02.928346 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7a701f-eef5-497b-9a32-ff22aebb6dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:42:02.928996 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7a701f-eef5-497b-9a32-ff22aebb6dcd None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:42:02.929279 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7a701f-eef5-497b-9a32-ff22aebb6dcd None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:42:02.929555 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7a701f-eef5-497b-9a32-ff22aebb6dcd None admin] PATH_INFO: `/v3/projects/c3382109b189477c9e144a5a548c21dd` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:42:02.930658 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7a701f-eef5-497b-9a32-ff22aebb6dcd None admin] RBAC: Authorizing `identity:get_project(project_id=c3382109b189477c9e144a5a548c21dd)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:42:02.932075 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7a701f-eef5-497b-9a32-ff22aebb6dcd None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:42:02.933706 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 572/1145] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Oct 4 11:42:02 2022] GET /identity/v3/projects/c3382109b189477c9e144a5a548c21dd => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:42:02.939914 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13446a0-4f1d-497f-9f05-73465ad15215 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:42:02.954887 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:42:03.036510 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13446a0-4f1d-497f-9f05-73465ad15215 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:42:03.069990 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b092fc0-b1f8-4dae-a282-220f7cdb02f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:42:03.070519 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b092fc0-b1f8-4dae-a282-220f7cdb02f2 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:42:03.070799 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b092fc0-b1f8-4dae-a282-220f7cdb02f2 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:42:03.071073 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b092fc0-b1f8-4dae-a282-220f7cdb02f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:42:03.071784 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b092fc0-b1f8-4dae-a282-220f7cdb02f2 None admin] RBAC: Adding query filter params (role.id=d6e7421d1ff9451c808004b818354550, scope.project.id=c3382109b189477c9e144a5a548c21dd, user.id=2754bdc9097245c98fab6d9135f21cf7) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:42:03.072090 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b092fc0-b1f8-4dae-a282-220f7cdb02f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:42:03.073536 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b092fc0-b1f8-4dae-a282-220f7cdb02f2 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:42:03.078751 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 574/1146] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Oct 4 11:42:02 2022] GET /identity/v3/role_assignments?user.id=2754bdc9097245c98fab6d9135f21cf7&scope.project.id=c3382109b189477c9e144a5a548c21dd&role.id=d6e7421d1ff9451c808004b818354550 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:42:05.222867 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cfe515-d065-475d-b421-42c57e5493d1 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:42:05.223679 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cfe515-d065-475d-b421-42c57e5493d1 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:42:05.223679 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cfe515-d065-475d-b421-42c57e5493d1 None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:42:05.225017 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 573/1147] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:42:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:42:05.230076 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b70a78-f84b-42ea-8e63-4bfb0a28e394 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:42:05.230496 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b70a78-f84b-42ea-8e63-4bfb0a28e394 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:42:05.230635 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b70a78-f84b-42ea-8e63-4bfb0a28e394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:42:05.250849 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-e7b70a78-f84b-42ea-8e63-4bfb0a28e394 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:42:05.252023 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-e7b70a78-f84b-42ea-8e63-4bfb0a28e394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:42:05.316069 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 575/1148] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:42:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 11:42:05.588492 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cfe515-d065-475d-b421-42c57e5493d1 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:42:05.686076 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cfe515-d065-475d-b421-42c57e5493d1 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:42:05.699397 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:42:05.720625 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d802ae-8422-4cc8-982b-fa1d2c27f7ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:42:05.726277 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d802ae-8422-4cc8-982b-fa1d2c27f7ce None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:42:05.726277 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d802ae-8422-4cc8-982b-fa1d2c27f7ce None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:42:05.726277 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d802ae-8422-4cc8-982b-fa1d2c27f7ce None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:42:05.731683 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d802ae-8422-4cc8-982b-fa1d2c27f7ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 11:42:05.736347 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-46d802ae-8422-4cc8-982b-fa1d2c27f7ce None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 11:42:05.736347 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:42:05.736347 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:42:05.736347 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:42:05.736347 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:42:05.736347 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:42:05.736347 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:42:05.736347 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:42:05.736347 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:42:05.736347 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:42:05.736347 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:42:05.736347 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:42:05.736347 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 11:42:05.736347 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 11:42:05.736347 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 11:42:05.736347 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 11:42:05.737472 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 11:42:05.737472 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 11:42:05.737472 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 11:42:05.737472 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 11:42:05.737472 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:42:05.737472 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:42:05.737472 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:42:05.737472 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:42:05.737472 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:42:05.737472 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:42:05.737472 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:42:05.737472 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:42:05.737472 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:42:05.737472 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:42:05.737472 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:42:05.737472 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:42:05.738364 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:42:05.738364 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:42:05.738364 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:42:05.738364 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:42:05.738364 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 11:42:05.738364 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 11:42:05.738364 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 11:42:05.738364 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 11:42:05.738364 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 11:42:05.738364 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 11:42:05.738364 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 11:42:05.738364 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:42:05.738364 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 574/1149] 10.222.0.59 () {56 vars in 1096 bytes} [Tue Oct 4 11:42:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:42:05.743821 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b70a78-f84b-42ea-8e63-4bfb0a28e394 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:42:05.754327 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:42:05.860928 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b70a78-f84b-42ea-8e63-4bfb0a28e394 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:42:05.904141 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1d066a-6624-480d-a061-ad1a376c20ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:42:05.904759 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1d066a-6624-480d-a061-ad1a376c20ab None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:42:05.905035 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1d066a-6624-480d-a061-ad1a376c20ab None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:42:05.905300 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1d066a-6624-480d-a061-ad1a376c20ab None admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:42:05.905944 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1d066a-6624-480d-a061-ad1a376c20ab None admin] RBAC: Adding query filter params (name=admin) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:42:05.906240 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1d066a-6624-480d-a061-ad1a376c20ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:42:05.907631 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1d066a-6624-480d-a061-ad1a376c20ab None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:42:05.915340 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 576/1150] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Oct 4 11:42:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:42:05.922054 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d802ae-8422-4cc8-982b-fa1d2c27f7ce None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:42:06.020958 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d802ae-8422-4cc8-982b-fa1d2c27f7ce None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:42:06.054421 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4662cb2-ab85-4cbc-8ab7-ad64c9127a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:42:06.055040 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4662cb2-ab85-4cbc-8ab7-ad64c9127a0a None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:42:06.055318 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4662cb2-ab85-4cbc-8ab7-ad64c9127a0a None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:42:06.055595 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4662cb2-ab85-4cbc-8ab7-ad64c9127a0a None admin] PATH_INFO: `/v3/users/2754bdc9097245c98fab6d9135f21cf7` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:42:06.056727 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4662cb2-ab85-4cbc-8ab7-ad64c9127a0a None admin] RBAC: Authorizing `identity:get_user(user_id=2754bdc9097245c98fab6d9135f21cf7)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:42:06.058148 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4662cb2-ab85-4cbc-8ab7-ad64c9127a0a None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:42:06.060227 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 575/1151] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Oct 4 11:42:05 2022] GET /identity/v3/users/2754bdc9097245c98fab6d9135f21cf7 => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:42:06.067286 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1d066a-6624-480d-a061-ad1a376c20ab None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:42:06.141229 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:42:06.171941 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1d066a-6624-480d-a061-ad1a376c20ab None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:42:06.212887 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30764081-3a35-4f38-94e2-32704d7a76e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:42:06.213523 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30764081-3a35-4f38-94e2-32704d7a76e3 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:42:06.213802 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30764081-3a35-4f38-94e2-32704d7a76e3 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:42:06.214075 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30764081-3a35-4f38-94e2-32704d7a76e3 None admin] PATH_INFO: `/v3/projects/c3382109b189477c9e144a5a548c21dd` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:42:06.215181 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30764081-3a35-4f38-94e2-32704d7a76e3 None admin] RBAC: Authorizing `identity:get_project(project_id=c3382109b189477c9e144a5a548c21dd)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:42:06.217229 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30764081-3a35-4f38-94e2-32704d7a76e3 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:42:06.218859 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 577/1152] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Oct 4 11:42:06 2022] GET /identity/v3/projects/c3382109b189477c9e144a5a548c21dd => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:42:06.225146 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4662cb2-ab85-4cbc-8ab7-ad64c9127a0a None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:42:06.269699 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:42:06.324844 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4662cb2-ab85-4cbc-8ab7-ad64c9127a0a None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:42:06.358264 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428aa9fc-7bfb-4b60-9ae6-d0ca313fdf61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:42:06.358917 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428aa9fc-7bfb-4b60-9ae6-d0ca313fdf61 None admin] REQUEST_METHOD: `PUT` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:42:06.359197 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428aa9fc-7bfb-4b60-9ae6-d0ca313fdf61 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:42:06.359469 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428aa9fc-7bfb-4b60-9ae6-d0ca313fdf61 None admin] PATH_INFO: `/v3/projects/c3382109b189477c9e144a5a548c21dd/users/2754bdc9097245c98fab6d9135f21cf7/roles/d6e7421d1ff9451c808004b818354550` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:42:06.361384 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428aa9fc-7bfb-4b60-9ae6-d0ca313fdf61 None admin] RBAC: Authorizing `identity:create_grant(project_id=c3382109b189477c9e144a5a548c21dd, user_id=2754bdc9097245c98fab6d9135f21cf7, role_id=d6e7421d1ff9451c808004b818354550)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:42:06.362805 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428aa9fc-7bfb-4b60-9ae6-d0ca313fdf61 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:42:06.429923 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 576/1153] 10.222.0.59 () {58 vars in 1439 bytes} [Tue Oct 4 11:42:06 2022] PUT /identity/v3/projects/c3382109b189477c9e144a5a548c21dd/users/2754bdc9097245c98fab6d9135f21cf7/roles/d6e7421d1ff9451c808004b818354550 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 11:42:08.556136 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692ac06e-5e74-4a88-9ec8-6e3ed5fc6831 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:42:08.556710 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692ac06e-5e74-4a88-9ec8-6e3ed5fc6831 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:42:08.556710 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692ac06e-5e74-4a88-9ec8-6e3ed5fc6831 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:42:08.558043 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 578/1154] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:42:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:42:08.564200 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9b9f26-2f77-489d-aa20-156b1bfe76db None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:42:08.564675 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9b9f26-2f77-489d-aa20-156b1bfe76db None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:42:08.564781 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9b9f26-2f77-489d-aa20-156b1bfe76db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:42:08.583209 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-2d9b9f26-2f77-489d-aa20-156b1bfe76db None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:42:08.584407 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-2d9b9f26-2f77-489d-aa20-156b1bfe76db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:42:08.649202 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 577/1155] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:42:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 11:42:08.922526 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692ac06e-5e74-4a88-9ec8-6e3ed5fc6831 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:42:09.019486 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692ac06e-5e74-4a88-9ec8-6e3ed5fc6831 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:42:09.052536 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdb71cb-06ff-4182-b790-60111832af06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:42:09.053174 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb71cb-06ff-4182-b790-60111832af06 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:42:09.053447 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb71cb-06ff-4182-b790-60111832af06 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:42:09.053712 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb71cb-06ff-4182-b790-60111832af06 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:42:09.060451 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:42:09.064286 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdb71cb-06ff-4182-b790-60111832af06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 11:42:09.068956 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-5fdb71cb-06ff-4182-b790-60111832af06 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 11:42:09.068956 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:42:09.068956 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:42:09.068956 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:42:09.068956 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:42:09.068956 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:42:09.068956 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:42:09.068956 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:42:09.068956 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:42:09.068956 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:42:09.068956 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:42:09.068956 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:42:09.068956 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 11:42:09.068956 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 11:42:09.068956 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 11:42:09.068956 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 11:42:09.069901 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 11:42:09.069901 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 11:42:09.069901 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 11:42:09.069901 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 11:42:09.069901 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:42:09.069901 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:42:09.069901 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:42:09.069901 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:42:09.069901 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:42:09.069901 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:42:09.069901 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:42:09.069901 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:42:09.069901 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:42:09.069901 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:42:09.069901 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:42:09.069901 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:42:09.071031 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:42:09.071031 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:42:09.071031 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:42:09.071031 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:42:09.071031 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 11:42:09.071031 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 11:42:09.071031 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 11:42:09.071031 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 11:42:09.071031 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 11:42:09.071031 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 11:42:09.071031 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 11:42:09.071031 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:42:09.071031 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 579/1156] 10.222.0.59 () {56 vars in 1096 bytes} [Tue Oct 4 11:42:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:42:09.077126 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9b9f26-2f77-489d-aa20-156b1bfe76db None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:42:09.107205 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:42:09.174416 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9b9f26-2f77-489d-aa20-156b1bfe76db None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:42:09.208376 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa26b676-2c1d-4a88-ba5b-b81d4c65ab95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:42:09.209000 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa26b676-2c1d-4a88-ba5b-b81d4c65ab95 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:42:09.209278 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa26b676-2c1d-4a88-ba5b-b81d4c65ab95 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:42:09.209549 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa26b676-2c1d-4a88-ba5b-b81d4c65ab95 None admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:42:09.210199 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa26b676-2c1d-4a88-ba5b-b81d4c65ab95 None admin] RBAC: Adding query filter params (name=admin) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:42:09.210500 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa26b676-2c1d-4a88-ba5b-b81d4c65ab95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:42:09.211850 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa26b676-2c1d-4a88-ba5b-b81d4c65ab95 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:42:09.219970 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 578/1157] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Oct 4 11:42:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:42:09.226141 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdb71cb-06ff-4182-b790-60111832af06 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:42:09.323096 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdb71cb-06ff-4182-b790-60111832af06 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:42:09.356301 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ccd4b6-eb31-49ba-b2b8-4a28e138fb93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:42:09.356960 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ccd4b6-eb31-49ba-b2b8-4a28e138fb93 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:42:09.357239 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ccd4b6-eb31-49ba-b2b8-4a28e138fb93 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:42:09.357510 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ccd4b6-eb31-49ba-b2b8-4a28e138fb93 None admin] PATH_INFO: `/v3/users/2754bdc9097245c98fab6d9135f21cf7` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:42:09.358613 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ccd4b6-eb31-49ba-b2b8-4a28e138fb93 None admin] RBAC: Authorizing `identity:get_user(user_id=2754bdc9097245c98fab6d9135f21cf7)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:42:09.360023 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ccd4b6-eb31-49ba-b2b8-4a28e138fb93 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:42:09.361591 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 580/1158] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Oct 4 11:42:09 2022] GET /identity/v3/users/2754bdc9097245c98fab6d9135f21cf7 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:42:09.367369 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa26b676-2c1d-4a88-ba5b-b81d4c65ab95 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:42:09.455596 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:42:09.463726 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa26b676-2c1d-4a88-ba5b-b81d4c65ab95 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:42:09.495075 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a71badb-925b-416a-aa4b-87d83d784f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:42:09.495663 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a71badb-925b-416a-aa4b-87d83d784f33 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:42:09.495940 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a71badb-925b-416a-aa4b-87d83d784f33 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:42:09.496208 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a71badb-925b-416a-aa4b-87d83d784f33 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:42:09.564890 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a71badb-925b-416a-aa4b-87d83d784f33 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:42:09.566325 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a71badb-925b-416a-aa4b-87d83d784f33 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:42:09.650762 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:42:09.660242 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 579/1159] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Oct 4 11:42:09 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 11:42:09.666339 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ccd4b6-eb31-49ba-b2b8-4a28e138fb93 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:42:09.732915 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:42:09.765902 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ccd4b6-eb31-49ba-b2b8-4a28e138fb93 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:42:09.798694 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd6968a-8d9a-4801-ad66-e37157ed86a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:42:09.799304 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd6968a-8d9a-4801-ad66-e37157ed86a8 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:42:09.799583 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd6968a-8d9a-4801-ad66-e37157ed86a8 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:42:09.799851 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd6968a-8d9a-4801-ad66-e37157ed86a8 None admin] PATH_INFO: `/v3/projects/c3382109b189477c9e144a5a548c21dd` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:42:09.800973 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd6968a-8d9a-4801-ad66-e37157ed86a8 None admin] RBAC: Authorizing `identity:get_project(project_id=c3382109b189477c9e144a5a548c21dd)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:42:09.802390 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd6968a-8d9a-4801-ad66-e37157ed86a8 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:42:09.803993 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 581/1160] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Oct 4 11:42:09 2022] GET /identity/v3/projects/c3382109b189477c9e144a5a548c21dd => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:42:09.810316 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a71badb-925b-416a-aa4b-87d83d784f33 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:42:09.909910 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a71badb-925b-416a-aa4b-87d83d784f33 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:42:09.943377 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309d1178-0928-4bfb-8a8b-f7cdf28543fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:42:09.943971 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309d1178-0928-4bfb-8a8b-f7cdf28543fc None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:42:09.944253 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309d1178-0928-4bfb-8a8b-f7cdf28543fc None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:42:09.944529 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309d1178-0928-4bfb-8a8b-f7cdf28543fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:42:09.945268 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309d1178-0928-4bfb-8a8b-f7cdf28543fc None admin] RBAC: Adding query filter params (role.id=d6e7421d1ff9451c808004b818354550, scope.project.id=c3382109b189477c9e144a5a548c21dd, user.id=2754bdc9097245c98fab6d9135f21cf7) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:42:09.945577 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309d1178-0928-4bfb-8a8b-f7cdf28543fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:42:09.946998 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309d1178-0928-4bfb-8a8b-f7cdf28543fc None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:42:09.952721 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 580/1161] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Oct 4 11:42:09 2022] GET /identity/v3/role_assignments?user.id=2754bdc9097245c98fab6d9135f21cf7&scope.project.id=c3382109b189477c9e144a5a548c21dd&role.id=d6e7421d1ff9451c808004b818354550 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 11:42:12.121270 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac59a2a1-3284-4b0d-a0cd-6433bf38e0b4 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:42:12.121819 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac59a2a1-3284-4b0d-a0cd-6433bf38e0b4 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:42:12.121973 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac59a2a1-3284-4b0d-a0cd-6433bf38e0b4 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:42:12.123557 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 582/1162] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:42:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:42:12.129093 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b840abdf-c879-4ba3-9fcf-734be56d584e None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:42:12.129511 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b840abdf-c879-4ba3-9fcf-734be56d584e None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:42:12.129641 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b840abdf-c879-4ba3-9fcf-734be56d584e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:42:12.148323 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-b840abdf-c879-4ba3-9fcf-734be56d584e None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:42:12.149544 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-b840abdf-c879-4ba3-9fcf-734be56d584e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:42:12.198195 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:42:12.214411 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 581/1163] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:42:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 11:42:12.486737 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac59a2a1-3284-4b0d-a0cd-6433bf38e0b4 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:42:12.587248 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac59a2a1-3284-4b0d-a0cd-6433bf38e0b4 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:42:12.620487 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4400c83-275e-4e31-a7b8-841b6e523aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:42:12.621099 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4400c83-275e-4e31-a7b8-841b6e523aa8 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:42:12.621372 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4400c83-275e-4e31-a7b8-841b6e523aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:42:12.622191 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4400c83-275e-4e31-a7b8-841b6e523aa8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:42:12.624661 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:42:12.687190 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4400c83-275e-4e31-a7b8-841b6e523aa8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:42:12.688635 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4400c83-275e-4e31-a7b8-841b6e523aa8 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:42:12.782491 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 583/1164] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Oct 4 11:42:12 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 11:42:12.788362 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b840abdf-c879-4ba3-9fcf-734be56d584e None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:42:12.882693 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b840abdf-c879-4ba3-9fcf-734be56d584e None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:42:12.914130 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1966dd-0c4f-47dc-8628-72fa250eb28f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:42:12.919095 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1966dd-0c4f-47dc-8628-72fa250eb28f None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:42:12.919095 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1966dd-0c4f-47dc-8628-72fa250eb28f None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:42:12.919095 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1966dd-0c4f-47dc-8628-72fa250eb28f None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:42:12.922284 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1966dd-0c4f-47dc-8628-72fa250eb28f None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:42:12.923712 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1966dd-0c4f-47dc-8628-72fa250eb28f None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:42:12.935542 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-3b1966dd-0c4f-47dc-8628-72fa250eb28f None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Oct 04 11:42:12.935542 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:42:12.935542 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 04 11:42:12.935542 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 04 11:42:12.935542 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 11:42:12.935542 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 11:42:12.935542 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 11:42:12.935542 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 11:42:12.935542 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Oct 04 11:42:12.935542 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:42:12.935542 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 11:42:12.935542 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:42:12.935542 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:42:12.935542 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:42:12.935542 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:42:12.935542 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:42:12.935542 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:42:12.936898 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:42:12.936898 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:42:12.936898 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:42:12.936898 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:42:12.936898 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:42:12.936898 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:42:12.936898 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 11:42:12.936898 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 11:42:12.936898 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 11:42:12.936898 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 11:42:12.936898 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:42:12.936898 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:42:12.936898 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:42:12.936898 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:42:12.936898 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:42:12.936898 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:42:12.938156 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:42:12.938156 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:42:12.938156 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:42:12.938156 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:42:12.938156 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:42:12.938156 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:42:12.938156 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:42:12.938156 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:42:12.938156 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:42:12.938156 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:42:12.938156 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 04 11:42:12.938156 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 11:42:12.938156 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Oct 04 11:42:12.938156 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:42:12.938156 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 582/1165] 10.222.0.59 () {56 vars in 1117 bytes} [Tue Oct 4 11:42:12 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:42:12.942649 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4400c83-275e-4e31-a7b8-841b6e523aa8 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:42:12.975769 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:42:13.038851 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4400c83-275e-4e31-a7b8-841b6e523aa8 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:42:13.071355 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574b6d95-c8d7-4f00-9c86-0faf1fa3bc19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:42:13.074567 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b6d95-c8d7-4f00-9c86-0faf1fa3bc19 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:42:13.074567 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b6d95-c8d7-4f00-9c86-0faf1fa3bc19 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:42:13.074567 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b6d95-c8d7-4f00-9c86-0faf1fa3bc19 None admin] PATH_INFO: `/v3/domains` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:42:13.074567 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574b6d95-c8d7-4f00-9c86-0faf1fa3bc19 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:42:13.074567 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574b6d95-c8d7-4f00-9c86-0faf1fa3bc19 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:42:13.074989 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574b6d95-c8d7-4f00-9c86-0faf1fa3bc19 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:42:13.081670 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 584/1166] 10.222.0.59 () {56 vars in 1115 bytes} [Tue Oct 4 11:42:12 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:42:15.271998 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89317f6a-5eac-4251-a386-6b1f4fa4afb8 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:42:15.272533 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89317f6a-5eac-4251-a386-6b1f4fa4afb8 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:42:15.272533 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89317f6a-5eac-4251-a386-6b1f4fa4afb8 None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:42:15.273958 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 583/1167] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:42:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:42:15.279782 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f1b278-4415-4311-a4db-a8a7cf75cf5a None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:42:15.280205 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f1b278-4415-4311-a4db-a8a7cf75cf5a None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:42:15.280334 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f1b278-4415-4311-a4db-a8a7cf75cf5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:42:15.298552 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-12f1b278-4415-4311-a4db-a8a7cf75cf5a None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:42:15.299715 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-12f1b278-4415-4311-a4db-a8a7cf75cf5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:42:15.363401 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 585/1168] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:42:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 11:42:15.642171 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89317f6a-5eac-4251-a386-6b1f4fa4afb8 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:42:15.688877 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:42:15.741453 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89317f6a-5eac-4251-a386-6b1f4fa4afb8 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:42:15.773671 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e347a5c8-a767-4c84-8f89-5d96b71c4380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:42:15.774263 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e347a5c8-a767-4c84-8f89-5d96b71c4380 None admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:42:15.774538 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e347a5c8-a767-4c84-8f89-5d96b71c4380 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:42:15.774807 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e347a5c8-a767-4c84-8f89-5d96b71c4380 None admin] PATH_INFO: `/v3/domains` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:42:15.775510 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e347a5c8-a767-4c84-8f89-5d96b71c4380 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:42:15.776833 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e347a5c8-a767-4c84-8f89-5d96b71c4380 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:42:15.836466 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 584/1169] 10.222.0.59 () {60 vars in 1138 bytes} [Tue Oct 4 11:42:15 2022] POST /identity/v3/domains => generated 267 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 11:42:18.016174 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbdcd81-fc83-4fdc-b6e7-f8c8ad435d05 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:42:18.016725 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbdcd81-fc83-4fdc-b6e7-f8c8ad435d05 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:42:18.016838 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbdcd81-fc83-4fdc-b6e7-f8c8ad435d05 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:42:18.018106 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 586/1170] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:42:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:42:18.023523 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2637fda-360d-4a8b-96c6-3fbfbf18ea76 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:42:18.023954 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2637fda-360d-4a8b-96c6-3fbfbf18ea76 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:42:18.024061 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2637fda-360d-4a8b-96c6-3fbfbf18ea76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:42:18.043640 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-f2637fda-360d-4a8b-96c6-3fbfbf18ea76 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:42:18.044858 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-f2637fda-360d-4a8b-96c6-3fbfbf18ea76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:42:18.109586 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 585/1171] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:42:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 11:42:18.388391 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbdcd81-fc83-4fdc-b6e7-f8c8ad435d05 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:42:18.415849 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:42:18.487218 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbdcd81-fc83-4fdc-b6e7-f8c8ad435d05 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:42:18.520549 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ef11b5-1c20-4a33-b4b7-a5eb8f153e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:42:18.521201 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ef11b5-1c20-4a33-b4b7-a5eb8f153e82 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:42:18.521480 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ef11b5-1c20-4a33-b4b7-a5eb8f153e82 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:42:18.521753 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ef11b5-1c20-4a33-b4b7-a5eb8f153e82 None admin] PATH_INFO: `/v3/domains/780e757e16af4557afb86f35f7f4b586` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:42:18.532124 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ef11b5-1c20-4a33-b4b7-a5eb8f153e82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=780e757e16af4557afb86f35f7f4b586)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:42:18.533593 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ef11b5-1c20-4a33-b4b7-a5eb8f153e82 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:42:18.535170 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 587/1172] 10.222.0.59 () {56 vars in 1183 bytes} [Tue Oct 4 11:42:18 2022] GET /identity/v3/domains/780e757e16af4557afb86f35f7f4b586 => generated 267 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 11:42:18.540938 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2637fda-360d-4a8b-96c6-3fbfbf18ea76 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:42:18.575258 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:42:18.638184 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2637fda-360d-4a8b-96c6-3fbfbf18ea76 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:42:18.670642 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488ebf9d-a3b6-4600-9f7f-3cb250621ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:42:18.671167 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488ebf9d-a3b6-4600-9f7f-3cb250621ec3 None admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:42:18.671440 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488ebf9d-a3b6-4600-9f7f-3cb250621ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:42:18.671706 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488ebf9d-a3b6-4600-9f7f-3cb250621ec3 None admin] PATH_INFO: `/v3/projects` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:42:18.672340 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488ebf9d-a3b6-4600-9f7f-3cb250621ec3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:42:18.673874 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488ebf9d-a3b6-4600-9f7f-3cb250621ec3 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:42:18.768048 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 586/1173] 10.222.0.59 () {60 vars in 1141 bytes} [Tue Oct 4 11:42:18 2022] POST /identity/v3/projects => generated 361 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 11:42:20.999433 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09000520-53b0-49c2-b4b5-8985fd4c8ad9 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:42:20.999991 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09000520-53b0-49c2-b4b5-8985fd4c8ad9 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:42:20.999991 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09000520-53b0-49c2-b4b5-8985fd4c8ad9 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:42:21.001343 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 588/1174] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:42:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:42:21.006644 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e369f7-26a9-4e5d-bf37-2105c74f9976 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:42:21.007071 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e369f7-26a9-4e5d-bf37-2105c74f9976 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:42:21.007197 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e369f7-26a9-4e5d-bf37-2105c74f9976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:42:21.025613 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-f6e369f7-26a9-4e5d-bf37-2105c74f9976 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:42:21.026783 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-f6e369f7-26a9-4e5d-bf37-2105c74f9976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:42:21.091791 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 587/1175] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:42:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 11:42:21.377208 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09000520-53b0-49c2-b4b5-8985fd4c8ad9 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:42:21.464379 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:42:21.476963 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09000520-53b0-49c2-b4b5-8985fd4c8ad9 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:42:21.511051 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefda157-1a47-4e2c-90fd-a7694c65987b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:42:21.512216 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefda157-1a47-4e2c-90fd-a7694c65987b None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:42:21.512502 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefda157-1a47-4e2c-90fd-a7694c65987b None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:42:21.512809 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefda157-1a47-4e2c-90fd-a7694c65987b None admin] PATH_INFO: `/v3/domains/780e757e16af4557afb86f35f7f4b586` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:42:21.513923 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefda157-1a47-4e2c-90fd-a7694c65987b None admin] RBAC: Authorizing `identity:get_domain(domain_id=780e757e16af4557afb86f35f7f4b586)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:42:21.515355 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefda157-1a47-4e2c-90fd-a7694c65987b None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:42:21.516950 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 589/1176] 10.222.0.59 () {56 vars in 1183 bytes} [Tue Oct 4 11:42:21 2022] GET /identity/v3/domains/780e757e16af4557afb86f35f7f4b586 => generated 267 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:42:21.522683 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e369f7-26a9-4e5d-bf37-2105c74f9976 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:42:21.541376 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:42:21.620728 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e369f7-26a9-4e5d-bf37-2105c74f9976 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:42:21.657077 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b972d3-4569-4ef6-a285-9951d6af7d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:42:21.657610 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b972d3-4569-4ef6-a285-9951d6af7d3d None admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:42:21.657889 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b972d3-4569-4ef6-a285-9951d6af7d3d None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:42:21.658164 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b972d3-4569-4ef6-a285-9951d6af7d3d None admin] PATH_INFO: `/v3/users` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:42:21.658867 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b972d3-4569-4ef6-a285-9951d6af7d3d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:42:21.660311 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b972d3-4569-4ef6-a285-9951d6af7d3d None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:42:21.744238 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 588/1177] 10.222.0.59 () {60 vars in 1132 bytes} [Tue Oct 4 11:42:21 2022] POST /identity/v3/users => generated 311 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 11:42:23.926254 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0974c1bb-62f6-4b26-9c6e-ae5d956c7891 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:42:23.926758 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0974c1bb-62f6-4b26-9c6e-ae5d956c7891 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:42:23.926865 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0974c1bb-62f6-4b26-9c6e-ae5d956c7891 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:42:23.928176 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 590/1178] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:42:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:42:23.934200 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77b98f6-96cd-4ba6-8a8a-96b54b5b4fa5 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:42:23.934698 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77b98f6-96cd-4ba6-8a8a-96b54b5b4fa5 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:42:23.934807 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77b98f6-96cd-4ba6-8a8a-96b54b5b4fa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:42:23.952681 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-d77b98f6-96cd-4ba6-8a8a-96b54b5b4fa5 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:42:23.954352 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-d77b98f6-96cd-4ba6-8a8a-96b54b5b4fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:42:24.022971 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 589/1179] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:42:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 11:42:24.301551 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0974c1bb-62f6-4b26-9c6e-ae5d956c7891 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:42:24.403001 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0974c1bb-62f6-4b26-9c6e-ae5d956c7891 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:42:24.435528 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4e1431-1135-463b-95ba-65ad48392e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:42:24.436144 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4e1431-1135-463b-95ba-65ad48392e22 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:42:24.436414 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4e1431-1135-463b-95ba-65ad48392e22 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:42:24.436703 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4e1431-1135-463b-95ba-65ad48392e22 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:42:24.446313 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4e1431-1135-463b-95ba-65ad48392e22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 11:42:24.450996 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-fa4e1431-1135-463b-95ba-65ad48392e22 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 11:42:24.450996 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:42:24.450996 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:42:24.450996 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:42:24.450996 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:42:24.450996 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:42:24.450996 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:42:24.450996 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:42:24.450996 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:42:24.450996 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:42:24.450996 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:42:24.450996 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:42:24.450996 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 11:42:24.450996 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 11:42:24.450996 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 11:42:24.450996 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 11:42:24.452212 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 11:42:24.452212 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 11:42:24.452212 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 11:42:24.452212 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 11:42:24.452212 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:42:24.452212 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:42:24.452212 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:42:24.452212 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:42:24.452212 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:42:24.452212 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:42:24.452212 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:42:24.452212 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:42:24.452212 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:42:24.452212 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:42:24.452212 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:42:24.452212 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:42:24.453380 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:42:24.453380 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:42:24.453380 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:42:24.453380 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:42:24.453380 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 11:42:24.453380 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 11:42:24.453380 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 11:42:24.453380 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 11:42:24.453380 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 11:42:24.453380 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 11:42:24.453380 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 11:42:24.453380 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:42:24.453380 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 591/1180] 10.222.0.59 () {56 vars in 1096 bytes} [Tue Oct 4 11:42:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:42:24.458418 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77b98f6-96cd-4ba6-8a8a-96b54b5b4fa5 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:42:24.461487 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:42:24.555221 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77b98f6-96cd-4ba6-8a8a-96b54b5b4fa5 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:42:24.587723 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8468981-f7a5-452a-9a8f-33776a3d84cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:42:24.588320 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8468981-f7a5-452a-9a8f-33776a3d84cc None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:42:24.588609 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8468981-f7a5-452a-9a8f-33776a3d84cc None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:42:24.588899 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8468981-f7a5-452a-9a8f-33776a3d84cc None admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:42:24.590317 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8468981-f7a5-452a-9a8f-33776a3d84cc None admin] RBAC: Adding query filter params (name=admin) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:42:24.590625 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8468981-f7a5-452a-9a8f-33776a3d84cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:42:24.591973 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8468981-f7a5-452a-9a8f-33776a3d84cc None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:42:24.599904 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 590/1181] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Oct 4 11:42:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:42:24.606028 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4e1431-1135-463b-95ba-65ad48392e22 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:42:24.624047 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:42:24.704247 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4e1431-1135-463b-95ba-65ad48392e22 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:42:24.738328 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d609ebf0-9574-4c04-b0d2-43672827b528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:42:24.738940 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d609ebf0-9574-4c04-b0d2-43672827b528 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:42:24.739216 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d609ebf0-9574-4c04-b0d2-43672827b528 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:42:24.739487 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d609ebf0-9574-4c04-b0d2-43672827b528 None admin] PATH_INFO: `/v3/users/380a9546a9df4fd7a2afb493ba875de7` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:42:24.752459 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d609ebf0-9574-4c04-b0d2-43672827b528 None admin] RBAC: Authorizing `identity:get_user(user_id=380a9546a9df4fd7a2afb493ba875de7)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:42:24.753910 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d609ebf0-9574-4c04-b0d2-43672827b528 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:42:24.755478 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 592/1182] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Oct 4 11:42:24 2022] GET /identity/v3/users/380a9546a9df4fd7a2afb493ba875de7 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:42:24.761178 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8468981-f7a5-452a-9a8f-33776a3d84cc None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:42:24.825561 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:42:24.859189 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8468981-f7a5-452a-9a8f-33776a3d84cc None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:42:24.891834 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee81528e-d462-4767-8430-ae67ee5d0105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:42:24.892421 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee81528e-d462-4767-8430-ae67ee5d0105 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:42:24.892724 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee81528e-d462-4767-8430-ae67ee5d0105 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:42:24.892992 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee81528e-d462-4767-8430-ae67ee5d0105 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:42:24.957203 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee81528e-d462-4767-8430-ae67ee5d0105 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:42:24.958627 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee81528e-d462-4767-8430-ae67ee5d0105 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:42:25.018319 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:42:25.051833 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 591/1183] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Oct 4 11:42:24 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 11:42:25.057720 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d609ebf0-9574-4c04-b0d2-43672827b528 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:42:25.130485 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:42:25.154991 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d609ebf0-9574-4c04-b0d2-43672827b528 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:42:25.187748 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031b026c-6092-43ee-b2b1-eb57fa7ab5b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:42:25.188348 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031b026c-6092-43ee-b2b1-eb57fa7ab5b6 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:42:25.188644 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031b026c-6092-43ee-b2b1-eb57fa7ab5b6 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:42:25.188922 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031b026c-6092-43ee-b2b1-eb57fa7ab5b6 None admin] PATH_INFO: `/v3/projects/5d74fc5b981242518f8380d49f6f4c26` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:42:25.190011 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031b026c-6092-43ee-b2b1-eb57fa7ab5b6 None admin] RBAC: Authorizing `identity:get_project(project_id=5d74fc5b981242518f8380d49f6f4c26)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:42:25.191429 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031b026c-6092-43ee-b2b1-eb57fa7ab5b6 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:42:25.193047 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 593/1184] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Oct 4 11:42:25 2022] GET /identity/v3/projects/5d74fc5b981242518f8380d49f6f4c26 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:42:25.200104 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee81528e-d462-4767-8430-ae67ee5d0105 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:42:25.296371 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee81528e-d462-4767-8430-ae67ee5d0105 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:42:25.329083 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0634fbf5-2faa-45e8-a467-dde9ed897706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:42:25.330024 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0634fbf5-2faa-45e8-a467-dde9ed897706 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:42:25.330306 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0634fbf5-2faa-45e8-a467-dde9ed897706 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:42:25.330574 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0634fbf5-2faa-45e8-a467-dde9ed897706 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:42:25.331288 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0634fbf5-2faa-45e8-a467-dde9ed897706 None admin] RBAC: Adding query filter params (role.id=d6e7421d1ff9451c808004b818354550, scope.project.id=5d74fc5b981242518f8380d49f6f4c26, user.id=380a9546a9df4fd7a2afb493ba875de7) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:42:25.331843 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0634fbf5-2faa-45e8-a467-dde9ed897706 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:42:25.333339 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0634fbf5-2faa-45e8-a467-dde9ed897706 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:42:25.340927 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 592/1185] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Oct 4 11:42:25 2022] GET /identity/v3/role_assignments?user.id=380a9546a9df4fd7a2afb493ba875de7&scope.project.id=5d74fc5b981242518f8380d49f6f4c26&role.id=d6e7421d1ff9451c808004b818354550 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:42:27.460566 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bed3193-e5d2-47a6-9541-e78fab879ae8 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:42:27.461154 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bed3193-e5d2-47a6-9541-e78fab879ae8 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:42:27.461154 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bed3193-e5d2-47a6-9541-e78fab879ae8 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:42:27.462468 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 594/1186] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:42:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:42:27.467766 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2137e3ae-2509-460a-90a3-b7e73582525a None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:42:27.468199 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2137e3ae-2509-460a-90a3-b7e73582525a None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:42:27.468294 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2137e3ae-2509-460a-90a3-b7e73582525a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:42:27.486380 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-2137e3ae-2509-460a-90a3-b7e73582525a None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:42:27.487559 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-2137e3ae-2509-460a-90a3-b7e73582525a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:42:27.510923 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:42:27.553878 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 593/1187] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:42:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 11:42:27.833092 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bed3193-e5d2-47a6-9541-e78fab879ae8 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:42:27.930886 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bed3193-e5d2-47a6-9541-e78fab879ae8 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:42:27.964175 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd5f3ab-da02-46bc-8521-77da224fbc06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:42:27.965773 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd5f3ab-da02-46bc-8521-77da224fbc06 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:42:27.966049 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd5f3ab-da02-46bc-8521-77da224fbc06 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:42:27.966313 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd5f3ab-da02-46bc-8521-77da224fbc06 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:42:27.976288 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd5f3ab-da02-46bc-8521-77da224fbc06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 11:42:27.981973 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-4fd5f3ab-da02-46bc-8521-77da224fbc06 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 11:42:27.981973 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:42:27.981973 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:42:27.981973 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:42:27.981973 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:42:27.981973 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:42:27.981973 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:42:27.981973 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:42:27.981973 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:42:27.981973 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:42:27.981973 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:42:27.981973 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:42:27.981973 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 11:42:27.981973 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 11:42:27.981973 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 11:42:27.981973 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 11:42:27.983099 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 11:42:27.983099 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 11:42:27.983099 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 11:42:27.983099 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 11:42:27.983099 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:42:27.983099 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:42:27.983099 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:42:27.983099 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:42:27.983099 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:42:27.983099 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:42:27.983099 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:42:27.983099 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:42:27.983099 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:42:27.983099 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:42:27.983099 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:42:27.983099 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:42:27.984010 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:42:27.984010 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:42:27.984010 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:42:27.984010 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:42:27.984010 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 11:42:27.984010 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 11:42:27.984010 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 11:42:27.984010 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 11:42:27.984010 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 11:42:27.984010 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 11:42:27.984010 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 11:42:27.984010 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:42:27.984010 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 595/1188] 10.222.0.59 () {56 vars in 1096 bytes} [Tue Oct 4 11:42:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:42:27.989052 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2137e3ae-2509-460a-90a3-b7e73582525a None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:42:28.090423 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2137e3ae-2509-460a-90a3-b7e73582525a None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:42:28.125734 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd4bf0b-45e9-478b-86f4-af945afcb00f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:42:28.126607 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd4bf0b-45e9-478b-86f4-af945afcb00f None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:42:28.127055 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd4bf0b-45e9-478b-86f4-af945afcb00f None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:42:28.127487 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd4bf0b-45e9-478b-86f4-af945afcb00f None admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:42:28.128296 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd4bf0b-45e9-478b-86f4-af945afcb00f None admin] RBAC: Adding query filter params (name=admin) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:42:28.128783 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd4bf0b-45e9-478b-86f4-af945afcb00f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:42:28.130148 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd4bf0b-45e9-478b-86f4-af945afcb00f None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:42:28.138994 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 594/1189] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Oct 4 11:42:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:42:28.144730 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd5f3ab-da02-46bc-8521-77da224fbc06 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:42:28.148842 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:42:28.250230 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd5f3ab-da02-46bc-8521-77da224fbc06 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:42:28.284551 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c041fc-d11c-4c3d-bc95-5a35c927fac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:42:28.285205 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c041fc-d11c-4c3d-bc95-5a35c927fac2 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:42:28.285485 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c041fc-d11c-4c3d-bc95-5a35c927fac2 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:42:28.285757 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c041fc-d11c-4c3d-bc95-5a35c927fac2 None admin] PATH_INFO: `/v3/users/380a9546a9df4fd7a2afb493ba875de7` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:42:28.286857 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c041fc-d11c-4c3d-bc95-5a35c927fac2 None admin] RBAC: Authorizing `identity:get_user(user_id=380a9546a9df4fd7a2afb493ba875de7)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:42:28.288284 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c041fc-d11c-4c3d-bc95-5a35c927fac2 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:42:28.289878 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 596/1190] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Oct 4 11:42:28 2022] GET /identity/v3/users/380a9546a9df4fd7a2afb493ba875de7 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:42:28.296299 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd4bf0b-45e9-478b-86f4-af945afcb00f None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:42:28.320259 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:42:28.394815 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd4bf0b-45e9-478b-86f4-af945afcb00f None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:42:28.427188 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf003e6a-0c00-40fd-9177-f613cde05753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:42:28.427804 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf003e6a-0c00-40fd-9177-f613cde05753 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:42:28.428082 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf003e6a-0c00-40fd-9177-f613cde05753 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:42:28.428353 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf003e6a-0c00-40fd-9177-f613cde05753 None admin] PATH_INFO: `/v3/projects/5d74fc5b981242518f8380d49f6f4c26` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:42:28.429470 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf003e6a-0c00-40fd-9177-f613cde05753 None admin] RBAC: Authorizing `identity:get_project(project_id=5d74fc5b981242518f8380d49f6f4c26)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:42:28.430880 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf003e6a-0c00-40fd-9177-f613cde05753 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:42:28.432473 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 595/1191] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Oct 4 11:42:28 2022] GET /identity/v3/projects/5d74fc5b981242518f8380d49f6f4c26 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:42:28.438378 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c041fc-d11c-4c3d-bc95-5a35c927fac2 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:42:28.508888 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:42:28.540553 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c041fc-d11c-4c3d-bc95-5a35c927fac2 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:42:28.573014 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c06585a-43a2-400f-b40b-d8d47954d593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:42:28.574300 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c06585a-43a2-400f-b40b-d8d47954d593 None admin] REQUEST_METHOD: `PUT` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:42:28.574300 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c06585a-43a2-400f-b40b-d8d47954d593 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:42:28.574806 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c06585a-43a2-400f-b40b-d8d47954d593 None admin] PATH_INFO: `/v3/projects/5d74fc5b981242518f8380d49f6f4c26/users/380a9546a9df4fd7a2afb493ba875de7/roles/d6e7421d1ff9451c808004b818354550` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:42:28.576750 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c06585a-43a2-400f-b40b-d8d47954d593 None admin] RBAC: Authorizing `identity:create_grant(project_id=5d74fc5b981242518f8380d49f6f4c26, user_id=380a9546a9df4fd7a2afb493ba875de7, role_id=d6e7421d1ff9451c808004b818354550)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:42:28.578170 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c06585a-43a2-400f-b40b-d8d47954d593 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:42:28.640576 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 597/1192] 10.222.0.59 () {58 vars in 1439 bytes} [Tue Oct 4 11:42:28 2022] PUT /identity/v3/projects/5d74fc5b981242518f8380d49f6f4c26/users/380a9546a9df4fd7a2afb493ba875de7/roles/d6e7421d1ff9451c808004b818354550 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 11:42:30.775689 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f110c9ec-c46a-44da-99f1-0bee4aa12cd1 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:42:30.776200 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f110c9ec-c46a-44da-99f1-0bee4aa12cd1 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:42:30.776200 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f110c9ec-c46a-44da-99f1-0bee4aa12cd1 None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:42:30.777709 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 596/1193] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:42:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:42:30.782893 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918f078b-05cf-4c27-ad37-fe1ef695ac99 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:42:30.783336 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918f078b-05cf-4c27-ad37-fe1ef695ac99 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:42:30.783436 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918f078b-05cf-4c27-ad37-fe1ef695ac99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:42:30.801790 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-918f078b-05cf-4c27-ad37-fe1ef695ac99 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:42:30.802958 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-918f078b-05cf-4c27-ad37-fe1ef695ac99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:42:30.868250 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 598/1194] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:42:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 11:42:31.144985 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f110c9ec-c46a-44da-99f1-0bee4aa12cd1 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:42:31.235311 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:42:31.245033 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f110c9ec-c46a-44da-99f1-0bee4aa12cd1 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:42:31.279294 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fd7ea1-d1c4-40fd-9c01-1f90d31c0ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:42:31.279907 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fd7ea1-d1c4-40fd-9c01-1f90d31c0ee2 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:42:31.280183 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fd7ea1-d1c4-40fd-9c01-1f90d31c0ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:42:31.280454 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fd7ea1-d1c4-40fd-9c01-1f90d31c0ee2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:42:31.290166 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fd7ea1-d1c4-40fd-9c01-1f90d31c0ee2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 11:42:31.295838 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-53fd7ea1-d1c4-40fd-9c01-1f90d31c0ee2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 11:42:31.295838 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:42:31.295838 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:42:31.295838 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:42:31.295838 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:42:31.295838 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:42:31.295838 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:42:31.295838 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:42:31.295838 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:42:31.295838 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:42:31.295838 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:42:31.295838 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:42:31.295838 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 11:42:31.295838 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 11:42:31.295838 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 11:42:31.295838 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 11:42:31.296949 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 11:42:31.296949 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 11:42:31.296949 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 11:42:31.296949 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 11:42:31.296949 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:42:31.296949 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:42:31.296949 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:42:31.296949 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:42:31.296949 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:42:31.296949 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:42:31.296949 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:42:31.296949 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:42:31.296949 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:42:31.296949 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:42:31.296949 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:42:31.296949 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:42:31.297820 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:42:31.297820 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:42:31.297820 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:42:31.297820 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:42:31.297820 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 11:42:31.297820 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 11:42:31.297820 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 11:42:31.297820 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 11:42:31.297820 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 11:42:31.297820 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 11:42:31.297820 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 11:42:31.297820 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:42:31.297820 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 597/1195] 10.222.0.59 () {56 vars in 1096 bytes} [Tue Oct 4 11:42:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:42:31.302919 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918f078b-05cf-4c27-ad37-fe1ef695ac99 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:42:31.370256 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:42:31.410294 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918f078b-05cf-4c27-ad37-fe1ef695ac99 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:42:31.445722 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce128cb-32f0-4cff-94e2-164bcffaa741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:42:31.446316 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce128cb-32f0-4cff-94e2-164bcffaa741 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:42:31.446593 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce128cb-32f0-4cff-94e2-164bcffaa741 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:42:31.446864 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce128cb-32f0-4cff-94e2-164bcffaa741 None admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:42:31.447514 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce128cb-32f0-4cff-94e2-164bcffaa741 None admin] RBAC: Adding query filter params (name=admin) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:42:31.447816 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce128cb-32f0-4cff-94e2-164bcffaa741 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:42:31.450898 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce128cb-32f0-4cff-94e2-164bcffaa741 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:42:31.460105 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 599/1196] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Oct 4 11:42:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:42:31.466245 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fd7ea1-d1c4-40fd-9c01-1f90d31c0ee2 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:42:31.566524 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fd7ea1-d1c4-40fd-9c01-1f90d31c0ee2 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:42:31.598192 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4da7f9c-280e-40a9-bbd6-f0c3644aaccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:42:31.598806 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4da7f9c-280e-40a9-bbd6-f0c3644aaccb None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:42:31.599079 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4da7f9c-280e-40a9-bbd6-f0c3644aaccb None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:42:31.599348 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4da7f9c-280e-40a9-bbd6-f0c3644aaccb None admin] PATH_INFO: `/v3/users/380a9546a9df4fd7a2afb493ba875de7` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:42:31.600444 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4da7f9c-280e-40a9-bbd6-f0c3644aaccb None admin] RBAC: Authorizing `identity:get_user(user_id=380a9546a9df4fd7a2afb493ba875de7)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:42:31.601879 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4da7f9c-280e-40a9-bbd6-f0c3644aaccb None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:42:31.603423 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 598/1197] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Oct 4 11:42:31 2022] GET /identity/v3/users/380a9546a9df4fd7a2afb493ba875de7 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:42:31.609775 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce128cb-32f0-4cff-94e2-164bcffaa741 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:42:31.706001 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce128cb-32f0-4cff-94e2-164bcffaa741 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:42:31.728291 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:42:31.740173 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3e5e99-414b-4756-989f-ee94a8cd6e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:42:31.740808 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3e5e99-414b-4756-989f-ee94a8cd6e72 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:42:31.742951 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3e5e99-414b-4756-989f-ee94a8cd6e72 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:42:31.742951 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3e5e99-414b-4756-989f-ee94a8cd6e72 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:42:31.807258 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3e5e99-414b-4756-989f-ee94a8cd6e72 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:42:31.808751 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3e5e99-414b-4756-989f-ee94a8cd6e72 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:42:31.904556 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 600/1198] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Oct 4 11:42:31 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 11:42:31.910430 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4da7f9c-280e-40a9-bbd6-f0c3644aaccb None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:42:31.929546 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:42:32.005936 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4da7f9c-280e-40a9-bbd6-f0c3644aaccb None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:42:32.037930 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caac6e54-4f67-4334-b34f-b2c6123822b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:42:32.038548 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caac6e54-4f67-4334-b34f-b2c6123822b9 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:42:32.038823 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caac6e54-4f67-4334-b34f-b2c6123822b9 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:42:32.039093 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caac6e54-4f67-4334-b34f-b2c6123822b9 None admin] PATH_INFO: `/v3/projects/5d74fc5b981242518f8380d49f6f4c26` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:42:32.040179 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caac6e54-4f67-4334-b34f-b2c6123822b9 None admin] RBAC: Authorizing `identity:get_project(project_id=5d74fc5b981242518f8380d49f6f4c26)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:42:32.041616 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caac6e54-4f67-4334-b34f-b2c6123822b9 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:42:32.043785 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 599/1199] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Oct 4 11:42:31 2022] GET /identity/v3/projects/5d74fc5b981242518f8380d49f6f4c26 => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:42:32.050040 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3e5e99-414b-4756-989f-ee94a8cd6e72 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:42:32.073012 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:42:32.148764 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3e5e99-414b-4756-989f-ee94a8cd6e72 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:42:32.182286 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcacb249-5c7d-41cb-8753-df50154d6d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:42:32.183468 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcacb249-5c7d-41cb-8753-df50154d6d50 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:42:32.183757 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcacb249-5c7d-41cb-8753-df50154d6d50 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:42:32.184033 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcacb249-5c7d-41cb-8753-df50154d6d50 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:42:32.184773 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcacb249-5c7d-41cb-8753-df50154d6d50 None admin] RBAC: Adding query filter params (role.id=d6e7421d1ff9451c808004b818354550, scope.project.id=5d74fc5b981242518f8380d49f6f4c26, user.id=380a9546a9df4fd7a2afb493ba875de7) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:42:32.185079 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcacb249-5c7d-41cb-8753-df50154d6d50 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:42:32.186482 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcacb249-5c7d-41cb-8753-df50154d6d50 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:42:32.192034 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 601/1200] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Oct 4 11:42:32 2022] GET /identity/v3/role_assignments?user.id=380a9546a9df4fd7a2afb493ba875de7&scope.project.id=5d74fc5b981242518f8380d49f6f4c26&role.id=d6e7421d1ff9451c808004b818354550 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:42:42.033910 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=57 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:42:42.189523 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=57 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:43:49.366909 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac736872-80fd-4bc4-9d2c-94cd49ae4e3f None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:43:49.367523 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac736872-80fd-4bc4-9d2c-94cd49ae4e3f None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:43:49.367523 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac736872-80fd-4bc4-9d2c-94cd49ae4e3f None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:43:49.368793 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 600/1201] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:43:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:43:49.374164 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ef12f0-e695-4a88-87c7-ba95d643cf0f None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:43:49.374649 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ef12f0-e695-4a88-87c7-ba95d643cf0f None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:43:49.374757 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ef12f0-e695-4a88-87c7-ba95d643cf0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:43:49.396039 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-c6ef12f0-e695-4a88-87c7-ba95d643cf0f None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:43:49.397634 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-c6ef12f0-e695-4a88-87c7-ba95d643cf0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:43:49.466854 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 602/1202] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:43:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 11:43:49.742456 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac736872-80fd-4bc4-9d2c-94cd49ae4e3f None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:43:49.845972 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac736872-80fd-4bc4-9d2c-94cd49ae4e3f None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:43:49.878641 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2700e9e-7e4f-4ba8-91dd-98f41e3c0c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:43:49.879255 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2700e9e-7e4f-4ba8-91dd-98f41e3c0c4e None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:43:49.879529 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2700e9e-7e4f-4ba8-91dd-98f41e3c0c4e None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:43:49.879798 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2700e9e-7e4f-4ba8-91dd-98f41e3c0c4e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:43:49.890615 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2700e9e-7e4f-4ba8-91dd-98f41e3c0c4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:43:49.893244 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2700e9e-7e4f-4ba8-91dd-98f41e3c0c4e None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:43:49.906306 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-d2700e9e-7e4f-4ba8-91dd-98f41e3c0c4e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:43:49.906306 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:43:49.906306 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:43:49.906306 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:43:49.906306 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:43:49.906306 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:43:49.906306 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:43:49.906306 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:43:49.906306 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:43:49.906306 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:43:49.906306 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:43:49.906306 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:43:49.906306 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 11:43:49.906306 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 11:43:49.906306 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 11:43:49.906306 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 11:43:49.907557 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:43:49.907557 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:43:49.907557 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:43:49.907557 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:43:49.907557 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:43:49.907557 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:43:49.907557 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:43:49.907557 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:43:49.907557 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:43:49.907557 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:43:49.907557 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:43:49.907557 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:43:49.907557 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:43:49.907557 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:43:49.907557 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:43:49.907557 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:43:49.907557 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 11:43:49.908748 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 11:43:49.908748 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:43:49.908748 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:43:49.908748 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 601/1203] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Oct 4 11:43:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:43:49.913773 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ef12f0-e695-4a88-87c7-ba95d643cf0f None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:43:50.011982 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ef12f0-e695-4a88-87c7-ba95d643cf0f None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:43:50.041074 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:43:50.046771 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f2c96a-0cad-4f29-8e71-19e981431219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:43:50.047376 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f2c96a-0cad-4f29-8e71-19e981431219 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:43:50.047695 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f2c96a-0cad-4f29-8e71-19e981431219 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:43:50.048021 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f2c96a-0cad-4f29-8e71-19e981431219 None admin] PATH_INFO: `/v3/domains` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:43:50.048686 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f2c96a-0cad-4f29-8e71-19e981431219 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:43:50.048991 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f2c96a-0cad-4f29-8e71-19e981431219 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:43:50.050355 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f2c96a-0cad-4f29-8e71-19e981431219 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:43:50.061391 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 603/1204] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Oct 4 11:43:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:43:50.068805 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2700e9e-7e4f-4ba8-91dd-98f41e3c0c4e None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:43:50.121157 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:43:50.167194 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2700e9e-7e4f-4ba8-91dd-98f41e3c0c4e None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:43:50.199954 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223b4809-5d31-4927-862c-d1bf243a6485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:43:50.200549 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223b4809-5d31-4927-862c-d1bf243a6485 None admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:43:50.200853 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223b4809-5d31-4927-862c-d1bf243a6485 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:43:50.201118 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223b4809-5d31-4927-862c-d1bf243a6485 None admin] PATH_INFO: `/v3/users` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:43:50.201790 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223b4809-5d31-4927-862c-d1bf243a6485 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:43:50.203189 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223b4809-5d31-4927-862c-d1bf243a6485 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:43:50.283411 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 602/1205] 10.222.0.59 () {60 vars in 1132 bytes} [Tue Oct 4 11:43:50 2022] POST /identity/v3/users => generated 251 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 11:43:52.460363 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a716015d-a3e7-4b8b-82a6-661d165e6e65 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:43:52.460959 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a716015d-a3e7-4b8b-82a6-661d165e6e65 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:43:52.460959 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a716015d-a3e7-4b8b-82a6-661d165e6e65 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:43:52.462270 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 604/1206] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:43:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:43:52.467530 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9165ea1d-14a9-4560-a681-77599295ab3d None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:43:52.467941 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9165ea1d-14a9-4560-a681-77599295ab3d None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:43:52.468067 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9165ea1d-14a9-4560-a681-77599295ab3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:43:52.486696 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-9165ea1d-14a9-4560-a681-77599295ab3d None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:43:52.487870 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-9165ea1d-14a9-4560-a681-77599295ab3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:43:52.553955 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 603/1207] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:43:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 11:43:52.825163 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a716015d-a3e7-4b8b-82a6-661d165e6e65 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:43:52.930824 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a716015d-a3e7-4b8b-82a6-661d165e6e65 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:43:52.964975 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645a1f19-b527-4c65-8eef-36357f27d273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:43:52.965596 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645a1f19-b527-4c65-8eef-36357f27d273 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:43:52.965947 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645a1f19-b527-4c65-8eef-36357f27d273 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:43:52.966138 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645a1f19-b527-4c65-8eef-36357f27d273 None admin] PATH_INFO: `/v3/roles/service` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:43:52.976565 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645a1f19-b527-4c65-8eef-36357f27d273 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 11:43:52.981255 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-645a1f19-b527-4c65-8eef-36357f27d273 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 11:43:52.981255 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:43:52.981255 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:43:52.981255 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:43:52.981255 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:43:52.981255 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:43:52.981255 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:43:52.981255 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:43:52.981255 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:43:52.981255 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:43:52.981255 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:43:52.981255 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:43:52.981255 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 11:43:52.981255 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 11:43:52.981255 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 11:43:52.981255 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 11:43:52.982465 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 11:43:52.982465 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 11:43:52.982465 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 11:43:52.982465 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 11:43:52.982465 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:43:52.982465 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:43:52.982465 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:43:52.982465 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:43:52.982465 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:43:52.982465 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:43:52.982465 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:43:52.982465 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:43:52.982465 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:43:52.982465 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:43:52.982465 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:43:52.982465 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:43:52.983389 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:43:52.983389 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:43:52.983389 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:43:52.983389 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:43:52.983389 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 11:43:52.983389 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 11:43:52.983389 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 11:43:52.983389 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 11:43:52.983389 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 11:43:52.983389 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 11:43:52.983389 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 11:43:52.983389 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:43:52.983389 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 605/1208] 10.222.0.59 () {56 vars in 1102 bytes} [Tue Oct 4 11:43:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:43:52.988360 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9165ea1d-14a9-4560-a681-77599295ab3d None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:43:53.026996 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:43:53.086013 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9165ea1d-14a9-4560-a681-77599295ab3d None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:43:53.118965 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd84e02-4aa4-41a4-a538-9f63afe39fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:43:53.119572 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd84e02-4aa4-41a4-a538-9f63afe39fdf None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:43:53.119846 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd84e02-4aa4-41a4-a538-9f63afe39fdf None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:43:53.120113 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd84e02-4aa4-41a4-a538-9f63afe39fdf None admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:43:53.120797 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd84e02-4aa4-41a4-a538-9f63afe39fdf None admin] RBAC: Adding query filter params (name=service) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:43:53.121094 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd84e02-4aa4-41a4-a538-9f63afe39fdf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:43:53.122453 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd84e02-4aa4-41a4-a538-9f63afe39fdf None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:43:53.130058 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 604/1209] 10.222.0.59 () {56 vars in 1103 bytes} [Tue Oct 4 11:43:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:43:53.137050 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645a1f19-b527-4c65-8eef-36357f27d273 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:43:53.205767 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:43:53.261678 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645a1f19-b527-4c65-8eef-36357f27d273 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:43:53.294466 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa15d06-21d8-4de1-bafb-e01255758ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:43:53.295085 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa15d06-21d8-4de1-bafb-e01255758ec0 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:43:53.295357 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa15d06-21d8-4de1-bafb-e01255758ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:43:53.295626 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa15d06-21d8-4de1-bafb-e01255758ec0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:43:53.305676 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa15d06-21d8-4de1-bafb-e01255758ec0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:43:53.307092 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa15d06-21d8-4de1-bafb-e01255758ec0 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:43:53.320986 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-cfa15d06-21d8-4de1-bafb-e01255758ec0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:43:53.320986 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:43:53.320986 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:43:53.320986 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:43:53.320986 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:43:53.320986 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:43:53.320986 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:43:53.320986 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:43:53.320986 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:43:53.320986 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:43:53.320986 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:43:53.320986 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:43:53.320986 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 11:43:53.320986 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 11:43:53.320986 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 11:43:53.320986 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 11:43:53.322103 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:43:53.322103 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:43:53.322103 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:43:53.322103 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:43:53.322103 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:43:53.322103 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:43:53.322103 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:43:53.322103 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:43:53.322103 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:43:53.322103 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:43:53.322103 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:43:53.322103 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:43:53.322103 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:43:53.322103 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:43:53.322103 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:43:53.322103 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:43:53.322103 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 11:43:53.323020 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 11:43:53.323020 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:43:53.323020 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:43:53.323020 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 606/1210] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Oct 4 11:43:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:43:53.328062 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd84e02-4aa4-41a4-a538-9f63afe39fdf None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:43:53.423074 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:43:53.426080 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd84e02-4aa4-41a4-a538-9f63afe39fdf None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:43:53.459257 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694b8bef-925e-4948-a8fc-47be8c3079ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:43:53.464376 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694b8bef-925e-4948-a8fc-47be8c3079ab None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:43:53.464376 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694b8bef-925e-4948-a8fc-47be8c3079ab None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:43:53.464376 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694b8bef-925e-4948-a8fc-47be8c3079ab None admin] PATH_INFO: `/v3/domains` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:43:53.464376 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694b8bef-925e-4948-a8fc-47be8c3079ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:43:53.464376 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694b8bef-925e-4948-a8fc-47be8c3079ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:43:53.464376 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694b8bef-925e-4948-a8fc-47be8c3079ab None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:43:53.474355 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 605/1211] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Oct 4 11:43:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:43:53.480208 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa15d06-21d8-4de1-bafb-e01255758ec0 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:43:53.580016 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa15d06-21d8-4de1-bafb-e01255758ec0 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:43:53.581530 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:43:53.614061 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e993f15-4369-41ec-b4fc-ccf057f98e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:43:53.616041 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e993f15-4369-41ec-b4fc-ccf057f98e98 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:43:53.616041 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e993f15-4369-41ec-b4fc-ccf057f98e98 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:43:53.616041 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e993f15-4369-41ec-b4fc-ccf057f98e98 None admin] PATH_INFO: `/v3/users/placement` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:43:53.622720 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e993f15-4369-41ec-b4fc-ccf057f98e98 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:43:53.624163 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e993f15-4369-41ec-b4fc-ccf057f98e98 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:43:53.636291 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-1e993f15-4369-41ec-b4fc-ccf057f98e98 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 04 11:43:53.636291 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:43:53.636291 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:43:53.636291 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:43:53.636291 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:43:53.636291 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:43:53.636291 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:43:53.636291 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:43:53.636291 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:43:53.636291 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:43:53.636291 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:43:53.636291 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:43:53.636291 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 11:43:53.636291 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 11:43:53.636291 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 11:43:53.636291 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 11:43:53.637471 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:43:53.637471 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:43:53.637471 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 11:43:53.637471 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 11:43:53.637471 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 11:43:53.637471 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 11:43:53.637471 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:43:53.637471 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:43:53.637471 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:43:53.637471 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:43:53.637471 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:43:53.637471 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:43:53.637471 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:43:53.637471 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:43:53.637471 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:43:53.637471 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:43:53.637471 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:43:53.637471 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:43:53.638493 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:43:53.638493 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:43:53.638493 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 11:43:53.638493 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 11:43:53.638493 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 11:43:53.638493 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 11:43:53.638493 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 11:43:53.638493 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 11:43:53.638493 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 04 11:43:53.638493 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:43:53.638493 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 607/1212] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Oct 4 11:43:53 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:43:53.643329 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694b8bef-925e-4948-a8fc-47be8c3079ab None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:43:53.739730 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694b8bef-925e-4948-a8fc-47be8c3079ab None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:43:53.774122 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dd5352-bd1d-48d0-8d9f-ae84a43cbdb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:43:53.774731 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dd5352-bd1d-48d0-8d9f-ae84a43cbdb3 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:43:53.775007 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dd5352-bd1d-48d0-8d9f-ae84a43cbdb3 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:43:53.775275 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dd5352-bd1d-48d0-8d9f-ae84a43cbdb3 None admin] PATH_INFO: `/v3/users` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:43:53.775991 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dd5352-bd1d-48d0-8d9f-ae84a43cbdb3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:43:53.776291 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dd5352-bd1d-48d0-8d9f-ae84a43cbdb3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:43:53.777744 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dd5352-bd1d-48d0-8d9f-ae84a43cbdb3 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:43:53.795120 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 606/1213] 10.222.0.59 () {56 vars in 1143 bytes} [Tue Oct 4 11:43:53 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 11:43:53.802477 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e993f15-4369-41ec-b4fc-ccf057f98e98 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:43:53.899551 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e993f15-4369-41ec-b4fc-ccf057f98e98 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:43:53.932743 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe0cf59-8ff7-415d-b466-424dd93e4c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:43:53.934013 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe0cf59-8ff7-415d-b466-424dd93e4c18 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:43:53.934013 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe0cf59-8ff7-415d-b466-424dd93e4c18 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:43:53.934013 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe0cf59-8ff7-415d-b466-424dd93e4c18 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:43:53.962417 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:43:54.001232 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe0cf59-8ff7-415d-b466-424dd93e4c18 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:43:54.002601 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe0cf59-8ff7-415d-b466-424dd93e4c18 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:43:54.103424 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 608/1214] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Oct 4 11:43:53 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 11:43:54.109249 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dd5352-bd1d-48d0-8d9f-ae84a43cbdb3 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:43:54.128281 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:43:54.205252 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dd5352-bd1d-48d0-8d9f-ae84a43cbdb3 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:43:54.239310 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83ba02b-7cf3-4a30-b60d-961cbedd92f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:43:54.240023 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83ba02b-7cf3-4a30-b60d-961cbedd92f6 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:43:54.240255 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83ba02b-7cf3-4a30-b60d-961cbedd92f6 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:43:54.240522 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83ba02b-7cf3-4a30-b60d-961cbedd92f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:43:54.252266 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83ba02b-7cf3-4a30-b60d-961cbedd92f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:43:54.253641 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83ba02b-7cf3-4a30-b60d-961cbedd92f6 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:43:54.270430 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-d83ba02b-7cf3-4a30-b60d-961cbedd92f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:43:54.270430 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:43:54.270430 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:43:54.270430 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:43:54.270430 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:43:54.270430 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:43:54.270430 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:43:54.270430 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:43:54.270430 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:43:54.270430 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:43:54.270430 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:43:54.270430 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:43:54.270430 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 11:43:54.270430 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 11:43:54.270430 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 11:43:54.270430 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 11:43:54.272069 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:43:54.272069 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:43:54.272069 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:43:54.272069 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:43:54.272069 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:43:54.272069 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:43:54.272069 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:43:54.272069 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:43:54.272069 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:43:54.272069 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:43:54.272069 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:43:54.272069 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:43:54.272069 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:43:54.272069 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:43:54.272069 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:43:54.272069 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:43:54.272069 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 11:43:54.273317 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 11:43:54.273317 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:43:54.273317 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:43:54.273317 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 607/1215] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Oct 4 11:43:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:43:54.278597 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe0cf59-8ff7-415d-b466-424dd93e4c18 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:43:54.339284 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:43:54.378072 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe0cf59-8ff7-415d-b466-424dd93e4c18 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:43:54.410818 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b4377e-9e6d-4874-8c79-a7c9c4748ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:43:54.411772 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b4377e-9e6d-4874-8c79-a7c9c4748ad1 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:43:54.411772 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b4377e-9e6d-4874-8c79-a7c9c4748ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:43:54.412611 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b4377e-9e6d-4874-8c79-a7c9c4748ad1 None admin] PATH_INFO: `/v3/domains` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:43:54.413243 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b4377e-9e6d-4874-8c79-a7c9c4748ad1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:43:54.413539 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b4377e-9e6d-4874-8c79-a7c9c4748ad1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:43:54.414885 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b4377e-9e6d-4874-8c79-a7c9c4748ad1 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:43:54.426306 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 609/1216] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Oct 4 11:43:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:43:54.432193 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83ba02b-7cf3-4a30-b60d-961cbedd92f6 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:43:54.501759 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:43:54.532379 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83ba02b-7cf3-4a30-b60d-961cbedd92f6 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:43:54.565982 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dd0561-084e-4429-999c-75ef067a47cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:43:54.566603 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dd0561-084e-4429-999c-75ef067a47cd None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:43:54.566876 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dd0561-084e-4429-999c-75ef067a47cd None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:43:54.567141 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dd0561-084e-4429-999c-75ef067a47cd None admin] PATH_INFO: `/v3/projects/service` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:43:54.573982 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dd0561-084e-4429-999c-75ef067a47cd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:43:54.575398 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dd0561-084e-4429-999c-75ef067a47cd None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:43:54.586758 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-60dd0561-084e-4429-999c-75ef067a47cd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 11:43:54.586758 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:43:54.586758 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:43:54.586758 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:43:54.586758 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:43:54.586758 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:43:54.586758 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:43:54.586758 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:43:54.586758 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:43:54.586758 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:43:54.586758 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:43:54.586758 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:43:54.586758 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 11:43:54.586758 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 11:43:54.586758 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 11:43:54.587922 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 11:43:54.587922 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:43:54.587922 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:43:54.587922 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:43:54.587922 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:43:54.587922 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:43:54.587922 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:43:54.587922 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:43:54.587922 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:43:54.587922 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:43:54.587922 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:43:54.587922 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:43:54.587922 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:43:54.587922 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:43:54.587922 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:43:54.587922 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:43:54.587922 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:43:54.589062 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 11:43:54.589062 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 11:43:54.589062 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 11:43:54.589062 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 11:43:54.589062 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 11:43:54.589062 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 11:43:54.589062 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 11:43:54.589062 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:43:54.589062 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 608/1217] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Oct 4 11:43:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:43:54.593861 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b4377e-9e6d-4874-8c79-a7c9c4748ad1 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:43:54.690447 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b4377e-9e6d-4874-8c79-a7c9c4748ad1 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:43:54.714104 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:43:54.725680 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b857d64-92a8-4cc2-94c2-9cd39e0421fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:43:54.726279 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b857d64-92a8-4cc2-94c2-9cd39e0421fa None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:43:54.726553 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b857d64-92a8-4cc2-94c2-9cd39e0421fa None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:43:54.726823 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b857d64-92a8-4cc2-94c2-9cd39e0421fa None admin] PATH_INFO: `/v3/projects` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:43:54.727495 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b857d64-92a8-4cc2-94c2-9cd39e0421fa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:43:54.727795 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b857d64-92a8-4cc2-94c2-9cd39e0421fa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:43:54.729267 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b857d64-92a8-4cc2-94c2-9cd39e0421fa None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:43:54.740839 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 610/1218] 10.222.0.59 () {56 vars in 1148 bytes} [Tue Oct 4 11:43:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:43:54.747047 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dd0561-084e-4429-999c-75ef067a47cd None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:43:54.844876 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dd0561-084e-4429-999c-75ef067a47cd None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:43:54.871875 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:43:54.877460 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7415f88f-67bb-4583-9887-99b712b73cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:43:54.878053 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7415f88f-67bb-4583-9887-99b712b73cca None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:43:54.878330 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7415f88f-67bb-4583-9887-99b712b73cca None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:43:54.878594 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7415f88f-67bb-4583-9887-99b712b73cca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:43:54.879312 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7415f88f-67bb-4583-9887-99b712b73cca None admin] RBAC: Adding query filter params (role.id=01769bbdbd2e48f2bf8e855ba6a8507e, scope.project.id=39913dbe3e984f27a61493dd75381501, user.id=be119968b02440adbbbc85c553077b92) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:43:54.879598 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7415f88f-67bb-4583-9887-99b712b73cca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:43:54.881638 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7415f88f-67bb-4583-9887-99b712b73cca None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:43:54.886786 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 609/1219] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Oct 4 11:43:54 2022] GET /identity/v3/role_assignments?user.id=be119968b02440adbbbc85c553077b92&scope.project.id=39913dbe3e984f27a61493dd75381501&role.id=01769bbdbd2e48f2bf8e855ba6a8507e => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:43:57.044290 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9257b384-b9e6-4a74-9924-fc540070b1c1 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:43:57.044904 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9257b384-b9e6-4a74-9924-fc540070b1c1 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:43:57.044904 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9257b384-b9e6-4a74-9924-fc540070b1c1 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:43:57.046294 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 611/1220] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:43:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:43:57.051635 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51260b44-3c7b-4572-8016-9cb284692c88 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:43:57.052049 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51260b44-3c7b-4572-8016-9cb284692c88 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:43:57.052247 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51260b44-3c7b-4572-8016-9cb284692c88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:43:57.071101 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-51260b44-3c7b-4572-8016-9cb284692c88 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:43:57.079225 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-51260b44-3c7b-4572-8016-9cb284692c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:43:57.137507 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 610/1221] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:43:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 11:43:57.419602 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9257b384-b9e6-4a74-9924-fc540070b1c1 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:43:57.523912 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9257b384-b9e6-4a74-9924-fc540070b1c1 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:43:57.562248 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb12a42-3b88-46de-9000-24f2c4d1334f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:43:57.562248 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb12a42-3b88-46de-9000-24f2c4d1334f None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:43:57.562248 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb12a42-3b88-46de-9000-24f2c4d1334f None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:43:57.562248 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb12a42-3b88-46de-9000-24f2c4d1334f None admin] PATH_INFO: `/v3/roles/service` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:43:57.571370 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb12a42-3b88-46de-9000-24f2c4d1334f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 11:43:57.578089 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-1fb12a42-3b88-46de-9000-24f2c4d1334f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 11:43:57.578089 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:43:57.578089 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:43:57.578089 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:43:57.578089 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:43:57.578089 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:43:57.578089 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:43:57.578089 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:43:57.578089 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:43:57.578089 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:43:57.578089 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:43:57.578089 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:43:57.578089 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 11:43:57.578089 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 11:43:57.578089 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 11:43:57.578089 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 11:43:57.579337 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 11:43:57.579337 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 11:43:57.579337 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 11:43:57.579337 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 11:43:57.579337 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:43:57.579337 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:43:57.579337 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:43:57.579337 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:43:57.579337 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:43:57.579337 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:43:57.579337 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:43:57.579337 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:43:57.579337 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:43:57.579337 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:43:57.579337 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:43:57.579337 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:43:57.580476 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:43:57.580476 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:43:57.580476 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:43:57.580476 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:43:57.580476 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 11:43:57.580476 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 11:43:57.580476 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 11:43:57.580476 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 11:43:57.580476 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 11:43:57.580476 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 11:43:57.580476 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 11:43:57.580476 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:43:57.580476 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 612/1222] 10.222.0.59 () {56 vars in 1102 bytes} [Tue Oct 4 11:43:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:43:57.585882 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51260b44-3c7b-4572-8016-9cb284692c88 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:43:57.685003 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51260b44-3c7b-4572-8016-9cb284692c88 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:43:57.707475 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:43:57.717966 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010412cc-de9c-4760-9c6d-41be2b94531c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:43:57.720404 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010412cc-de9c-4760-9c6d-41be2b94531c None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:43:57.720404 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010412cc-de9c-4760-9c6d-41be2b94531c None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:43:57.720404 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010412cc-de9c-4760-9c6d-41be2b94531c None admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:43:57.720404 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010412cc-de9c-4760-9c6d-41be2b94531c None admin] RBAC: Adding query filter params (name=service) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:43:57.720404 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010412cc-de9c-4760-9c6d-41be2b94531c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:43:57.721681 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010412cc-de9c-4760-9c6d-41be2b94531c None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:43:57.729653 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 611/1223] 10.222.0.59 () {56 vars in 1103 bytes} [Tue Oct 4 11:43:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:43:57.735588 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb12a42-3b88-46de-9000-24f2c4d1334f None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:43:57.778801 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:43:57.833292 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb12a42-3b88-46de-9000-24f2c4d1334f None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:43:57.881341 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb810e9-313f-45f5-be36-15f5acd3404f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:43:57.881988 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb810e9-313f-45f5-be36-15f5acd3404f None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:43:57.882264 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb810e9-313f-45f5-be36-15f5acd3404f None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:43:57.882534 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb810e9-313f-45f5-be36-15f5acd3404f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:43:57.898195 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb810e9-313f-45f5-be36-15f5acd3404f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:43:57.899637 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb810e9-313f-45f5-be36-15f5acd3404f None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:43:57.916299 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-3cb810e9-313f-45f5-be36-15f5acd3404f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:43:57.916299 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:43:57.916299 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:43:57.916299 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:43:57.916299 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:43:57.916299 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:43:57.916299 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:43:57.916299 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:43:57.916299 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:43:57.916299 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:43:57.916299 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:43:57.916299 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:43:57.916299 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 11:43:57.916299 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 11:43:57.916299 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 11:43:57.916299 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 11:43:57.917501 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:43:57.917501 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:43:57.917501 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:43:57.917501 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:43:57.917501 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:43:57.917501 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:43:57.917501 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:43:57.917501 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:43:57.917501 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:43:57.917501 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:43:57.917501 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:43:57.917501 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:43:57.917501 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:43:57.917501 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:43:57.917501 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:43:57.917501 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:43:57.917501 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 11:43:57.918911 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 11:43:57.918911 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:43:57.918911 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:43:57.918911 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 613/1224] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Oct 4 11:43:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:43:57.925454 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010412cc-de9c-4760-9c6d-41be2b94531c None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:43:58.031649 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010412cc-de9c-4760-9c6d-41be2b94531c None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:43:58.064440 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988dbad0-b081-42f5-9e47-973d755bea17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:43:58.069690 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988dbad0-b081-42f5-9e47-973d755bea17 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:43:58.069690 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988dbad0-b081-42f5-9e47-973d755bea17 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:43:58.069690 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988dbad0-b081-42f5-9e47-973d755bea17 None admin] PATH_INFO: `/v3/domains` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:43:58.069690 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988dbad0-b081-42f5-9e47-973d755bea17 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:43:58.069690 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988dbad0-b081-42f5-9e47-973d755bea17 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:43:58.069690 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988dbad0-b081-42f5-9e47-973d755bea17 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:43:58.079502 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 612/1225] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Oct 4 11:43:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:43:58.086242 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb810e9-313f-45f5-be36-15f5acd3404f None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:43:58.180009 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:43:58.186498 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb810e9-313f-45f5-be36-15f5acd3404f None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:43:58.219787 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832c9cfc-cb84-405a-b8ae-a8e4353d86b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:43:58.220420 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832c9cfc-cb84-405a-b8ae-a8e4353d86b7 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:43:58.220732 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832c9cfc-cb84-405a-b8ae-a8e4353d86b7 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:43:58.221256 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832c9cfc-cb84-405a-b8ae-a8e4353d86b7 None admin] PATH_INFO: `/v3/users/placement` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:43:58.232815 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832c9cfc-cb84-405a-b8ae-a8e4353d86b7 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:43:58.234308 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832c9cfc-cb84-405a-b8ae-a8e4353d86b7 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:43:58.246534 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-832c9cfc-cb84-405a-b8ae-a8e4353d86b7 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 04 11:43:58.246534 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:43:58.246534 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:43:58.246534 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:43:58.246534 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:43:58.246534 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:43:58.246534 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:43:58.246534 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:43:58.246534 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:43:58.246534 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:43:58.246534 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:43:58.246534 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:43:58.246534 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 11:43:58.246534 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 11:43:58.246534 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 11:43:58.246534 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 11:43:58.247759 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:43:58.247759 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:43:58.247759 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 11:43:58.247759 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 11:43:58.247759 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 11:43:58.247759 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 11:43:58.247759 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:43:58.247759 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:43:58.247759 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:43:58.247759 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:43:58.247759 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:43:58.247759 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:43:58.247759 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:43:58.247759 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:43:58.247759 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:43:58.247759 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:43:58.247759 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:43:58.247759 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:43:58.249732 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:43:58.249732 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:43:58.249732 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 11:43:58.249732 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 11:43:58.249732 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 11:43:58.249732 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 11:43:58.249732 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 11:43:58.249732 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 11:43:58.249732 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 04 11:43:58.249732 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:43:58.249732 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 614/1226] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Oct 4 11:43:58 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:43:58.254156 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988dbad0-b081-42f5-9e47-973d755bea17 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:43:58.300652 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:43:58.352159 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988dbad0-b081-42f5-9e47-973d755bea17 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:43:58.385249 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc40c39b-0132-4908-b14c-60cffefa5049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:43:58.385860 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc40c39b-0132-4908-b14c-60cffefa5049 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:43:58.386133 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc40c39b-0132-4908-b14c-60cffefa5049 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:43:58.386397 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc40c39b-0132-4908-b14c-60cffefa5049 None admin] PATH_INFO: `/v3/users` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:43:58.387138 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc40c39b-0132-4908-b14c-60cffefa5049 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:43:58.387435 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc40c39b-0132-4908-b14c-60cffefa5049 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:43:58.388885 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc40c39b-0132-4908-b14c-60cffefa5049 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:43:58.406665 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 613/1227] 10.222.0.59 () {56 vars in 1143 bytes} [Tue Oct 4 11:43:58 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:43:58.412515 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832c9cfc-cb84-405a-b8ae-a8e4353d86b7 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:43:58.510692 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832c9cfc-cb84-405a-b8ae-a8e4353d86b7 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:43:58.545153 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a642d65-15aa-476d-a74f-7438b899706f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:43:58.545773 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a642d65-15aa-476d-a74f-7438b899706f None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:43:58.546055 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a642d65-15aa-476d-a74f-7438b899706f None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:43:58.546321 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a642d65-15aa-476d-a74f-7438b899706f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:43:58.556895 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a642d65-15aa-476d-a74f-7438b899706f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:43:58.558272 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a642d65-15aa-476d-a74f-7438b899706f None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:43:58.572528 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-0a642d65-15aa-476d-a74f-7438b899706f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:43:58.572528 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:43:58.572528 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:43:58.572528 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:43:58.572528 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:43:58.572528 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:43:58.572528 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:43:58.572528 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:43:58.572528 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:43:58.572528 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:43:58.572528 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:43:58.572528 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:43:58.572528 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 11:43:58.572528 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 11:43:58.572528 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 11:43:58.572528 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 11:43:58.573596 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:43:58.573596 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:43:58.573596 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:43:58.573596 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:43:58.573596 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:43:58.573596 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:43:58.573596 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:43:58.573596 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:43:58.573596 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:43:58.573596 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:43:58.573596 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:43:58.573596 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:43:58.573596 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:43:58.573596 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:43:58.573596 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:43:58.573596 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:43:58.573596 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 11:43:58.574517 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 11:43:58.574517 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:43:58.574517 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:43:58.574715 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 615/1228] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Oct 4 11:43:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:43:58.579324 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc40c39b-0132-4908-b14c-60cffefa5049 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:43:58.676411 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc40c39b-0132-4908-b14c-60cffefa5049 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:43:58.679399 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:43:58.709920 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a328375-73ad-4e2e-b919-fb069605fd97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:43:58.710532 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a328375-73ad-4e2e-b919-fb069605fd97 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:43:58.710811 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a328375-73ad-4e2e-b919-fb069605fd97 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:43:58.711084 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a328375-73ad-4e2e-b919-fb069605fd97 None admin] PATH_INFO: `/v3/domains` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:43:58.711723 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a328375-73ad-4e2e-b919-fb069605fd97 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:43:58.712024 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a328375-73ad-4e2e-b919-fb069605fd97 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:43:58.713413 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a328375-73ad-4e2e-b919-fb069605fd97 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:43:58.724680 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 614/1229] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Oct 4 11:43:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:43:58.730357 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a642d65-15aa-476d-a74f-7438b899706f None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:43:58.740289 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:43:58.830194 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a642d65-15aa-476d-a74f-7438b899706f None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:43:58.863356 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8039e4f4-42da-4dd6-ba38-45c68ab5e7fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:43:58.863977 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8039e4f4-42da-4dd6-ba38-45c68ab5e7fb None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:43:58.864262 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8039e4f4-42da-4dd6-ba38-45c68ab5e7fb None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:43:58.865106 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8039e4f4-42da-4dd6-ba38-45c68ab5e7fb None admin] PATH_INFO: `/v3/projects/service` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:43:58.871896 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8039e4f4-42da-4dd6-ba38-45c68ab5e7fb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:43:58.873343 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8039e4f4-42da-4dd6-ba38-45c68ab5e7fb None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:43:58.884718 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-8039e4f4-42da-4dd6-ba38-45c68ab5e7fb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 11:43:58.884718 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:43:58.884718 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:43:58.884718 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:43:58.884718 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:43:58.884718 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:43:58.884718 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:43:58.884718 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:43:58.884718 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:43:58.884718 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:43:58.884718 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:43:58.884718 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:43:58.884718 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 11:43:58.884718 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 11:43:58.884718 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 11:43:58.887660 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 11:43:58.887660 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:43:58.887660 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:43:58.887660 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:43:58.887660 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:43:58.887660 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:43:58.887660 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:43:58.887660 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:43:58.887660 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:43:58.887660 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:43:58.887660 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:43:58.887660 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:43:58.887660 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:43:58.887660 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:43:58.887660 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:43:58.887660 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:43:58.887660 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:43:58.888823 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 11:43:58.888823 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 11:43:58.888823 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 11:43:58.888823 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 11:43:58.888823 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 11:43:58.888823 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 11:43:58.888823 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 11:43:58.888823 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:43:58.888823 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 616/1230] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Oct 4 11:43:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:43:58.891750 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a328375-73ad-4e2e-b919-fb069605fd97 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:43:58.991686 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a328375-73ad-4e2e-b919-fb069605fd97 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:43:59.024544 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fc8dcf-d7d2-40cf-bed7-060857fba731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:43:59.025249 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fc8dcf-d7d2-40cf-bed7-060857fba731 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:43:59.025522 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fc8dcf-d7d2-40cf-bed7-060857fba731 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:43:59.025788 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fc8dcf-d7d2-40cf-bed7-060857fba731 None admin] PATH_INFO: `/v3/projects` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:43:59.026467 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fc8dcf-d7d2-40cf-bed7-060857fba731 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:43:59.026766 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fc8dcf-d7d2-40cf-bed7-060857fba731 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:43:59.028287 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fc8dcf-d7d2-40cf-bed7-060857fba731 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:43:59.040407 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 615/1231] 10.222.0.59 () {56 vars in 1148 bytes} [Tue Oct 4 11:43:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:43:59.046500 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8039e4f4-42da-4dd6-ba38-45c68ab5e7fb None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:43:59.110807 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:43:59.145125 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8039e4f4-42da-4dd6-ba38-45c68ab5e7fb None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:43:59.178607 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0511754e-d7a8-4b81-9097-8e521cd708e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:43:59.179301 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0511754e-d7a8-4b81-9097-8e521cd708e7 None admin] REQUEST_METHOD: `PUT` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:43:59.179581 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0511754e-d7a8-4b81-9097-8e521cd708e7 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:43:59.179855 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0511754e-d7a8-4b81-9097-8e521cd708e7 None admin] PATH_INFO: `/v3/projects/39913dbe3e984f27a61493dd75381501/users/be119968b02440adbbbc85c553077b92/roles/01769bbdbd2e48f2bf8e855ba6a8507e` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:43:59.193942 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0511754e-d7a8-4b81-9097-8e521cd708e7 None admin] RBAC: Authorizing `identity:create_grant(project_id=39913dbe3e984f27a61493dd75381501, user_id=be119968b02440adbbbc85c553077b92, role_id=01769bbdbd2e48f2bf8e855ba6a8507e)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:43:59.195462 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0511754e-d7a8-4b81-9097-8e521cd708e7 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:43:59.345648 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 617/1232] 10.222.0.59 () {58 vars in 1439 bytes} [Tue Oct 4 11:43:59 2022] PUT /identity/v3/projects/39913dbe3e984f27a61493dd75381501/users/be119968b02440adbbbc85c553077b92/roles/01769bbdbd2e48f2bf8e855ba6a8507e => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 11:44:01.502017 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e02b87-1919-4188-8406-c4e62a4946aa None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:44:01.502598 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e02b87-1919-4188-8406-c4e62a4946aa None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:44:01.502598 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e02b87-1919-4188-8406-c4e62a4946aa None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:44:01.503911 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 616/1233] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:44:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:44:01.509221 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8e8924-a9a5-421b-8d80-b8e5d04dd507 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:44:01.509651 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8e8924-a9a5-421b-8d80-b8e5d04dd507 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:44:01.509758 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8e8924-a9a5-421b-8d80-b8e5d04dd507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:44:01.527844 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-0e8e8924-a9a5-421b-8d80-b8e5d04dd507 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:44:01.529069 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-0e8e8924-a9a5-421b-8d80-b8e5d04dd507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:44:01.594174 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 618/1234] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:44:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 11:44:01.866581 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e02b87-1919-4188-8406-c4e62a4946aa None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:44:01.891890 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:44:01.965761 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e02b87-1919-4188-8406-c4e62a4946aa None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:44:01.999590 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2469dd4e-56c1-4c00-8f78-5f08fa3b300a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:44:02.000213 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2469dd4e-56c1-4c00-8f78-5f08fa3b300a None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:44:02.000491 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2469dd4e-56c1-4c00-8f78-5f08fa3b300a None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:44:02.000798 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2469dd4e-56c1-4c00-8f78-5f08fa3b300a None admin] PATH_INFO: `/v3/roles/service` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:44:02.010800 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2469dd4e-56c1-4c00-8f78-5f08fa3b300a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 11:44:02.015501 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-2469dd4e-56c1-4c00-8f78-5f08fa3b300a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 11:44:02.015501 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:44:02.015501 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:44:02.015501 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:44:02.015501 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:44:02.015501 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:44:02.015501 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:44:02.015501 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:44:02.015501 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:44:02.015501 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:44:02.015501 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:44:02.015501 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:44:02.015501 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 11:44:02.015501 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 11:44:02.015501 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 11:44:02.015501 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 11:44:02.016459 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 11:44:02.016459 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 11:44:02.016459 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 11:44:02.016459 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 11:44:02.016459 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:44:02.016459 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:44:02.016459 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:44:02.016459 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:44:02.016459 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:44:02.016459 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:44:02.016459 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:44:02.016459 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:44:02.016459 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:44:02.016459 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:44:02.016459 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:44:02.016459 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:44:02.017391 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:44:02.017391 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:44:02.017391 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:44:02.017391 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:44:02.017391 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 11:44:02.017391 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 11:44:02.017391 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 11:44:02.017391 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 11:44:02.017391 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 11:44:02.017391 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 11:44:02.017391 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 11:44:02.017391 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:44:02.017391 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 617/1235] 10.222.0.59 () {56 vars in 1102 bytes} [Tue Oct 4 11:44:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:44:02.023439 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8e8924-a9a5-421b-8d80-b8e5d04dd507 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:44:02.069469 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:44:02.119800 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8e8924-a9a5-421b-8d80-b8e5d04dd507 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:44:02.152397 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651558e7-4fcb-4333-a5db-7ccb28558491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:44:02.153013 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651558e7-4fcb-4333-a5db-7ccb28558491 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:44:02.153288 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651558e7-4fcb-4333-a5db-7ccb28558491 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:44:02.153556 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651558e7-4fcb-4333-a5db-7ccb28558491 None admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:44:02.154200 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651558e7-4fcb-4333-a5db-7ccb28558491 None admin] RBAC: Adding query filter params (name=service) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:44:02.154496 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651558e7-4fcb-4333-a5db-7ccb28558491 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:44:02.155887 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651558e7-4fcb-4333-a5db-7ccb28558491 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:44:02.163532 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 619/1236] 10.222.0.59 () {56 vars in 1103 bytes} [Tue Oct 4 11:44:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:44:02.169460 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2469dd4e-56c1-4c00-8f78-5f08fa3b300a None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:44:02.251843 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:44:02.267303 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2469dd4e-56c1-4c00-8f78-5f08fa3b300a None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:44:02.303587 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557fd97e-217d-41c1-9c63-e46b57e0f113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:44:02.304201 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557fd97e-217d-41c1-9c63-e46b57e0f113 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:44:02.304525 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557fd97e-217d-41c1-9c63-e46b57e0f113 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:44:02.304800 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557fd97e-217d-41c1-9c63-e46b57e0f113 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:44:02.315095 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557fd97e-217d-41c1-9c63-e46b57e0f113 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:44:02.316571 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557fd97e-217d-41c1-9c63-e46b57e0f113 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:44:02.331025 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-557fd97e-217d-41c1-9c63-e46b57e0f113 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:44:02.331025 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:44:02.331025 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:44:02.331025 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:44:02.331025 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:44:02.331025 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:44:02.331025 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:44:02.331025 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:44:02.331025 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:44:02.331025 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:44:02.331025 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:44:02.331025 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:44:02.331025 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 11:44:02.331025 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 11:44:02.331025 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 11:44:02.331025 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 11:44:02.334913 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:44:02.334913 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:44:02.334913 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:44:02.334913 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:44:02.334913 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:44:02.334913 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:44:02.334913 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:44:02.334913 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:44:02.334913 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:44:02.334913 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:44:02.334913 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:44:02.334913 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:44:02.334913 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:44:02.334913 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:44:02.334913 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:44:02.334913 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:44:02.334913 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 11:44:02.336011 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 11:44:02.336011 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:44:02.336011 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:44:02.336011 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 618/1237] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Oct 4 11:44:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:44:02.338835 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651558e7-4fcb-4333-a5db-7ccb28558491 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:44:02.436226 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651558e7-4fcb-4333-a5db-7ccb28558491 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:44:02.468571 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc1d2aa-8d38-4aec-9f23-64b277d189e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:44:02.469181 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc1d2aa-8d38-4aec-9f23-64b277d189e1 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:44:02.469455 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc1d2aa-8d38-4aec-9f23-64b277d189e1 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:44:02.469725 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc1d2aa-8d38-4aec-9f23-64b277d189e1 None admin] PATH_INFO: `/v3/domains` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:44:02.470345 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc1d2aa-8d38-4aec-9f23-64b277d189e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:44:02.470640 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc1d2aa-8d38-4aec-9f23-64b277d189e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:44:02.472247 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc1d2aa-8d38-4aec-9f23-64b277d189e1 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:44:02.483693 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 620/1238] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Oct 4 11:44:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:44:02.489998 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557fd97e-217d-41c1-9c63-e46b57e0f113 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:44:02.586986 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557fd97e-217d-41c1-9c63-e46b57e0f113 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:44:02.621604 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78247e2d-df65-423b-886e-58df59fc566c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:44:02.636519 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78247e2d-df65-423b-886e-58df59fc566c None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:44:02.636519 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78247e2d-df65-423b-886e-58df59fc566c None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:44:02.636519 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78247e2d-df65-423b-886e-58df59fc566c None admin] PATH_INFO: `/v3/users/placement` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:44:02.636519 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:44:02.636519 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78247e2d-df65-423b-886e-58df59fc566c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:44:02.636519 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78247e2d-df65-423b-886e-58df59fc566c None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:44:02.643335 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-78247e2d-df65-423b-886e-58df59fc566c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 04 11:44:02.643335 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:44:02.643335 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:44:02.643335 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:44:02.643335 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:44:02.643335 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:44:02.643335 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:44:02.643335 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:44:02.643335 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:44:02.643335 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:44:02.643335 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:44:02.643335 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:44:02.643335 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 11:44:02.643335 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 11:44:02.643335 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 11:44:02.643335 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 11:44:02.644556 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:44:02.644556 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:44:02.644556 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 11:44:02.644556 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 11:44:02.644556 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 11:44:02.644556 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 11:44:02.644556 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:44:02.644556 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:44:02.644556 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:44:02.644556 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:44:02.644556 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:44:02.644556 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:44:02.644556 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:44:02.644556 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:44:02.644556 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:44:02.644556 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:44:02.644556 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:44:02.644556 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:44:02.645822 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:44:02.645822 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:44:02.645822 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 11:44:02.645822 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 11:44:02.645822 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 11:44:02.645822 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 11:44:02.645822 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 11:44:02.645822 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 11:44:02.645822 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 04 11:44:02.645822 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:44:02.645822 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 619/1239] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Oct 4 11:44:02 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:44:02.650603 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc1d2aa-8d38-4aec-9f23-64b277d189e1 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:44:02.746172 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc1d2aa-8d38-4aec-9f23-64b277d189e1 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:44:02.779362 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc4d00d-4b27-46ef-9018-04ec53721432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:44:02.779955 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc4d00d-4b27-46ef-9018-04ec53721432 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:44:02.780230 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc4d00d-4b27-46ef-9018-04ec53721432 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:44:02.780497 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc4d00d-4b27-46ef-9018-04ec53721432 None admin] PATH_INFO: `/v3/users` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:44:02.781236 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc4d00d-4b27-46ef-9018-04ec53721432 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:44:02.781539 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc4d00d-4b27-46ef-9018-04ec53721432 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:44:02.782940 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc4d00d-4b27-46ef-9018-04ec53721432 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:44:02.793147 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:44:02.802050 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 621/1240] 10.222.0.59 () {56 vars in 1143 bytes} [Tue Oct 4 11:44:02 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:44:02.807961 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78247e2d-df65-423b-886e-58df59fc566c None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:44:02.905899 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78247e2d-df65-423b-886e-58df59fc566c None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:44:02.938691 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc32405-2175-4d73-9e7e-f7a406435498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:44:02.939296 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc32405-2175-4d73-9e7e-f7a406435498 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:44:02.939571 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc32405-2175-4d73-9e7e-f7a406435498 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:44:02.939839 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc32405-2175-4d73-9e7e-f7a406435498 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:44:02.999701 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:44:03.006622 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc32405-2175-4d73-9e7e-f7a406435498 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:44:03.008061 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc32405-2175-4d73-9e7e-f7a406435498 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:44:03.105493 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 620/1241] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Oct 4 11:44:02 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 11:44:03.111511 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc4d00d-4b27-46ef-9018-04ec53721432 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:44:03.138770 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:44:03.209475 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc4d00d-4b27-46ef-9018-04ec53721432 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:44:03.243119 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915dda6d-ca2d-4a2d-acb7-674fadff3e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:44:03.243731 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915dda6d-ca2d-4a2d-acb7-674fadff3e7b None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:44:03.244005 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915dda6d-ca2d-4a2d-acb7-674fadff3e7b None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:44:03.244271 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915dda6d-ca2d-4a2d-acb7-674fadff3e7b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:44:03.255669 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915dda6d-ca2d-4a2d-acb7-674fadff3e7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:44:03.256902 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915dda6d-ca2d-4a2d-acb7-674fadff3e7b None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:44:03.271601 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-915dda6d-ca2d-4a2d-acb7-674fadff3e7b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:44:03.271601 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:44:03.271601 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:44:03.271601 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:44:03.271601 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:44:03.271601 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:44:03.271601 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:44:03.271601 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:44:03.271601 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:44:03.271601 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:44:03.271601 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:44:03.271601 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:44:03.271601 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 11:44:03.271601 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 11:44:03.271601 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 11:44:03.271601 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 11:44:03.272756 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:44:03.272756 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:44:03.272756 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:44:03.272756 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:44:03.272756 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:44:03.272756 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:44:03.272756 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:44:03.272756 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:44:03.272756 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:44:03.272756 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:44:03.272756 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:44:03.272756 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:44:03.272756 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:44:03.272756 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:44:03.272756 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:44:03.272756 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:44:03.272756 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 11:44:03.273807 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 11:44:03.273807 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:44:03.273807 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:44:03.273807 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 622/1242] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Oct 4 11:44:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:44:03.278565 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc32405-2175-4d73-9e7e-f7a406435498 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:44:03.369505 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:44:03.375033 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc32405-2175-4d73-9e7e-f7a406435498 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:44:03.408353 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1783af-ee98-43dc-b00c-c40030468473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:44:03.412539 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1783af-ee98-43dc-b00c-c40030468473 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:44:03.412539 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1783af-ee98-43dc-b00c-c40030468473 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:44:03.412539 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1783af-ee98-43dc-b00c-c40030468473 None admin] PATH_INFO: `/v3/domains` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:44:03.412539 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1783af-ee98-43dc-b00c-c40030468473 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:44:03.412539 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1783af-ee98-43dc-b00c-c40030468473 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:44:03.412539 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1783af-ee98-43dc-b00c-c40030468473 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:44:03.423255 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 621/1243] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Oct 4 11:44:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:44:03.429226 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915dda6d-ca2d-4a2d-acb7-674fadff3e7b None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:44:03.506801 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:44:03.528440 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915dda6d-ca2d-4a2d-acb7-674fadff3e7b None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:44:03.562754 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bcef3a-e723-4051-a3c3-39ecd4400dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:44:03.563441 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bcef3a-e723-4051-a3c3-39ecd4400dd1 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:44:03.563775 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bcef3a-e723-4051-a3c3-39ecd4400dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:44:03.564045 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bcef3a-e723-4051-a3c3-39ecd4400dd1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:44:03.571125 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bcef3a-e723-4051-a3c3-39ecd4400dd1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:44:03.572778 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bcef3a-e723-4051-a3c3-39ecd4400dd1 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:44:03.583894 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-c0bcef3a-e723-4051-a3c3-39ecd4400dd1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 11:44:03.583894 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:44:03.583894 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:44:03.583894 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:44:03.583894 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:44:03.583894 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:44:03.583894 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:44:03.583894 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:44:03.583894 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:44:03.583894 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:44:03.583894 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:44:03.583894 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:44:03.583894 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 11:44:03.583894 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 11:44:03.583894 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 11:44:03.584957 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 11:44:03.584957 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:44:03.584957 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:44:03.584957 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:44:03.584957 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:44:03.584957 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:44:03.584957 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:44:03.584957 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:44:03.584957 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:44:03.584957 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:44:03.584957 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:44:03.584957 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:44:03.584957 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:44:03.584957 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:44:03.584957 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:44:03.584957 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:44:03.584957 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:44:03.586088 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 11:44:03.586088 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 11:44:03.586088 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 11:44:03.586088 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 11:44:03.586088 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 11:44:03.586088 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 11:44:03.586088 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 11:44:03.586088 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:44:03.586088 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 623/1244] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Oct 4 11:44:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:44:03.592783 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1783af-ee98-43dc-b00c-c40030468473 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:44:03.696332 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1783af-ee98-43dc-b00c-c40030468473 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:44:03.729159 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d007d0a8-370b-4ae1-8bbd-ba2a7c383668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:44:03.729756 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d007d0a8-370b-4ae1-8bbd-ba2a7c383668 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:44:03.730031 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d007d0a8-370b-4ae1-8bbd-ba2a7c383668 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:44:03.730299 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d007d0a8-370b-4ae1-8bbd-ba2a7c383668 None admin] PATH_INFO: `/v3/projects` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:44:03.730969 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d007d0a8-370b-4ae1-8bbd-ba2a7c383668 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:44:03.731265 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d007d0a8-370b-4ae1-8bbd-ba2a7c383668 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:44:03.732716 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d007d0a8-370b-4ae1-8bbd-ba2a7c383668 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:44:03.744968 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 622/1245] 10.222.0.59 () {56 vars in 1148 bytes} [Tue Oct 4 11:44:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:44:03.751252 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bcef3a-e723-4051-a3c3-39ecd4400dd1 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:44:03.851383 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bcef3a-e723-4051-a3c3-39ecd4400dd1 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:44:03.884195 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2122c7-cf11-4f7f-a8d5-25d52f778bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:44:03.884822 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2122c7-cf11-4f7f-a8d5-25d52f778bb6 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:44:03.885099 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2122c7-cf11-4f7f-a8d5-25d52f778bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:44:03.885368 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2122c7-cf11-4f7f-a8d5-25d52f778bb6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:44:03.886076 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2122c7-cf11-4f7f-a8d5-25d52f778bb6 None admin] RBAC: Adding query filter params (role.id=01769bbdbd2e48f2bf8e855ba6a8507e, scope.project.id=39913dbe3e984f27a61493dd75381501, user.id=be119968b02440adbbbc85c553077b92) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:44:03.886377 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2122c7-cf11-4f7f-a8d5-25d52f778bb6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:44:03.887789 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2122c7-cf11-4f7f-a8d5-25d52f778bb6 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:44:03.893372 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 624/1246] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Oct 4 11:44:03 2022] GET /identity/v3/role_assignments?user.id=be119968b02440adbbbc85c553077b92&scope.project.id=39913dbe3e984f27a61493dd75381501&role.id=01769bbdbd2e48f2bf8e855ba6a8507e => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:44:06.111616 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883c6e9b-fc59-4979-8946-9ee462e71967 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:44:06.112195 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883c6e9b-fc59-4979-8946-9ee462e71967 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:44:06.112195 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883c6e9b-fc59-4979-8946-9ee462e71967 None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:44:06.113522 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 623/1247] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:44:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:44:06.119018 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b37dce4-cf29-44d0-b4ef-11e99f73eb6a None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:44:06.119407 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b37dce4-cf29-44d0-b4ef-11e99f73eb6a None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:44:06.122952 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b37dce4-cf29-44d0-b4ef-11e99f73eb6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:44:06.125774 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:44:06.138147 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-6b37dce4-cf29-44d0-b4ef-11e99f73eb6a None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:44:06.139375 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-6b37dce4-cf29-44d0-b4ef-11e99f73eb6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:44:06.205584 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 625/1248] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:44:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 11:44:06.472826 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883c6e9b-fc59-4979-8946-9ee462e71967 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:44:06.491349 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:44:06.577047 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883c6e9b-fc59-4979-8946-9ee462e71967 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:44:06.611413 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9733d70f-b3cc-48a2-85bb-bc2c526b42f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:44:06.612084 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9733d70f-b3cc-48a2-85bb-bc2c526b42f8 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:44:06.612362 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9733d70f-b3cc-48a2-85bb-bc2c526b42f8 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:44:06.612657 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9733d70f-b3cc-48a2-85bb-bc2c526b42f8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:44:06.622818 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9733d70f-b3cc-48a2-85bb-bc2c526b42f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 11:44:06.627557 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-9733d70f-b3cc-48a2-85bb-bc2c526b42f8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 11:44:06.627557 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:44:06.627557 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:44:06.627557 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:44:06.627557 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:44:06.627557 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:44:06.627557 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:44:06.627557 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:44:06.627557 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:44:06.627557 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:44:06.627557 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:44:06.627557 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:44:06.627557 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 11:44:06.627557 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 11:44:06.627557 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 11:44:06.627557 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 11:44:06.628792 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 11:44:06.628792 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 11:44:06.628792 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 11:44:06.628792 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 11:44:06.628792 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:44:06.628792 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:44:06.628792 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:44:06.628792 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:44:06.628792 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:44:06.628792 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:44:06.628792 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:44:06.628792 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:44:06.628792 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:44:06.628792 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:44:06.628792 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:44:06.628792 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:44:06.630574 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:44:06.630574 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:44:06.630574 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:44:06.630574 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:44:06.630574 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 11:44:06.630574 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 11:44:06.630574 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 11:44:06.630574 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 11:44:06.630574 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 11:44:06.630574 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 11:44:06.630574 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 11:44:06.630574 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:44:06.630574 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 624/1249] 10.222.0.59 () {56 vars in 1096 bytes} [Tue Oct 4 11:44:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:44:06.635499 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b37dce4-cf29-44d0-b4ef-11e99f73eb6a None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:44:06.732063 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b37dce4-cf29-44d0-b4ef-11e99f73eb6a None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:44:06.761489 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:44:06.766231 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33648b2e-16cd-4e71-a8fd-50a107df0565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:44:06.766831 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33648b2e-16cd-4e71-a8fd-50a107df0565 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:44:06.767113 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33648b2e-16cd-4e71-a8fd-50a107df0565 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:44:06.767424 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33648b2e-16cd-4e71-a8fd-50a107df0565 None admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:44:06.768078 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33648b2e-16cd-4e71-a8fd-50a107df0565 None admin] RBAC: Adding query filter params (name=admin) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:44:06.768379 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33648b2e-16cd-4e71-a8fd-50a107df0565 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:44:06.769804 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33648b2e-16cd-4e71-a8fd-50a107df0565 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:44:06.778452 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 626/1250] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Oct 4 11:44:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:44:06.784494 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9733d70f-b3cc-48a2-85bb-bc2c526b42f8 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:44:06.861392 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:44:06.884943 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9733d70f-b3cc-48a2-85bb-bc2c526b42f8 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:44:06.918426 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58c5949-d42d-4bac-9e11-60670cfbe008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:44:06.921266 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58c5949-d42d-4bac-9e11-60670cfbe008 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:44:06.921266 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58c5949-d42d-4bac-9e11-60670cfbe008 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:44:06.921266 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58c5949-d42d-4bac-9e11-60670cfbe008 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:44:06.930074 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58c5949-d42d-4bac-9e11-60670cfbe008 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:44:06.931501 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58c5949-d42d-4bac-9e11-60670cfbe008 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:44:06.945969 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-e58c5949-d42d-4bac-9e11-60670cfbe008 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:44:06.945969 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:44:06.945969 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:44:06.945969 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:44:06.945969 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:44:06.945969 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:44:06.945969 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:44:06.945969 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:44:06.945969 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:44:06.945969 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:44:06.945969 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:44:06.945969 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:44:06.945969 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 11:44:06.945969 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 11:44:06.945969 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 11:44:06.945969 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 11:44:06.947131 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:44:06.947131 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:44:06.947131 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:44:06.947131 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:44:06.947131 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:44:06.947131 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:44:06.947131 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:44:06.947131 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:44:06.947131 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:44:06.947131 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:44:06.947131 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:44:06.947131 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:44:06.947131 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:44:06.947131 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:44:06.947131 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:44:06.947131 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:44:06.947131 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 11:44:06.948115 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 11:44:06.948115 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:44:06.948115 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:44:06.948115 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 625/1251] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Oct 4 11:44:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:44:06.953193 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33648b2e-16cd-4e71-a8fd-50a107df0565 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:44:07.062841 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33648b2e-16cd-4e71-a8fd-50a107df0565 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:44:07.097067 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55853352-fce6-4449-97f8-89b891b3a57c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:44:07.097671 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55853352-fce6-4449-97f8-89b891b3a57c None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:44:07.097951 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55853352-fce6-4449-97f8-89b891b3a57c None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:44:07.098226 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55853352-fce6-4449-97f8-89b891b3a57c None admin] PATH_INFO: `/v3/domains` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:44:07.099517 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55853352-fce6-4449-97f8-89b891b3a57c None admin] RBAC: Adding query filter params (name=Default) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:44:07.099817 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55853352-fce6-4449-97f8-89b891b3a57c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:44:07.101212 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55853352-fce6-4449-97f8-89b891b3a57c None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:44:07.112819 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 627/1252] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Oct 4 11:44:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:44:07.118744 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58c5949-d42d-4bac-9e11-60670cfbe008 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:44:07.216330 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58c5949-d42d-4bac-9e11-60670cfbe008 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:44:07.243321 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:44:07.255050 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5f5b3e-3214-4bbb-bd40-363bbfd66ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:44:07.256410 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5f5b3e-3214-4bbb-bd40-363bbfd66ac1 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:44:07.257119 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5f5b3e-3214-4bbb-bd40-363bbfd66ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:44:07.257697 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5f5b3e-3214-4bbb-bd40-363bbfd66ac1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:44:07.269505 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5f5b3e-3214-4bbb-bd40-363bbfd66ac1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:44:07.271588 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5f5b3e-3214-4bbb-bd40-363bbfd66ac1 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:44:07.282484 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-3e5f5b3e-3214-4bbb-bd40-363bbfd66ac1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 04 11:44:07.282484 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:44:07.282484 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:44:07.282484 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:44:07.282484 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:44:07.282484 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:44:07.282484 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:44:07.282484 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:44:07.282484 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:44:07.282484 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:44:07.282484 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:44:07.282484 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:44:07.282484 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 11:44:07.282484 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 11:44:07.282484 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 11:44:07.282484 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 11:44:07.283629 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:44:07.283629 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:44:07.283629 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 11:44:07.283629 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 11:44:07.283629 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 11:44:07.283629 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 11:44:07.283629 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:44:07.283629 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:44:07.283629 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:44:07.283629 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:44:07.283629 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:44:07.283629 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:44:07.283629 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:44:07.283629 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:44:07.283629 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:44:07.283629 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:44:07.283629 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:44:07.283629 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:44:07.285009 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:44:07.285009 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:44:07.285009 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 11:44:07.285009 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 11:44:07.285009 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 11:44:07.285009 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 11:44:07.285009 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 11:44:07.285009 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 11:44:07.285009 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 04 11:44:07.285009 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:44:07.285009 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 626/1253] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Oct 4 11:44:07 2022] GET /identity/v3/users/placement => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:44:07.290342 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55853352-fce6-4449-97f8-89b891b3a57c None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:44:07.347576 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:44:07.390150 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55853352-fce6-4449-97f8-89b891b3a57c None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:44:07.422454 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe4658e-f5d7-41f0-ad6f-2cf6ac3ee957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:44:07.423054 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe4658e-f5d7-41f0-ad6f-2cf6ac3ee957 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:44:07.423333 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe4658e-f5d7-41f0-ad6f-2cf6ac3ee957 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:44:07.423600 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe4658e-f5d7-41f0-ad6f-2cf6ac3ee957 None admin] PATH_INFO: `/v3/users` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:44:07.424316 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe4658e-f5d7-41f0-ad6f-2cf6ac3ee957 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:44:07.424636 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe4658e-f5d7-41f0-ad6f-2cf6ac3ee957 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:44:07.426060 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe4658e-f5d7-41f0-ad6f-2cf6ac3ee957 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:44:07.443705 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 628/1254] 10.222.0.59 () {56 vars in 1143 bytes} [Tue Oct 4 11:44:07 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:44:07.449591 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5f5b3e-3214-4bbb-bd40-363bbfd66ac1 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:44:07.548003 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5f5b3e-3214-4bbb-bd40-363bbfd66ac1 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:44:07.580586 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a69c1e7-cfde-4178-807a-09a6dbe9f0c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:44:07.581216 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a69c1e7-cfde-4178-807a-09a6dbe9f0c4 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:44:07.581497 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a69c1e7-cfde-4178-807a-09a6dbe9f0c4 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:44:07.581770 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a69c1e7-cfde-4178-807a-09a6dbe9f0c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:44:07.636003 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:44:07.648133 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a69c1e7-cfde-4178-807a-09a6dbe9f0c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:44:07.649611 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a69c1e7-cfde-4178-807a-09a6dbe9f0c4 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:44:07.744381 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 627/1255] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Oct 4 11:44:07 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 11:44:07.749911 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe4658e-f5d7-41f0-ad6f-2cf6ac3ee957 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:44:07.846886 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe4658e-f5d7-41f0-ad6f-2cf6ac3ee957 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:44:07.859782 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:44:07.882132 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b329e22a-0d0c-4970-b71e-a85c600214c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:44:07.882755 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b329e22a-0d0c-4970-b71e-a85c600214c0 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:44:07.883035 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b329e22a-0d0c-4970-b71e-a85c600214c0 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:44:07.883305 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b329e22a-0d0c-4970-b71e-a85c600214c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:44:07.893031 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b329e22a-0d0c-4970-b71e-a85c600214c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:44:07.894406 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b329e22a-0d0c-4970-b71e-a85c600214c0 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:44:07.908744 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-b329e22a-0d0c-4970-b71e-a85c600214c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:44:07.908744 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:44:07.908744 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:44:07.908744 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:44:07.908744 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:44:07.908744 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:44:07.908744 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:44:07.908744 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:44:07.908744 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:44:07.908744 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:44:07.908744 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:44:07.908744 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:44:07.908744 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 11:44:07.908744 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 11:44:07.908744 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 11:44:07.908744 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 11:44:07.909827 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:44:07.909827 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:44:07.909827 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:44:07.909827 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:44:07.909827 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:44:07.909827 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:44:07.909827 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:44:07.909827 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:44:07.909827 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:44:07.909827 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:44:07.909827 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:44:07.909827 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:44:07.909827 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:44:07.909827 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:44:07.909827 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:44:07.909827 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:44:07.909827 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 11:44:07.911094 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 11:44:07.911094 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:44:07.911094 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:44:07.911094 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 629/1256] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Oct 4 11:44:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:44:07.916069 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a69c1e7-cfde-4178-807a-09a6dbe9f0c4 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:44:08.001114 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:44:08.013087 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a69c1e7-cfde-4178-807a-09a6dbe9f0c4 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:44:08.046350 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e521e20e-eb39-42e4-9a63-e7c09b52e738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:44:08.049617 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e521e20e-eb39-42e4-9a63-e7c09b52e738 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:44:08.049617 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e521e20e-eb39-42e4-9a63-e7c09b52e738 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:44:08.049617 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e521e20e-eb39-42e4-9a63-e7c09b52e738 None admin] PATH_INFO: `/v3/domains` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:44:08.049617 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e521e20e-eb39-42e4-9a63-e7c09b52e738 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:44:08.049617 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e521e20e-eb39-42e4-9a63-e7c09b52e738 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:44:08.050084 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e521e20e-eb39-42e4-9a63-e7c09b52e738 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:44:08.062552 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 628/1257] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Oct 4 11:44:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:44:08.068718 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b329e22a-0d0c-4970-b71e-a85c600214c0 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:44:08.167848 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b329e22a-0d0c-4970-b71e-a85c600214c0 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:44:08.201984 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed13f62a-9b67-4ad6-9ded-165ae7987185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:44:08.202599 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed13f62a-9b67-4ad6-9ded-165ae7987185 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:44:08.202880 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed13f62a-9b67-4ad6-9ded-165ae7987185 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:44:08.203159 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed13f62a-9b67-4ad6-9ded-165ae7987185 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:44:08.210006 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed13f62a-9b67-4ad6-9ded-165ae7987185 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:44:08.211452 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed13f62a-9b67-4ad6-9ded-165ae7987185 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:44:08.223944 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-ed13f62a-9b67-4ad6-9ded-165ae7987185 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 11:44:08.223944 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:44:08.223944 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:44:08.223944 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:44:08.223944 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:44:08.223944 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:44:08.223944 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:44:08.223944 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:44:08.223944 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:44:08.223944 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:44:08.223944 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:44:08.223944 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:44:08.223944 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 11:44:08.223944 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 11:44:08.223944 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 11:44:08.236589 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 11:44:08.236589 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:44:08.236589 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:44:08.236589 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:44:08.236589 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:44:08.236589 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:44:08.236589 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:44:08.236589 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:44:08.236589 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:44:08.236589 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:44:08.236589 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:44:08.236589 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:44:08.236589 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:44:08.236589 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:44:08.236589 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:44:08.236589 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:44:08.236589 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:44:08.237763 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 11:44:08.237763 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 11:44:08.237763 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 11:44:08.237763 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 11:44:08.237763 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 11:44:08.237763 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 11:44:08.237763 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 11:44:08.237763 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:44:08.237763 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 630/1258] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Oct 4 11:44:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 11:44:08.238373 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e521e20e-eb39-42e4-9a63-e7c09b52e738 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:44:08.329892 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e521e20e-eb39-42e4-9a63-e7c09b52e738 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:44:08.369616 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c4c41f-0ad9-4a94-868d-b5e97f94a357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:44:08.370227 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c4c41f-0ad9-4a94-868d-b5e97f94a357 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:44:08.370508 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c4c41f-0ad9-4a94-868d-b5e97f94a357 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:44:08.370785 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c4c41f-0ad9-4a94-868d-b5e97f94a357 None admin] PATH_INFO: `/v3/projects` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:44:08.371476 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c4c41f-0ad9-4a94-868d-b5e97f94a357 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:44:08.371782 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c4c41f-0ad9-4a94-868d-b5e97f94a357 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:44:08.373306 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c4c41f-0ad9-4a94-868d-b5e97f94a357 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:44:08.385638 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 629/1259] 10.222.0.59 () {56 vars in 1148 bytes} [Tue Oct 4 11:44:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:44:08.391891 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed13f62a-9b67-4ad6-9ded-165ae7987185 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:44:08.418024 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:44:08.490704 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed13f62a-9b67-4ad6-9ded-165ae7987185 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:44:08.529371 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2d55e4-3fbf-4cc0-a1dd-d85b8c59629e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:44:08.529981 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2d55e4-3fbf-4cc0-a1dd-d85b8c59629e None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:44:08.530256 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2d55e4-3fbf-4cc0-a1dd-d85b8c59629e None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:44:08.530523 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2d55e4-3fbf-4cc0-a1dd-d85b8c59629e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:44:08.531236 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2d55e4-3fbf-4cc0-a1dd-d85b8c59629e None admin] RBAC: Adding query filter params (role.id=d6e7421d1ff9451c808004b818354550, scope.project.id=39913dbe3e984f27a61493dd75381501, user.id=be119968b02440adbbbc85c553077b92) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:44:08.531539 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2d55e4-3fbf-4cc0-a1dd-d85b8c59629e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:44:08.533012 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2d55e4-3fbf-4cc0-a1dd-d85b8c59629e None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:44:08.539297 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 631/1260] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Oct 4 11:44:08 2022] GET /identity/v3/role_assignments?user.id=be119968b02440adbbbc85c553077b92&scope.project.id=39913dbe3e984f27a61493dd75381501&role.id=d6e7421d1ff9451c808004b818354550 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:44:10.682837 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe89ab4f-e0e2-4143-b705-4b8a12c67066 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:44:10.683410 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe89ab4f-e0e2-4143-b705-4b8a12c67066 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:44:10.683410 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe89ab4f-e0e2-4143-b705-4b8a12c67066 None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:44:10.684722 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 630/1261] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:44:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:44:10.689787 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4570792-7686-4e1f-af6a-5f812aabd579 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:44:10.690184 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4570792-7686-4e1f-af6a-5f812aabd579 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:44:10.690363 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4570792-7686-4e1f-af6a-5f812aabd579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:44:10.709934 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-f4570792-7686-4e1f-af6a-5f812aabd579 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:44:10.717161 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-f4570792-7686-4e1f-af6a-5f812aabd579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:44:10.779840 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 632/1262] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:44:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 11:44:11.062701 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe89ab4f-e0e2-4143-b705-4b8a12c67066 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:44:11.074023 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:44:11.163999 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe89ab4f-e0e2-4143-b705-4b8a12c67066 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:44:11.198688 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5c0526-2823-4ff5-97f5-6461e7a01e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:44:11.199306 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5c0526-2823-4ff5-97f5-6461e7a01e62 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:44:11.199584 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5c0526-2823-4ff5-97f5-6461e7a01e62 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:44:11.199851 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5c0526-2823-4ff5-97f5-6461e7a01e62 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:44:11.210642 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5c0526-2823-4ff5-97f5-6461e7a01e62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 11:44:11.215771 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-4d5c0526-2823-4ff5-97f5-6461e7a01e62 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 11:44:11.215771 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:44:11.215771 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:44:11.215771 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:44:11.215771 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:44:11.215771 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:44:11.215771 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:44:11.215771 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:44:11.215771 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:44:11.215771 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:44:11.215771 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:44:11.215771 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:44:11.215771 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 11:44:11.215771 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 11:44:11.215771 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 11:44:11.215771 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 11:44:11.218940 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 11:44:11.218940 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 11:44:11.218940 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 11:44:11.218940 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 11:44:11.218940 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:44:11.218940 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:44:11.218940 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:44:11.218940 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:44:11.218940 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:44:11.218940 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:44:11.218940 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:44:11.218940 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:44:11.218940 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:44:11.218940 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:44:11.218940 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:44:11.218940 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:44:11.219873 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:44:11.219873 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:44:11.219873 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:44:11.219873 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:44:11.219873 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 11:44:11.219873 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 11:44:11.219873 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 11:44:11.219873 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 11:44:11.219873 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 11:44:11.219873 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 11:44:11.219873 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 11:44:11.219873 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:44:11.219873 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 631/1263] 10.222.0.59 () {56 vars in 1096 bytes} [Tue Oct 4 11:44:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:44:11.223994 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4570792-7686-4e1f-af6a-5f812aabd579 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:44:11.241893 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:44:11.320985 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4570792-7686-4e1f-af6a-5f812aabd579 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:44:11.355575 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12badd2f-79f0-4593-99db-d887080b924d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:44:11.356177 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12badd2f-79f0-4593-99db-d887080b924d None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:44:11.356472 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12badd2f-79f0-4593-99db-d887080b924d None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:44:11.356763 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12badd2f-79f0-4593-99db-d887080b924d None admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:44:11.357421 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12badd2f-79f0-4593-99db-d887080b924d None admin] RBAC: Adding query filter params (name=admin) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:44:11.357724 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12badd2f-79f0-4593-99db-d887080b924d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:44:11.359087 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12badd2f-79f0-4593-99db-d887080b924d None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:44:11.367299 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 633/1264] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Oct 4 11:44:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:44:11.373107 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5c0526-2823-4ff5-97f5-6461e7a01e62 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:44:11.444554 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:44:11.476473 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5c0526-2823-4ff5-97f5-6461e7a01e62 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:44:11.511056 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c60a5ab-6a7c-415b-b449-762714881b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:44:11.511688 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c60a5ab-6a7c-415b-b449-762714881b14 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:44:11.511964 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c60a5ab-6a7c-415b-b449-762714881b14 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:44:11.512232 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c60a5ab-6a7c-415b-b449-762714881b14 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:44:11.523331 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c60a5ab-6a7c-415b-b449-762714881b14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:44:11.524828 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c60a5ab-6a7c-415b-b449-762714881b14 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:44:11.539345 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-3c60a5ab-6a7c-415b-b449-762714881b14 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:44:11.539345 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:44:11.539345 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:44:11.539345 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:44:11.539345 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:44:11.539345 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:44:11.539345 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:44:11.539345 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:44:11.539345 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:44:11.539345 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:44:11.539345 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:44:11.539345 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:44:11.539345 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 11:44:11.539345 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 11:44:11.539345 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 11:44:11.539345 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 11:44:11.541119 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:44:11.541119 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:44:11.541119 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:44:11.541119 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:44:11.541119 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:44:11.541119 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:44:11.541119 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:44:11.541119 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:44:11.541119 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:44:11.541119 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:44:11.541119 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:44:11.541119 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:44:11.541119 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:44:11.541119 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:44:11.541119 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:44:11.541119 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:44:11.541119 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 11:44:11.542217 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 11:44:11.542217 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:44:11.542217 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:44:11.542217 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 632/1265] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Oct 4 11:44:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 11:44:11.546216 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12badd2f-79f0-4593-99db-d887080b924d None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:44:11.627213 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:44:11.646557 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12badd2f-79f0-4593-99db-d887080b924d None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:44:11.679929 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f186b26-2979-4e7c-a708-5c4df722b9c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:44:11.680528 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f186b26-2979-4e7c-a708-5c4df722b9c9 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:44:11.680839 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f186b26-2979-4e7c-a708-5c4df722b9c9 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:44:11.681115 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f186b26-2979-4e7c-a708-5c4df722b9c9 None admin] PATH_INFO: `/v3/domains` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:44:11.681754 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f186b26-2979-4e7c-a708-5c4df722b9c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:44:11.682058 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f186b26-2979-4e7c-a708-5c4df722b9c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:44:11.683423 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f186b26-2979-4e7c-a708-5c4df722b9c9 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:44:11.696949 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 634/1266] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Oct 4 11:44:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:44:11.703238 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c60a5ab-6a7c-415b-b449-762714881b14 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:44:11.802928 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c60a5ab-6a7c-415b-b449-762714881b14 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:44:11.822321 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:44:11.836283 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda25e76-b3e1-4d63-b2b2-febf90491846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:44:11.836934 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda25e76-b3e1-4d63-b2b2-febf90491846 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:44:11.837208 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda25e76-b3e1-4d63-b2b2-febf90491846 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:44:11.837473 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda25e76-b3e1-4d63-b2b2-febf90491846 None admin] PATH_INFO: `/v3/users/placement` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:44:11.844822 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda25e76-b3e1-4d63-b2b2-febf90491846 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:44:11.846535 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda25e76-b3e1-4d63-b2b2-febf90491846 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:44:11.857372 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-cda25e76-b3e1-4d63-b2b2-febf90491846 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 04 11:44:11.857372 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:44:11.857372 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:44:11.857372 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:44:11.857372 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:44:11.857372 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:44:11.857372 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:44:11.857372 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:44:11.857372 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:44:11.857372 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:44:11.857372 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:44:11.857372 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:44:11.857372 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 11:44:11.857372 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 11:44:11.857372 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 11:44:11.857372 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 11:44:11.858579 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:44:11.858579 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:44:11.858579 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 11:44:11.858579 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 11:44:11.858579 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 11:44:11.858579 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 11:44:11.858579 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:44:11.858579 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:44:11.858579 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:44:11.858579 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:44:11.858579 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:44:11.858579 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:44:11.858579 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:44:11.858579 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:44:11.858579 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:44:11.858579 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:44:11.858579 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:44:11.858579 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:44:11.859769 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:44:11.859769 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:44:11.859769 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 11:44:11.859769 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 11:44:11.859769 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 11:44:11.859769 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 11:44:11.859769 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 11:44:11.859769 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 11:44:11.859769 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 04 11:44:11.859769 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:44:11.859769 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 633/1267] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Oct 4 11:44:11 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:44:11.864711 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f186b26-2979-4e7c-a708-5c4df722b9c9 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:44:11.969164 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f186b26-2979-4e7c-a708-5c4df722b9c9 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:44:12.003965 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc03600-a5a7-46f2-b505-237a15fa5d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:44:12.005566 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc03600-a5a7-46f2-b505-237a15fa5d1a None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:44:12.005847 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc03600-a5a7-46f2-b505-237a15fa5d1a None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:44:12.006121 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc03600-a5a7-46f2-b505-237a15fa5d1a None admin] PATH_INFO: `/v3/users` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:44:12.006991 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc03600-a5a7-46f2-b505-237a15fa5d1a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:44:12.007542 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc03600-a5a7-46f2-b505-237a15fa5d1a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:44:12.009003 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc03600-a5a7-46f2-b505-237a15fa5d1a None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:44:12.018779 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:44:12.027779 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 635/1268] 10.222.0.59 () {56 vars in 1143 bytes} [Tue Oct 4 11:44:11 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 11:44:12.033711 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda25e76-b3e1-4d63-b2b2-febf90491846 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:44:12.133885 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda25e76-b3e1-4d63-b2b2-febf90491846 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:44:12.168659 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae1ed24-29c2-492f-88fd-60e477950f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:44:12.169282 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae1ed24-29c2-492f-88fd-60e477950f2e None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:44:12.169558 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae1ed24-29c2-492f-88fd-60e477950f2e None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:44:12.169828 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae1ed24-29c2-492f-88fd-60e477950f2e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:44:12.180560 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae1ed24-29c2-492f-88fd-60e477950f2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:44:12.182019 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae1ed24-29c2-492f-88fd-60e477950f2e None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:44:12.196290 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-0ae1ed24-29c2-492f-88fd-60e477950f2e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:44:12.196290 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:44:12.196290 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:44:12.196290 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:44:12.196290 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:44:12.196290 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:44:12.196290 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:44:12.196290 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:44:12.196290 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:44:12.196290 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:44:12.196290 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:44:12.196290 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:44:12.196290 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 11:44:12.196290 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 11:44:12.196290 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 11:44:12.196290 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 11:44:12.197492 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:44:12.197492 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:44:12.197492 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:44:12.197492 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:44:12.197492 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:44:12.197492 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:44:12.197492 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:44:12.197492 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:44:12.197492 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:44:12.197492 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:44:12.197492 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:44:12.197492 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:44:12.197492 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:44:12.197492 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:44:12.197492 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:44:12.197492 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:44:12.197492 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 11:44:12.198632 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 11:44:12.198632 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:44:12.198632 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:44:12.198632 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 634/1269] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Oct 4 11:44:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:44:12.203277 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc03600-a5a7-46f2-b505-237a15fa5d1a None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:44:12.301868 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc03600-a5a7-46f2-b505-237a15fa5d1a None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:44:12.343237 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b967676-abda-4134-9477-adc8bd3c3865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:44:12.344088 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b967676-abda-4134-9477-adc8bd3c3865 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:44:12.344493 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b967676-abda-4134-9477-adc8bd3c3865 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:44:12.344969 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b967676-abda-4134-9477-adc8bd3c3865 None admin] PATH_INFO: `/v3/domains` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:44:12.346163 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b967676-abda-4134-9477-adc8bd3c3865 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:44:12.346609 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b967676-abda-4134-9477-adc8bd3c3865 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:44:12.349013 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b967676-abda-4134-9477-adc8bd3c3865 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:44:12.364841 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 636/1270] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Oct 4 11:44:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:44:12.370890 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae1ed24-29c2-492f-88fd-60e477950f2e None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:44:12.418773 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:44:12.485380 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae1ed24-29c2-492f-88fd-60e477950f2e None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:44:12.518913 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580a2de5-a6ec-4f4b-b3e0-88aa4b5cc8b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:44:12.519565 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580a2de5-a6ec-4f4b-b3e0-88aa4b5cc8b2 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:44:12.519857 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580a2de5-a6ec-4f4b-b3e0-88aa4b5cc8b2 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:44:12.520470 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580a2de5-a6ec-4f4b-b3e0-88aa4b5cc8b2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:44:12.527652 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580a2de5-a6ec-4f4b-b3e0-88aa4b5cc8b2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:44:12.528496 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580a2de5-a6ec-4f4b-b3e0-88aa4b5cc8b2 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:44:12.541079 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-580a2de5-a6ec-4f4b-b3e0-88aa4b5cc8b2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 11:44:12.541079 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:44:12.541079 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:44:12.541079 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:44:12.541079 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:44:12.541079 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:44:12.541079 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:44:12.541079 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:44:12.541079 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:44:12.541079 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:44:12.541079 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:44:12.541079 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:44:12.541079 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 11:44:12.541079 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 11:44:12.541079 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 11:44:12.542188 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 11:44:12.542188 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:44:12.542188 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:44:12.542188 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:44:12.542188 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:44:12.542188 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:44:12.542188 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:44:12.542188 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:44:12.542188 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:44:12.542188 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:44:12.542188 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:44:12.542188 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:44:12.542188 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:44:12.542188 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:44:12.542188 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:44:12.542188 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:44:12.542188 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:44:12.543420 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 11:44:12.543420 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 11:44:12.543420 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 11:44:12.543420 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 11:44:12.543420 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 11:44:12.543420 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 11:44:12.543420 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 11:44:12.543420 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:44:12.543420 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 635/1271] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Oct 4 11:44:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 11:44:12.548034 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b967676-abda-4134-9477-adc8bd3c3865 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:44:12.607105 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:44:12.648302 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b967676-abda-4134-9477-adc8bd3c3865 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:44:12.683708 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242bc932-7f89-4dd8-980b-0616d9ed8458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:44:12.684313 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242bc932-7f89-4dd8-980b-0616d9ed8458 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:44:12.684592 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242bc932-7f89-4dd8-980b-0616d9ed8458 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:44:12.684906 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242bc932-7f89-4dd8-980b-0616d9ed8458 None admin] PATH_INFO: `/v3/projects` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:44:12.685768 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242bc932-7f89-4dd8-980b-0616d9ed8458 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:44:12.686565 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242bc932-7f89-4dd8-980b-0616d9ed8458 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:44:12.688041 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242bc932-7f89-4dd8-980b-0616d9ed8458 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:44:12.701035 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 637/1272] 10.222.0.59 () {56 vars in 1148 bytes} [Tue Oct 4 11:44:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:44:12.707097 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580a2de5-a6ec-4f4b-b3e0-88aa4b5cc8b2 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:44:12.801019 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:44:12.809868 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580a2de5-a6ec-4f4b-b3e0-88aa4b5cc8b2 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:44:12.841533 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f46745-57b4-4d01-a0a3-eb0dd50297e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:44:12.842176 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f46745-57b4-4d01-a0a3-eb0dd50297e6 None admin] REQUEST_METHOD: `PUT` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:44:12.842451 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f46745-57b4-4d01-a0a3-eb0dd50297e6 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:44:12.842715 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f46745-57b4-4d01-a0a3-eb0dd50297e6 None admin] PATH_INFO: `/v3/projects/39913dbe3e984f27a61493dd75381501/users/be119968b02440adbbbc85c553077b92/roles/d6e7421d1ff9451c808004b818354550` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:44:12.844557 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f46745-57b4-4d01-a0a3-eb0dd50297e6 None admin] RBAC: Authorizing `identity:create_grant(project_id=39913dbe3e984f27a61493dd75381501, user_id=be119968b02440adbbbc85c553077b92, role_id=d6e7421d1ff9451c808004b818354550)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:44:12.846250 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f46745-57b4-4d01-a0a3-eb0dd50297e6 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:44:13.045086 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 636/1273] 10.222.0.59 () {58 vars in 1439 bytes} [Tue Oct 4 11:44:12 2022] PUT /identity/v3/projects/39913dbe3e984f27a61493dd75381501/users/be119968b02440adbbbc85c553077b92/roles/d6e7421d1ff9451c808004b818354550 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 11:44:15.222923 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9afb971-be3a-489b-a5cf-4c974b9ad874 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:44:15.223494 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9afb971-be3a-489b-a5cf-4c974b9ad874 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:44:15.224224 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9afb971-be3a-489b-a5cf-4c974b9ad874 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:44:15.225623 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 638/1274] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:44:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:44:15.230781 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bf1362-d04b-4162-966f-6c0c29bee051 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:44:15.235402 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bf1362-d04b-4162-966f-6c0c29bee051 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:44:15.235402 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bf1362-d04b-4162-966f-6c0c29bee051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:44:15.249469 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-80bf1362-d04b-4162-966f-6c0c29bee051 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:44:15.250680 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-80bf1362-d04b-4162-966f-6c0c29bee051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:44:15.315601 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 637/1275] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:44:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 11:44:15.581884 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9afb971-be3a-489b-a5cf-4c974b9ad874 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:44:15.680338 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9afb971-be3a-489b-a5cf-4c974b9ad874 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:44:15.698136 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:44:15.714772 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d2fcb6-6673-4371-b7d0-3f76042b52a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:44:15.715385 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d2fcb6-6673-4371-b7d0-3f76042b52a4 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:44:15.715661 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d2fcb6-6673-4371-b7d0-3f76042b52a4 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:44:15.715926 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d2fcb6-6673-4371-b7d0-3f76042b52a4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:44:15.725815 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d2fcb6-6673-4371-b7d0-3f76042b52a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 11:44:15.730522 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-c8d2fcb6-6673-4371-b7d0-3f76042b52a4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 11:44:15.730522 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:44:15.730522 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:44:15.730522 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:44:15.730522 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:44:15.730522 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:44:15.730522 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:44:15.730522 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:44:15.730522 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:44:15.730522 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:44:15.730522 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:44:15.730522 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:44:15.730522 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 11:44:15.730522 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 11:44:15.730522 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 11:44:15.730522 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 11:44:15.734838 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 11:44:15.734838 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 11:44:15.734838 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 11:44:15.734838 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 11:44:15.734838 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:44:15.734838 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:44:15.734838 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:44:15.734838 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:44:15.734838 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:44:15.734838 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:44:15.734838 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:44:15.734838 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:44:15.734838 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:44:15.734838 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:44:15.734838 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:44:15.734838 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:44:15.735762 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:44:15.735762 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:44:15.735762 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:44:15.735762 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:44:15.735762 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 11:44:15.735762 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 11:44:15.735762 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 11:44:15.735762 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 11:44:15.735762 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 11:44:15.735762 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 11:44:15.735762 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 11:44:15.735762 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:44:15.735762 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 639/1276] 10.222.0.59 () {56 vars in 1096 bytes} [Tue Oct 4 11:44:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:44:15.737826 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bf1362-d04b-4162-966f-6c0c29bee051 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:44:15.816671 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:44:15.839044 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bf1362-d04b-4162-966f-6c0c29bee051 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:44:15.872863 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1ff6eb-f649-4511-a3b3-23a5fa761e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:44:15.873467 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1ff6eb-f649-4511-a3b3-23a5fa761e38 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:44:15.873749 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1ff6eb-f649-4511-a3b3-23a5fa761e38 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:44:15.874023 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1ff6eb-f649-4511-a3b3-23a5fa761e38 None admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:44:15.874675 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1ff6eb-f649-4511-a3b3-23a5fa761e38 None admin] RBAC: Adding query filter params (name=admin) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:44:15.874979 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1ff6eb-f649-4511-a3b3-23a5fa761e38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:44:15.876636 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1ff6eb-f649-4511-a3b3-23a5fa761e38 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:44:15.884458 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 638/1277] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Oct 4 11:44:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:44:15.890655 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d2fcb6-6673-4371-b7d0-3f76042b52a4 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:44:15.989896 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d2fcb6-6673-4371-b7d0-3f76042b52a4 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:44:16.022704 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241267d0-bd7f-4908-a846-45fb154b1cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:44:16.023320 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241267d0-bd7f-4908-a846-45fb154b1cbf None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:44:16.023592 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241267d0-bd7f-4908-a846-45fb154b1cbf None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:44:16.023858 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241267d0-bd7f-4908-a846-45fb154b1cbf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:44:16.033517 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241267d0-bd7f-4908-a846-45fb154b1cbf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:44:16.034940 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241267d0-bd7f-4908-a846-45fb154b1cbf None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:44:16.050344 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-241267d0-bd7f-4908-a846-45fb154b1cbf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:44:16.050344 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:44:16.050344 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:44:16.050344 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:44:16.050344 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:44:16.050344 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:44:16.050344 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:44:16.050344 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:44:16.050344 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:44:16.050344 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:44:16.050344 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:44:16.050344 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:44:16.050344 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 11:44:16.050344 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 11:44:16.050344 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 11:44:16.050344 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 11:44:16.053217 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:44:16.053217 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:44:16.053217 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:44:16.053217 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:44:16.053217 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:44:16.053217 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:44:16.053217 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:44:16.053217 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:44:16.053217 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:44:16.053217 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:44:16.053217 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:44:16.053217 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:44:16.053217 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:44:16.053217 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:44:16.053217 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:44:16.053217 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:44:16.053217 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 11:44:16.054329 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 11:44:16.054329 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:44:16.054329 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:44:16.054329 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 640/1278] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Oct 4 11:44:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:44:16.057751 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1ff6eb-f649-4511-a3b3-23a5fa761e38 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:44:16.155840 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1ff6eb-f649-4511-a3b3-23a5fa761e38 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:44:16.191326 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3defb57-0abc-4242-b2c3-c1602912fecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:44:16.192012 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3defb57-0abc-4242-b2c3-c1602912fecd None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:44:16.192293 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3defb57-0abc-4242-b2c3-c1602912fecd None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:44:16.192584 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3defb57-0abc-4242-b2c3-c1602912fecd None admin] PATH_INFO: `/v3/domains` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:44:16.193407 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3defb57-0abc-4242-b2c3-c1602912fecd None admin] RBAC: Adding query filter params (name=Default) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:44:16.193704 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3defb57-0abc-4242-b2c3-c1602912fecd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:44:16.195053 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3defb57-0abc-4242-b2c3-c1602912fecd None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:44:16.206360 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 639/1279] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Oct 4 11:44:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:44:16.213006 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241267d0-bd7f-4908-a846-45fb154b1cbf None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:44:16.243637 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:44:16.310526 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241267d0-bd7f-4908-a846-45fb154b1cbf None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:44:16.343988 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0fab13-9254-4403-8be2-a6b9a5620e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:44:16.344628 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0fab13-9254-4403-8be2-a6b9a5620e6f None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:44:16.344914 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0fab13-9254-4403-8be2-a6b9a5620e6f None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:44:16.345185 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0fab13-9254-4403-8be2-a6b9a5620e6f None admin] PATH_INFO: `/v3/users/placement` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:44:16.352168 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0fab13-9254-4403-8be2-a6b9a5620e6f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:44:16.353649 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0fab13-9254-4403-8be2-a6b9a5620e6f None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:44:16.364947 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-8b0fab13-9254-4403-8be2-a6b9a5620e6f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 04 11:44:16.364947 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:44:16.364947 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:44:16.364947 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:44:16.364947 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:44:16.364947 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:44:16.364947 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:44:16.364947 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:44:16.364947 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:44:16.364947 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:44:16.364947 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:44:16.364947 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:44:16.364947 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 11:44:16.364947 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 11:44:16.364947 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 11:44:16.364947 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 11:44:16.366059 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:44:16.366059 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:44:16.366059 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 11:44:16.366059 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 11:44:16.366059 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 11:44:16.366059 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 11:44:16.366059 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:44:16.366059 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:44:16.366059 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:44:16.366059 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:44:16.366059 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:44:16.366059 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:44:16.366059 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:44:16.366059 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:44:16.366059 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:44:16.366059 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:44:16.366059 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:44:16.366059 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:44:16.367473 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:44:16.367473 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:44:16.367473 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 11:44:16.367473 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 11:44:16.367473 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 11:44:16.367473 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 11:44:16.367473 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 11:44:16.367473 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 11:44:16.367473 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 04 11:44:16.367473 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:44:16.367473 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 641/1280] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Oct 4 11:44:16 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:44:16.371846 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3defb57-0abc-4242-b2c3-c1602912fecd None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:44:16.376317 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:44:16.467097 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3defb57-0abc-4242-b2c3-c1602912fecd None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:44:16.499723 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8ebef9-7d3e-4055-b63b-faf0f43211ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:44:16.500534 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8ebef9-7d3e-4055-b63b-faf0f43211ef None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:44:16.501504 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8ebef9-7d3e-4055-b63b-faf0f43211ef None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:44:16.501776 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8ebef9-7d3e-4055-b63b-faf0f43211ef None admin] PATH_INFO: `/v3/users` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:44:16.502515 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8ebef9-7d3e-4055-b63b-faf0f43211ef None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:44:16.502811 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8ebef9-7d3e-4055-b63b-faf0f43211ef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:44:16.504216 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8ebef9-7d3e-4055-b63b-faf0f43211ef None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:44:16.523993 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 640/1281] 10.222.0.59 () {56 vars in 1143 bytes} [Tue Oct 4 11:44:16 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:44:16.529894 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0fab13-9254-4403-8be2-a6b9a5620e6f None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:44:16.618309 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:44:16.627697 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0fab13-9254-4403-8be2-a6b9a5620e6f None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:44:16.662062 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f55b73-59af-479e-a2c4-2f7bf6354b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:44:16.662655 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f55b73-59af-479e-a2c4-2f7bf6354b29 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:44:16.662930 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f55b73-59af-479e-a2c4-2f7bf6354b29 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:44:16.663199 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f55b73-59af-479e-a2c4-2f7bf6354b29 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:44:16.728880 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f55b73-59af-479e-a2c4-2f7bf6354b29 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:44:16.730247 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f55b73-59af-479e-a2c4-2f7bf6354b29 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:44:16.816557 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:44:16.827121 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 642/1282] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Oct 4 11:44:16 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 11:44:16.833395 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8ebef9-7d3e-4055-b63b-faf0f43211ef None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:44:16.895117 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:44:16.932956 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8ebef9-7d3e-4055-b63b-faf0f43211ef None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:44:16.966279 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c04c2fa-067a-406d-8b1a-5f3152432295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:44:16.966963 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c04c2fa-067a-406d-8b1a-5f3152432295 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:44:16.967239 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c04c2fa-067a-406d-8b1a-5f3152432295 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:44:16.967513 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c04c2fa-067a-406d-8b1a-5f3152432295 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:44:16.977784 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c04c2fa-067a-406d-8b1a-5f3152432295 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:44:16.979288 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c04c2fa-067a-406d-8b1a-5f3152432295 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:44:16.994162 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-8c04c2fa-067a-406d-8b1a-5f3152432295 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:44:16.994162 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:44:16.994162 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:44:16.994162 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:44:16.994162 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:44:16.994162 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:44:16.994162 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:44:16.994162 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:44:16.994162 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:44:16.994162 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:44:16.994162 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:44:16.994162 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:44:16.994162 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 11:44:16.994162 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 11:44:16.994162 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 11:44:16.994162 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 11:44:16.995312 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:44:16.995312 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:44:16.995312 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:44:16.995312 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:44:16.995312 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:44:16.995312 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:44:16.995312 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:44:16.995312 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:44:16.995312 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:44:16.995312 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:44:16.995312 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:44:16.995312 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:44:16.995312 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:44:16.995312 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:44:16.995312 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:44:16.995312 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:44:16.995312 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 11:44:16.996278 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 11:44:16.996278 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 11:44:16.996278 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:44:16.996278 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 641/1283] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Oct 4 11:44:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:44:17.001080 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f55b73-59af-479e-a2c4-2f7bf6354b29 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:44:17.101195 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f55b73-59af-479e-a2c4-2f7bf6354b29 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:44:17.135849 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c91b367-8b43-4139-b9ae-cd230f091049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:44:17.136446 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c91b367-8b43-4139-b9ae-cd230f091049 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:44:17.136830 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c91b367-8b43-4139-b9ae-cd230f091049 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:44:17.137105 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c91b367-8b43-4139-b9ae-cd230f091049 None admin] PATH_INFO: `/v3/domains` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:44:17.137730 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c91b367-8b43-4139-b9ae-cd230f091049 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:44:17.138029 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c91b367-8b43-4139-b9ae-cd230f091049 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:44:17.139393 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c91b367-8b43-4139-b9ae-cd230f091049 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:44:17.150990 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 643/1284] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Oct 4 11:44:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:44:17.159849 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c04c2fa-067a-406d-8b1a-5f3152432295 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:44:17.255696 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c04c2fa-067a-406d-8b1a-5f3152432295 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:44:17.268758 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:44:17.289154 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0460348-dc8a-44d1-b3dd-494aa63db6f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:44:17.289789 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0460348-dc8a-44d1-b3dd-494aa63db6f9 None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:44:17.290087 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0460348-dc8a-44d1-b3dd-494aa63db6f9 None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:44:17.290342 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0460348-dc8a-44d1-b3dd-494aa63db6f9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:44:17.296908 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0460348-dc8a-44d1-b3dd-494aa63db6f9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:44:17.303204 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0460348-dc8a-44d1-b3dd-494aa63db6f9 None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:44:17.309416 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application [None req-c0460348-dc8a-44d1-b3dd-494aa63db6f9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 11:44:17.309416 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:44:17.309416 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:44:17.309416 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:44:17.309416 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:44:17.309416 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:44:17.309416 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:44:17.309416 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:44:17.309416 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:44:17.309416 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:44:17.309416 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:44:17.309416 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:44:17.309416 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 11:44:17.309416 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 11:44:17.309416 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 11:44:17.310470 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 11:44:17.310470 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:44:17.310470 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:44:17.310470 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:44:17.310470 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:44:17.310470 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:44:17.310470 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:44:17.310470 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:44:17.310470 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application with Lock( Oct 04 11:44:17.310470 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:44:17.310470 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:44:17.310470 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:44:17.310470 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:44:17.310470 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:44:17.310470 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:44:17.310470 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:44:17.310470 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:44:17.311797 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 11:44:17.311797 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 11:44:17.311797 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 11:44:17.311797 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 11:44:17.311797 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 11:44:17.311797 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 11:44:17.311797 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 11:44:17.311797 dv-cinder-860212-2-smb devstack@keystone.service[98474]: ERROR keystone.server.flask.application Oct 04 11:44:17.311797 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 642/1285] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Oct 4 11:44:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:44:17.316499 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c91b367-8b43-4139-b9ae-cd230f091049 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:44:17.366679 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:44:17.414698 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c91b367-8b43-4139-b9ae-cd230f091049 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:44:17.447665 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4678ac7c-7b3d-4642-bdef-f4deb5e24be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:44:17.448286 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4678ac7c-7b3d-4642-bdef-f4deb5e24be9 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:44:17.448593 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4678ac7c-7b3d-4642-bdef-f4deb5e24be9 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:44:17.448915 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4678ac7c-7b3d-4642-bdef-f4deb5e24be9 None admin] PATH_INFO: `/v3/projects` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:44:17.449585 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4678ac7c-7b3d-4642-bdef-f4deb5e24be9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:44:17.449884 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4678ac7c-7b3d-4642-bdef-f4deb5e24be9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:44:17.451287 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4678ac7c-7b3d-4642-bdef-f4deb5e24be9 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:44:17.462817 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 644/1286] 10.222.0.59 () {56 vars in 1148 bytes} [Tue Oct 4 11:44:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:44:17.468937 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0460348-dc8a-44d1-b3dd-494aa63db6f9 None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:44:17.569474 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0460348-dc8a-44d1-b3dd-494aa63db6f9 None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:44:17.601403 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4620be-263b-4b18-a14e-07a2584890cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:44:17.602001 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4620be-263b-4b18-a14e-07a2584890cc None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:44:17.602278 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4620be-263b-4b18-a14e-07a2584890cc None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:44:17.602545 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4620be-263b-4b18-a14e-07a2584890cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:44:17.603256 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4620be-263b-4b18-a14e-07a2584890cc None admin] RBAC: Adding query filter params (role.id=d6e7421d1ff9451c808004b818354550, scope.project.id=39913dbe3e984f27a61493dd75381501, user.id=be119968b02440adbbbc85c553077b92) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:44:17.603561 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4620be-263b-4b18-a14e-07a2584890cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:44:17.605006 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4620be-263b-4b18-a14e-07a2584890cc None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:44:17.610539 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 643/1287] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Oct 4 11:44:17 2022] GET /identity/v3/role_assignments?user.id=be119968b02440adbbbc85c553077b92&scope.project.id=39913dbe3e984f27a61493dd75381501&role.id=d6e7421d1ff9451c808004b818354550 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:44:19.834542 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aff7cb-9354-4eef-af00-fc0a859f4d19 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:44:19.835046 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aff7cb-9354-4eef-af00-fc0a859f4d19 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:44:19.835046 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aff7cb-9354-4eef-af00-fc0a859f4d19 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:44:19.836332 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 645/1288] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:44:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:44:19.841416 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a158548a-8599-4128-be5e-3b319583fe86 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:44:19.841813 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a158548a-8599-4128-be5e-3b319583fe86 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:44:19.841958 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a158548a-8599-4128-be5e-3b319583fe86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:44:19.861251 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-a158548a-8599-4128-be5e-3b319583fe86 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:44:19.862412 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-a158548a-8599-4128-be5e-3b319583fe86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:44:19.891458 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:44:19.928554 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 644/1289] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:44:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 11:44:20.200102 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aff7cb-9354-4eef-af00-fc0a859f4d19 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:44:20.301248 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aff7cb-9354-4eef-af00-fc0a859f4d19 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:44:20.313018 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:44:20.336417 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7154551-2df1-4fb3-82e3-566784859a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:44:20.337068 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7154551-2df1-4fb3-82e3-566784859a1f None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:44:20.337342 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7154551-2df1-4fb3-82e3-566784859a1f None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:44:20.337613 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7154551-2df1-4fb3-82e3-566784859a1f None admin] PATH_INFO: `/v3/services/placement` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:44:20.338175 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7154551-2df1-4fb3-82e3-566784859a1f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:44:20.339528 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7154551-2df1-4fb3-82e3-566784859a1f None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:44:20.348242 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-e7154551-2df1-4fb3-82e3-566784859a1f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 04 11:44:20.348242 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:44:20.348242 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 11:44:20.348242 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 11:44:20.348242 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 11:44:20.348242 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 11:44:20.348242 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 11:44:20.348242 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 11:44:20.348242 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 04 11:44:20.348242 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:44:20.348242 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 11:44:20.348242 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:44:20.348242 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:44:20.348242 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:44:20.348242 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:44:20.348242 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:44:20.348242 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:44:20.349593 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:44:20.349593 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:44:20.349593 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:44:20.349593 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:44:20.349593 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:44:20.349593 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:44:20.349593 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 11:44:20.349593 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 11:44:20.349593 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 11:44:20.349593 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 11:44:20.349593 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:44:20.349593 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:44:20.349593 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:44:20.349593 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:44:20.349593 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:44:20.349593 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:44:20.350777 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:44:20.350777 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:44:20.350777 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:44:20.350777 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:44:20.350777 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:44:20.350777 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:44:20.350777 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:44:20.350777 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:44:20.350777 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:44:20.350777 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:44:20.350777 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 11:44:20.350777 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 11:44:20.350777 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 04 11:44:20.350777 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:44:20.350777 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 646/1290] 10.222.0.59 () {56 vars in 1117 bytes} [Tue Oct 4 11:44:20 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:44:20.355313 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a158548a-8599-4128-be5e-3b319583fe86 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:44:20.450818 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a158548a-8599-4128-be5e-3b319583fe86 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:44:20.486091 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef38bfb-337e-4293-9c9a-e4ff6dfe95cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:44:20.486696 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef38bfb-337e-4293-9c9a-e4ff6dfe95cf None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:44:20.486971 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef38bfb-337e-4293-9c9a-e4ff6dfe95cf None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:44:20.487240 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef38bfb-337e-4293-9c9a-e4ff6dfe95cf None admin] PATH_INFO: `/v3/services` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:44:20.487907 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef38bfb-337e-4293-9c9a-e4ff6dfe95cf None admin] RBAC: Adding query filter params (name=placement) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:44:20.488205 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef38bfb-337e-4293-9c9a-e4ff6dfe95cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:44:20.490117 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef38bfb-337e-4293-9c9a-e4ff6dfe95cf None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:44:20.494747 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 645/1291] 10.222.0.59 () {56 vars in 1116 bytes} [Tue Oct 4 11:44:20 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:44:20.500500 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7154551-2df1-4fb3-82e3-566784859a1f None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:44:20.601733 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7154551-2df1-4fb3-82e3-566784859a1f None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:44:20.635546 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5b4ba4-56d8-4e92-90ba-a245aae28233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:44:20.636151 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5b4ba4-56d8-4e92-90ba-a245aae28233 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:44:20.636425 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5b4ba4-56d8-4e92-90ba-a245aae28233 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:44:20.636723 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5b4ba4-56d8-4e92-90ba-a245aae28233 None admin] PATH_INFO: `/v3/services` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:44:20.637338 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5b4ba4-56d8-4e92-90ba-a245aae28233 None admin] RBAC: Adding query filter params (type=placement) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:44:20.637638 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5b4ba4-56d8-4e92-90ba-a245aae28233 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:44:20.638992 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5b4ba4-56d8-4e92-90ba-a245aae28233 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:44:20.643285 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 647/1292] 10.222.0.59 () {56 vars in 1116 bytes} [Tue Oct 4 11:44:20 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:44:22.794580 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea450211-47a3-490d-b74d-854d94bb575a None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:44:22.795088 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea450211-47a3-490d-b74d-854d94bb575a None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:44:22.795088 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea450211-47a3-490d-b74d-854d94bb575a None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:44:22.796367 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 646/1293] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:44:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 11:44:22.802630 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2677f1d-01c7-4fb1-beea-8fb8bc0df0bf None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:44:22.803040 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2677f1d-01c7-4fb1-beea-8fb8bc0df0bf None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:44:22.803361 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2677f1d-01c7-4fb1-beea-8fb8bc0df0bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:44:22.821883 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-a2677f1d-01c7-4fb1-beea-8fb8bc0df0bf None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:44:22.823128 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-a2677f1d-01c7-4fb1-beea-8fb8bc0df0bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:44:22.852181 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:44:22.889251 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 648/1294] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:44:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 11:44:23.170973 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea450211-47a3-490d-b74d-854d94bb575a None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:44:23.202964 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:44:23.272580 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea450211-47a3-490d-b74d-854d94bb575a None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:44:23.306058 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b839d7a-3c9d-46d1-afdb-a877ae731aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:44:23.306658 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b839d7a-3c9d-46d1-afdb-a877ae731aac None admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:44:23.306936 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b839d7a-3c9d-46d1-afdb-a877ae731aac None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:44:23.307209 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b839d7a-3c9d-46d1-afdb-a877ae731aac None admin] PATH_INFO: `/v3/services` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:44:23.307873 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b839d7a-3c9d-46d1-afdb-a877ae731aac None admin] RBAC: Authorizing `identity:create_service()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:44:23.309290 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b839d7a-3c9d-46d1-afdb-a877ae731aac None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:44:23.398447 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 647/1295] 10.222.0.59 () {60 vars in 1141 bytes} [Tue Oct 4 11:44:23 2022] POST /identity/v3/services => generated 246 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 11:44:25.577351 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8e1834-367c-495d-bb3d-dfb5a45e7822 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:44:25.577862 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8e1834-367c-495d-bb3d-dfb5a45e7822 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:44:25.577966 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8e1834-367c-495d-bb3d-dfb5a45e7822 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:44:25.579345 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 649/1296] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:44:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:44:25.584493 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963f39ce-172e-45ec-bf14-84d9faddbcd7 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:44:25.584918 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963f39ce-172e-45ec-bf14-84d9faddbcd7 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:44:25.585170 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963f39ce-172e-45ec-bf14-84d9faddbcd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:44:25.605014 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-963f39ce-172e-45ec-bf14-84d9faddbcd7 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:44:25.606210 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-963f39ce-172e-45ec-bf14-84d9faddbcd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:44:25.684798 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 648/1297] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:44:25 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 11:44:25.955548 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8e1834-367c-495d-bb3d-dfb5a45e7822 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:44:26.058033 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8e1834-367c-495d-bb3d-dfb5a45e7822 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:44:26.091919 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1a6a9c-5bb7-401f-b49b-9f0c26e3ba8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:44:26.092542 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1a6a9c-5bb7-401f-b49b-9f0c26e3ba8e None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:44:26.092847 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1a6a9c-5bb7-401f-b49b-9f0c26e3ba8e None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:44:26.093120 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1a6a9c-5bb7-401f-b49b-9f0c26e3ba8e None admin] PATH_INFO: `/v3/services/placement` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:44:26.093690 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1a6a9c-5bb7-401f-b49b-9f0c26e3ba8e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:44:26.095048 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1a6a9c-5bb7-401f-b49b-9f0c26e3ba8e None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:44:26.104644 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-1f1a6a9c-5bb7-401f-b49b-9f0c26e3ba8e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 04 11:44:26.104644 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:44:26.104644 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 11:44:26.104644 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 11:44:26.104644 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 11:44:26.104644 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 11:44:26.104644 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 11:44:26.104644 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 11:44:26.104644 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 04 11:44:26.104644 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:44:26.104644 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 11:44:26.104644 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:44:26.104644 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:44:26.104644 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:44:26.104644 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:44:26.104644 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:44:26.104644 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:44:26.105886 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:44:26.105886 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:44:26.105886 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:44:26.105886 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:44:26.105886 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:44:26.105886 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:44:26.105886 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 11:44:26.105886 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 11:44:26.105886 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 11:44:26.105886 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 11:44:26.105886 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:44:26.105886 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:44:26.105886 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:44:26.105886 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:44:26.105886 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:44:26.105886 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:44:26.106948 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:44:26.106948 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:44:26.106948 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:44:26.106948 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:44:26.106948 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:44:26.106948 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:44:26.106948 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:44:26.106948 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:44:26.106948 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:44:26.106948 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:44:26.106948 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 11:44:26.106948 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 11:44:26.106948 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 04 11:44:26.106948 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:44:26.106948 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 650/1298] 10.222.0.59 () {56 vars in 1117 bytes} [Tue Oct 4 11:44:25 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:44:26.111652 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963f39ce-172e-45ec-bf14-84d9faddbcd7 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:44:26.130461 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:44:26.207424 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963f39ce-172e-45ec-bf14-84d9faddbcd7 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:44:26.241430 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a61bc9-5797-4b5a-afac-85a062927b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:44:26.242070 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a61bc9-5797-4b5a-afac-85a062927b7e None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:44:26.242379 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a61bc9-5797-4b5a-afac-85a062927b7e None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:44:26.242650 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a61bc9-5797-4b5a-afac-85a062927b7e None admin] PATH_INFO: `/v3/services` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:44:26.243271 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a61bc9-5797-4b5a-afac-85a062927b7e None admin] RBAC: Adding query filter params (name=placement) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:44:26.243572 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a61bc9-5797-4b5a-afac-85a062927b7e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:44:26.244956 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a61bc9-5797-4b5a-afac-85a062927b7e None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:44:26.250107 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 649/1299] 10.222.0.59 () {56 vars in 1116 bytes} [Tue Oct 4 11:44:26 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:44:26.256159 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1a6a9c-5bb7-401f-b49b-9f0c26e3ba8e None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:44:26.288077 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:44:26.354105 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1a6a9c-5bb7-401f-b49b-9f0c26e3ba8e None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:44:26.387694 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fb7b18-6ce9-4280-9e56-dedade0b8e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:44:26.388298 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fb7b18-6ce9-4280-9e56-dedade0b8e5d None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:44:26.388619 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fb7b18-6ce9-4280-9e56-dedade0b8e5d None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:44:26.388899 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fb7b18-6ce9-4280-9e56-dedade0b8e5d None admin] PATH_INFO: `/v3/endpoints` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:44:26.389584 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fb7b18-6ce9-4280-9e56-dedade0b8e5d None admin] RBAC: Adding query filter params (interface=public, service_id=2c29f569007a4bfe80ddbb5672679b3c, region_id=RegionOne) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:44:26.389884 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fb7b18-6ce9-4280-9e56-dedade0b8e5d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:44:26.391237 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fb7b18-6ce9-4280-9e56-dedade0b8e5d None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:44:26.396170 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 651/1300] 10.222.0.59 () {56 vars in 1251 bytes} [Tue Oct 4 11:44:26 2022] GET /identity/v3/endpoints?service_id=2c29f569007a4bfe80ddbb5672679b3c&interface=public®ion_id=RegionOne => generated 194 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:44:26.401836 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a61bc9-5797-4b5a-afac-85a062927b7e None admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:44:26.486965 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:44:26.505850 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a61bc9-5797-4b5a-afac-85a062927b7e None admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:44:26.545567 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af898ff9-14f2-4814-b7fb-dd74dec60c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:44:26.546196 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af898ff9-14f2-4814-b7fb-dd74dec60c4e None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:44:26.546473 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af898ff9-14f2-4814-b7fb-dd74dec60c4e None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:44:26.546741 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af898ff9-14f2-4814-b7fb-dd74dec60c4e None admin] PATH_INFO: `/v3/services` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:44:26.547350 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af898ff9-14f2-4814-b7fb-dd74dec60c4e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:44:26.548774 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af898ff9-14f2-4814-b7fb-dd74dec60c4e None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:44:26.556481 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 650/1301] 10.222.0.59 () {56 vars in 1087 bytes} [Tue Oct 4 11:44:26 2022] GET /identity/v3/services => generated 2191 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 11:44:28.737895 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c3d6b9-7faf-4e12-bd0b-063b63aeab7d None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:44:28.738483 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c3d6b9-7faf-4e12-bd0b-063b63aeab7d None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:44:28.738483 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c3d6b9-7faf-4e12-bd0b-063b63aeab7d None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:44:28.740323 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 652/1302] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:44:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:44:28.745598 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e0dbbb-66e6-486a-b2a1-5405fb36a57f None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:44:28.746066 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e0dbbb-66e6-486a-b2a1-5405fb36a57f None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:44:28.746178 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e0dbbb-66e6-486a-b2a1-5405fb36a57f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:44:28.765083 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-14e0dbbb-66e6-486a-b2a1-5405fb36a57f None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:44:28.768306 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-14e0dbbb-66e6-486a-b2a1-5405fb36a57f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:44:28.832684 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 651/1303] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:44:28 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 11:44:29.112226 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c3d6b9-7faf-4e12-bd0b-063b63aeab7d None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:44:29.226045 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:44:29.232732 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c3d6b9-7faf-4e12-bd0b-063b63aeab7d None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:44:29.266391 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215fcfab-6c5d-4094-80b6-dd47881b00b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:44:29.267010 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215fcfab-6c5d-4094-80b6-dd47881b00b5 None admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:44:29.267290 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215fcfab-6c5d-4094-80b6-dd47881b00b5 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:44:29.267561 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215fcfab-6c5d-4094-80b6-dd47881b00b5 None admin] PATH_INFO: `/v3/services/placement` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:44:29.268132 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215fcfab-6c5d-4094-80b6-dd47881b00b5 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:44:29.269565 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215fcfab-6c5d-4094-80b6-dd47881b00b5 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:44:29.278777 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application [None req-215fcfab-6c5d-4094-80b6-dd47881b00b5 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 04 11:44:29.278777 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:44:29.278777 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 11:44:29.278777 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 11:44:29.278777 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 11:44:29.278777 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 11:44:29.278777 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 11:44:29.278777 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 11:44:29.278777 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 04 11:44:29.278777 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:44:29.278777 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 11:44:29.278777 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:44:29.278777 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 11:44:29.278777 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 11:44:29.278777 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 11:44:29.278777 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 11:44:29.278777 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 11:44:29.282007 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 11:44:29.282007 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 11:44:29.282007 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 11:44:29.282007 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 11:44:29.282007 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 11:44:29.282007 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 11:44:29.282007 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 11:44:29.282007 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 11:44:29.282007 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 11:44:29.282007 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 11:44:29.282007 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 11:44:29.282007 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 11:44:29.282007 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 11:44:29.282007 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 11:44:29.282007 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 11:44:29.282007 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 11:44:29.283151 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 11:44:29.283151 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application with Lock( Oct 04 11:44:29.283151 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 11:44:29.283151 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self._enter() Oct 04 11:44:29.283151 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 11:44:29.283151 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 11:44:29.283151 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 11:44:29.283151 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application return self.creator() Oct 04 11:44:29.283151 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 11:44:29.283151 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application created_value = creator( Oct 04 11:44:29.283151 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 11:44:29.283151 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 11:44:29.283151 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 04 11:44:29.283151 dv-cinder-860212-2-smb devstack@keystone.service[98475]: ERROR keystone.server.flask.application Oct 04 11:44:29.283151 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 653/1304] 10.222.0.59 () {56 vars in 1117 bytes} [Tue Oct 4 11:44:29 2022] GET /identity/v3/services/placement => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 11:44:29.286122 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e0dbbb-66e6-486a-b2a1-5405fb36a57f None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:44:29.361169 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:44:29.383052 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e0dbbb-66e6-486a-b2a1-5405fb36a57f None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:44:29.416381 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecf9495-17b3-4294-a80b-02cc07b4c80f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:44:29.417014 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecf9495-17b3-4294-a80b-02cc07b4c80f None admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:44:29.417288 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecf9495-17b3-4294-a80b-02cc07b4c80f None admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:44:29.417553 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecf9495-17b3-4294-a80b-02cc07b4c80f None admin] PATH_INFO: `/v3/services` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:44:29.418168 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecf9495-17b3-4294-a80b-02cc07b4c80f None admin] RBAC: Adding query filter params (name=placement) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:44:29.418462 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecf9495-17b3-4294-a80b-02cc07b4c80f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:44:29.419792 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecf9495-17b3-4294-a80b-02cc07b4c80f None admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:44:29.424621 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 652/1305] 10.222.0.59 () {56 vars in 1116 bytes} [Tue Oct 4 11:44:29 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:44:29.431737 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215fcfab-6c5d-4094-80b6-dd47881b00b5 None admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:44:29.531723 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215fcfab-6c5d-4094-80b6-dd47881b00b5 None admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:44:29.564411 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2dd2cb-f7dc-4d08-b6a6-f8051b0b5cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:44:29.565031 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2dd2cb-f7dc-4d08-b6a6-f8051b0b5cc6 None admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:44:29.565306 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2dd2cb-f7dc-4d08-b6a6-f8051b0b5cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:44:29.565573 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2dd2cb-f7dc-4d08-b6a6-f8051b0b5cc6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:44:29.566218 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2dd2cb-f7dc-4d08-b6a6-f8051b0b5cc6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:44:29.567595 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2dd2cb-f7dc-4d08-b6a6-f8051b0b5cc6 None admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:44:29.671907 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 654/1306] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Oct 4 11:44:29 2022] POST /identity/v3/endpoints => generated 331 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 11:44:39.455124 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=30 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:44:39.667433 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:52:46.893329 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7737ab3-a407-4351-b1e0-c1275524478a None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:52:46.894278 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7737ab3-a407-4351-b1e0-c1275524478a None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:52:46.894712 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7737ab3-a407-4351-b1e0-c1275524478a None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:52:46.896228 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 653/1307] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:52:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:52:46.905096 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4ada89-2c6e-44f8-9fd8-16cc7408a648 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:52:46.905555 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4ada89-2c6e-44f8-9fd8-16cc7408a648 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:52:46.905849 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4ada89-2c6e-44f8-9fd8-16cc7408a648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:52:47.066425 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-0d4ada89-2c6e-44f8-9fd8-16cc7408a648 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:52:47.067846 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-0d4ada89-2c6e-44f8-9fd8-16cc7408a648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:52:47.195411 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 655/1308] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:52:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 11:52:47.516393 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e037376-b7e5-4914-a22f-e3fb2ce2716d None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:52:47.517324 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e037376-b7e5-4914-a22f-e3fb2ce2716d None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:52:47.517507 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e037376-b7e5-4914-a22f-e3fb2ce2716d None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:52:47.519137 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 654/1309] 10.222.0.59 () {54 vars in 964 bytes} [Tue Oct 4 11:52:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:52:47.528993 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fe9b9f-95f0-422f-8ebd-d51e6ecc2fe6 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:52:47.529575 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fe9b9f-95f0-422f-8ebd-d51e6ecc2fe6 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:52:47.530051 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fe9b9f-95f0-422f-8ebd-d51e6ecc2fe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:52:47.624293 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-b3fe9b9f-95f0-422f-8ebd-d51e6ecc2fe6 None None] MFA Rules not processed for user `e7289515c5c44914a19daa439de98cb1`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:52:47.625714 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-b3fe9b9f-95f0-422f-8ebd-d51e6ecc2fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:52:47.651374 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:52:47.714342 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 656/1310] 10.222.0.59 () {58 vars in 1061 bytes} [Tue Oct 4 11:52:47 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 11:52:47.723259 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e037376-b7e5-4914-a22f-e3fb2ce2716d None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:52:47.725189 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-0e037376-b7e5-4914-a22f-e3fb2ce2716d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:52:47.858271 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e037376-b7e5-4914-a22f-e3fb2ce2716d None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:52:47.955450 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b23aff-f1ee-4901-ae44-37bd7462506e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7289515c5c44914a19daa439de98cb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:52:47.956203 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b23aff-f1ee-4901-ae44-37bd7462506e service neutron] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:52:47.956557 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b23aff-f1ee-4901-ae44-37bd7462506e service neutron] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:52:47.956999 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b23aff-f1ee-4901-ae44-37bd7462506e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:52:47.958925 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-41b23aff-f1ee-4901-ae44-37bd7462506e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:52:48.022947 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:52:48.085752 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b23aff-f1ee-4901-ae44-37bd7462506e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:52:48.087528 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b23aff-f1ee-4901-ae44-37bd7462506e service neutron] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:52:48.109002 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 655/1311] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 11:52:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 11:52:50.624027 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb27876-d8c6-4a9e-b38c-ea5cd28a3971 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:52:50.624463 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb27876-d8c6-4a9e-b38c-ea5cd28a3971 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:52:50.624707 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb27876-d8c6-4a9e-b38c-ea5cd28a3971 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:52:50.625994 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 657/1312] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:52:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:52:50.631545 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96f7e26-03a3-4ad4-8e39-e20a84634d90 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:52:50.631949 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96f7e26-03a3-4ad4-8e39-e20a84634d90 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:52:50.632037 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96f7e26-03a3-4ad4-8e39-e20a84634d90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:52:50.721073 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-b96f7e26-03a3-4ad4-8e39-e20a84634d90 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:52:50.722267 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-b96f7e26-03a3-4ad4-8e39-e20a84634d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:52:50.820818 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 656/1313] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:52:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 11:52:51.103472 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb27876-d8c6-4a9e-b38c-ea5cd28a3971 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:52:51.105404 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-6cb27876-d8c6-4a9e-b38c-ea5cd28a3971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:52:51.211024 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb27876-d8c6-4a9e-b38c-ea5cd28a3971 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:52:51.283249 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:52:51.285766 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4a190f-659a-45c1-9f66-9b98559a6700 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7289515c5c44914a19daa439de98cb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:52:51.286398 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4a190f-659a-45c1-9f66-9b98559a6700 service neutron] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:52:51.286678 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4a190f-659a-45c1-9f66-9b98559a6700 service neutron] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:52:51.286949 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4a190f-659a-45c1-9f66-9b98559a6700 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:52:51.288592 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-de4a190f-659a-45c1-9f66-9b98559a6700 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:52:51.398932 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4a190f-659a-45c1-9f66-9b98559a6700 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:52:51.400281 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4a190f-659a-45c1-9f66-9b98559a6700 service neutron] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:52:51.418347 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 658/1314] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 11:52:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 11:52:54.278086 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6446f069-f538-42fc-a445-c7d6e94a5a80 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:52:54.278634 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6446f069-f538-42fc-a445-c7d6e94a5a80 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:52:54.278634 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6446f069-f538-42fc-a445-c7d6e94a5a80 None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:52:54.279978 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 657/1315] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:52:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 11:52:54.287002 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6277278a-3e99-466b-a507-371acad2fcf1 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:52:54.287477 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6277278a-3e99-466b-a507-371acad2fcf1 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:52:54.287682 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6277278a-3e99-466b-a507-371acad2fcf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:52:54.372233 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-6277278a-3e99-466b-a507-371acad2fcf1 None None] MFA Rules not processed for user `47abe7c6472d45e6b9c35ceab8d4ffc5`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:52:54.373743 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-6277278a-3e99-466b-a507-371acad2fcf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:52:54.432387 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:52:54.477418 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 659/1316] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:52:54 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 11:52:54.784338 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc80648-5551-47c4-9af3-3f2e43a21ece None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:52:54.784638 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc80648-5551-47c4-9af3-3f2e43a21ece None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:52:54.784912 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc80648-5551-47c4-9af3-3f2e43a21ece None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:52:54.786232 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 658/1317] 10.222.0.59 () {54 vars in 964 bytes} [Tue Oct 4 11:52:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:52:54.792329 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688d528b-fa39-45d7-9aa0-9829a449b910 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:52:54.792831 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688d528b-fa39-45d7-9aa0-9829a449b910 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:52:54.793156 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688d528b-fa39-45d7-9aa0-9829a449b910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:52:54.869353 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-688d528b-fa39-45d7-9aa0-9829a449b910 None None] MFA Rules not processed for user `e7289515c5c44914a19daa439de98cb1`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:52:54.870470 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-688d528b-fa39-45d7-9aa0-9829a449b910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:52:54.945674 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 660/1318] 10.222.0.59 () {58 vars in 1061 bytes} [Tue Oct 4 11:52:54 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 11:52:54.954796 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc80648-5551-47c4-9af3-3f2e43a21ece None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:52:54.956314 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-5cc80648-5551-47c4-9af3-3f2e43a21ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:52:54.965904 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:52:55.066088 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc80648-5551-47c4-9af3-3f2e43a21ece None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:52:55.139449 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98f9b88-d8e5-4194-a6db-13997e118ebe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7289515c5c44914a19daa439de98cb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:52:55.139981 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98f9b88-d8e5-4194-a6db-13997e118ebe service neutron] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:52:55.140259 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98f9b88-d8e5-4194-a6db-13997e118ebe service neutron] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:52:55.140532 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98f9b88-d8e5-4194-a6db-13997e118ebe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:52:55.142793 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-f98f9b88-d8e5-4194-a6db-13997e118ebe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:52:55.202920 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:52:55.249465 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98f9b88-d8e5-4194-a6db-13997e118ebe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:52:55.251191 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98f9b88-d8e5-4194-a6db-13997e118ebe service neutron] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:52:55.269911 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 659/1319] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 11:52:54 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 11:52:58.675031 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68aaeaa-e030-4bfa-bb19-5a04a19d9996 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:52:58.675545 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68aaeaa-e030-4bfa-bb19-5a04a19d9996 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:52:58.675659 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68aaeaa-e030-4bfa-bb19-5a04a19d9996 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:52:58.676966 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 661/1320] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:52:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:52:58.682221 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6776a29c-0f69-4b60-ba28-f9d8196dd167 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:52:58.682653 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6776a29c-0f69-4b60-ba28-f9d8196dd167 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:52:58.682776 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6776a29c-0f69-4b60-ba28-f9d8196dd167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:52:58.755753 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-6776a29c-0f69-4b60-ba28-f9d8196dd167 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:52:58.757124 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-6776a29c-0f69-4b60-ba28-f9d8196dd167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:52:58.870266 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 660/1321] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:52:58 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 11:52:59.162228 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68aaeaa-e030-4bfa-bb19-5a04a19d9996 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:52:59.163776 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-a68aaeaa-e030-4bfa-bb19-5a04a19d9996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:52:59.214637 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:52:59.270352 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68aaeaa-e030-4bfa-bb19-5a04a19d9996 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:52:59.343193 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615ddc3f-e35b-4fda-a55f-d8e92f78216f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7289515c5c44914a19daa439de98cb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:52:59.343791 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615ddc3f-e35b-4fda-a55f-d8e92f78216f service neutron] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:52:59.344070 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615ddc3f-e35b-4fda-a55f-d8e92f78216f service neutron] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:52:59.345409 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615ddc3f-e35b-4fda-a55f-d8e92f78216f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:52:59.347076 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-615ddc3f-e35b-4fda-a55f-d8e92f78216f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:52:59.444801 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:52:59.459602 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615ddc3f-e35b-4fda-a55f-d8e92f78216f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:52:59.461110 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615ddc3f-e35b-4fda-a55f-d8e92f78216f service neutron] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:52:59.480207 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 662/1322] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 11:52:59 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 11:53:02.915754 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335d9c54-6a54-437c-855a-8f8cb9cdb30e None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:53:02.916278 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335d9c54-6a54-437c-855a-8f8cb9cdb30e None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:53:02.916278 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335d9c54-6a54-437c-855a-8f8cb9cdb30e None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:53:02.918016 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 661/1323] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:53:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:53:02.924418 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6c33c2-e353-4f0f-b715-fbfa5519dd1d None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:53:02.925023 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6c33c2-e353-4f0f-b715-fbfa5519dd1d None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:53:02.925023 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6c33c2-e353-4f0f-b715-fbfa5519dd1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:53:02.997778 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-2a6c33c2-e353-4f0f-b715-fbfa5519dd1d None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:53:02.999001 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-2a6c33c2-e353-4f0f-b715-fbfa5519dd1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:53:03.122880 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 663/1324] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:53:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 11:53:03.404146 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335d9c54-6a54-437c-855a-8f8cb9cdb30e None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:53:03.405729 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-335d9c54-6a54-437c-855a-8f8cb9cdb30e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:53:03.426839 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:53:03.511638 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335d9c54-6a54-437c-855a-8f8cb9cdb30e None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:53:03.588253 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e88a415-f4d3-4c24-892d-679dc45154c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7289515c5c44914a19daa439de98cb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:53:03.588887 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e88a415-f4d3-4c24-892d-679dc45154c2 service neutron] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:53:03.589167 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e88a415-f4d3-4c24-892d-679dc45154c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:53:03.589432 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e88a415-f4d3-4c24-892d-679dc45154c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:53:03.590996 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-5e88a415-f4d3-4c24-892d-679dc45154c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:53:03.663483 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:53:03.701646 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e88a415-f4d3-4c24-892d-679dc45154c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:53:03.703096 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e88a415-f4d3-4c24-892d-679dc45154c2 service neutron] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:53:03.721751 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 662/1325] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 11:53:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 11:53:05.972211 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b7cb52-9b93-45af-b52e-3f2c2cbc70a3 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:53:05.972770 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b7cb52-9b93-45af-b52e-3f2c2cbc70a3 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:53:05.972770 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b7cb52-9b93-45af-b52e-3f2c2cbc70a3 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:53:05.974128 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 664/1326] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:53:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:53:05.988809 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f172b51-116b-42bc-9d09-81247c2ac1ae None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:53:05.989249 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f172b51-116b-42bc-9d09-81247c2ac1ae None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:53:05.989349 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f172b51-116b-42bc-9d09-81247c2ac1ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:53:06.057512 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-8f172b51-116b-42bc-9d09-81247c2ac1ae None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:53:06.058728 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-8f172b51-116b-42bc-9d09-81247c2ac1ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:53:06.158039 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 663/1327] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:53:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 11:53:06.451008 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b7cb52-9b93-45af-b52e-3f2c2cbc70a3 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:53:06.452557 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-f8b7cb52-9b93-45af-b52e-3f2c2cbc70a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:53:06.515432 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:53:06.559569 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b7cb52-9b93-45af-b52e-3f2c2cbc70a3 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:53:06.640091 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3e9167-c3bb-40c8-bb6f-ac02ae975376 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7289515c5c44914a19daa439de98cb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:53:06.640788 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3e9167-c3bb-40c8-bb6f-ac02ae975376 service neutron] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:53:06.641643 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3e9167-c3bb-40c8-bb6f-ac02ae975376 service neutron] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:53:06.641946 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3e9167-c3bb-40c8-bb6f-ac02ae975376 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:53:06.643510 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-0c3e9167-c3bb-40c8-bb6f-ac02ae975376 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:53:06.751178 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:53:06.753541 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3e9167-c3bb-40c8-bb6f-ac02ae975376 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:53:06.754990 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3e9167-c3bb-40c8-bb6f-ac02ae975376 service neutron] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:53:06.773939 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 665/1328] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 11:53:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 11:53:09.007549 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21269feb-e742-4fea-b521-a0404c335c8f None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:53:09.008071 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21269feb-e742-4fea-b521-a0404c335c8f None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:53:09.008071 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21269feb-e742-4fea-b521-a0404c335c8f None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:53:09.009433 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 664/1329] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:53:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:53:09.014889 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec79294-1c0a-4bd9-a933-ac6f6d340cf0 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:53:09.015323 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec79294-1c0a-4bd9-a933-ac6f6d340cf0 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:53:09.015464 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec79294-1c0a-4bd9-a933-ac6f6d340cf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:53:09.085292 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-0ec79294-1c0a-4bd9-a933-ac6f6d340cf0 None None] MFA Rules not processed for user `47abe7c6472d45e6b9c35ceab8d4ffc5`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:53:09.086724 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-0ec79294-1c0a-4bd9-a933-ac6f6d340cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:53:09.189713 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 666/1330] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:53:09 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 11:53:09.489799 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21269feb-e742-4fea-b521-a0404c335c8f None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:53:09.491426 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-21269feb-e742-4fea-b521-a0404c335c8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:53:09.524519 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:53:09.637047 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21269feb-e742-4fea-b521-a0404c335c8f None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:53:09.698067 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3ee3c5-54e9-4463-85c7-f6bd29c2a1aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7289515c5c44914a19daa439de98cb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:53:09.698673 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ee3c5-54e9-4463-85c7-f6bd29c2a1aa service neutron] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:53:09.698952 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ee3c5-54e9-4463-85c7-f6bd29c2a1aa service neutron] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:53:09.699224 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ee3c5-54e9-4463-85c7-f6bd29c2a1aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:53:09.700824 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-7a3ee3c5-54e9-4463-85c7-f6bd29c2a1aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:53:09.780700 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:53:09.814184 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3ee3c5-54e9-4463-85c7-f6bd29c2a1aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:53:09.815628 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3ee3c5-54e9-4463-85c7-f6bd29c2a1aa service neutron] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:53:09.834011 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 665/1331] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 11:53:09 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 11:53:12.440723 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3613ad49-a891-48fd-8b98-17319699de83 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:53:12.441312 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3613ad49-a891-48fd-8b98-17319699de83 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:53:12.441312 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3613ad49-a891-48fd-8b98-17319699de83 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:53:12.442645 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 667/1332] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:53:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:53:12.447849 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18fa130-a6b9-40c6-a8b3-b0acfffd472a None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:53:12.448256 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18fa130-a6b9-40c6-a8b3-b0acfffd472a None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:53:12.448405 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18fa130-a6b9-40c6-a8b3-b0acfffd472a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:53:12.513785 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-f18fa130-a6b9-40c6-a8b3-b0acfffd472a None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:53:12.514962 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-f18fa130-a6b9-40c6-a8b3-b0acfffd472a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:53:12.611197 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 666/1333] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:53:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 11:53:12.898081 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3613ad49-a891-48fd-8b98-17319699de83 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:53:12.899631 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-3613ad49-a891-48fd-8b98-17319699de83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:53:12.986140 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:53:13.020371 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3613ad49-a891-48fd-8b98-17319699de83 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:53:13.092156 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b214ed-2057-49c6-9b56-0e091160dfeb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7289515c5c44914a19daa439de98cb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:53:13.092800 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b214ed-2057-49c6-9b56-0e091160dfeb service neutron] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:53:13.093101 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b214ed-2057-49c6-9b56-0e091160dfeb service neutron] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:53:13.093368 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b214ed-2057-49c6-9b56-0e091160dfeb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:53:13.095019 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-f0b214ed-2057-49c6-9b56-0e091160dfeb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:53:13.210874 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b214ed-2057-49c6-9b56-0e091160dfeb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:53:13.212244 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b214ed-2057-49c6-9b56-0e091160dfeb service neutron] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:53:13.221987 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:53:13.229803 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 668/1334] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 11:53:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 11:53:15.462573 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56015fa3-3171-43e6-afb6-89a5d913e3f6 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:53:15.463151 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56015fa3-3171-43e6-afb6-89a5d913e3f6 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:53:15.463151 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56015fa3-3171-43e6-afb6-89a5d913e3f6 None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:53:15.464464 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 667/1335] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:53:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:53:15.470339 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d29de3-e587-426f-b091-e7d32853c348 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:53:15.470742 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d29de3-e587-426f-b091-e7d32853c348 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:53:15.470883 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d29de3-e587-426f-b091-e7d32853c348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:53:15.537030 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-82d29de3-e587-426f-b091-e7d32853c348 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:53:15.538238 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-82d29de3-e587-426f-b091-e7d32853c348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:53:15.634573 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 669/1336] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:53:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 11:53:15.920215 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56015fa3-3171-43e6-afb6-89a5d913e3f6 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:53:15.923068 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-56015fa3-3171-43e6-afb6-89a5d913e3f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:53:15.963054 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:53:16.032852 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56015fa3-3171-43e6-afb6-89a5d913e3f6 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:53:16.107349 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfe02f4-0cc5-4460-882a-14f805fac25b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7289515c5c44914a19daa439de98cb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:53:16.107949 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfe02f4-0cc5-4460-882a-14f805fac25b service neutron] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:53:16.108229 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfe02f4-0cc5-4460-882a-14f805fac25b service neutron] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:53:16.108528 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfe02f4-0cc5-4460-882a-14f805fac25b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:53:16.110964 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-dcfe02f4-0cc5-4460-882a-14f805fac25b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:53:16.196158 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:53:16.221936 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfe02f4-0cc5-4460-882a-14f805fac25b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:53:16.223370 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfe02f4-0cc5-4460-882a-14f805fac25b service neutron] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:53:16.242527 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 668/1337] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 11:53:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 11:53:19.267065 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c70fb1-3472-486e-a6ce-6369961b9430 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:53:19.267622 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c70fb1-3472-486e-a6ce-6369961b9430 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:53:19.267622 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c70fb1-3472-486e-a6ce-6369961b9430 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:53:19.268958 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 670/1338] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:53:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:53:19.274152 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c566dd-02b2-41a5-b11c-68a555a712c5 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:53:19.274546 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c566dd-02b2-41a5-b11c-68a555a712c5 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:53:19.274729 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c566dd-02b2-41a5-b11c-68a555a712c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:53:19.341928 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-25c566dd-02b2-41a5-b11c-68a555a712c5 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:53:19.343125 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-25c566dd-02b2-41a5-b11c-68a555a712c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:53:19.452163 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 669/1339] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:53:19 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 11:53:19.738967 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c70fb1-3472-486e-a6ce-6369961b9430 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:53:19.740501 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-98c70fb1-3472-486e-a6ce-6369961b9430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:53:19.815203 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:53:19.841634 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c70fb1-3472-486e-a6ce-6369961b9430 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:53:19.913307 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50774e82-71a5-4467-ab1a-1d68db504e58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7289515c5c44914a19daa439de98cb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:53:19.913902 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50774e82-71a5-4467-ab1a-1d68db504e58 service neutron] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:53:19.914178 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50774e82-71a5-4467-ab1a-1d68db504e58 service neutron] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:53:19.914442 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50774e82-71a5-4467-ab1a-1d68db504e58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:53:19.916004 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-50774e82-71a5-4467-ab1a-1d68db504e58 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:53:20.024091 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50774e82-71a5-4467-ab1a-1d68db504e58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:53:20.025467 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50774e82-71a5-4467-ab1a-1d68db504e58 service neutron] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:53:20.042876 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 671/1340] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 11:53:19 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 11:53:24.545651 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35f3544-c22e-4c9f-98f7-6468b1a8dd71 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:53:24.546642 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35f3544-c22e-4c9f-98f7-6468b1a8dd71 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:53:24.546743 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35f3544-c22e-4c9f-98f7-6468b1a8dd71 None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:53:24.548781 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 670/1341] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:53:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:53:24.553878 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a310e2-5225-4fd8-8f92-167babfa342f None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:53:24.554347 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a310e2-5225-4fd8-8f92-167babfa342f None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:53:24.554445 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a310e2-5225-4fd8-8f92-167babfa342f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:53:24.559870 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:53:24.621939 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-92a310e2-5225-4fd8-8f92-167babfa342f None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:53:24.623137 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-92a310e2-5225-4fd8-8f92-167babfa342f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:53:24.722941 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 672/1342] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:53:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 11:53:25.010341 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35f3544-c22e-4c9f-98f7-6468b1a8dd71 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:53:25.011992 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-f35f3544-c22e-4c9f-98f7-6468b1a8dd71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:53:25.062066 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:53:25.119892 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35f3544-c22e-4c9f-98f7-6468b1a8dd71 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:53:25.200297 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa154f37-1e48-4a09-b5f8-4f54e35e9e4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7289515c5c44914a19daa439de98cb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:53:25.200928 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa154f37-1e48-4a09-b5f8-4f54e35e9e4f service neutron] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:53:25.201203 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa154f37-1e48-4a09-b5f8-4f54e35e9e4f service neutron] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:53:25.201469 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa154f37-1e48-4a09-b5f8-4f54e35e9e4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:53:25.203223 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-aa154f37-1e48-4a09-b5f8-4f54e35e9e4f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:53:25.304049 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:53:25.319850 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa154f37-1e48-4a09-b5f8-4f54e35e9e4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:53:25.321419 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa154f37-1e48-4a09-b5f8-4f54e35e9e4f service neutron] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:53:25.339818 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 671/1343] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 11:53:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 11:53:28.553135 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6fa488-9ec2-48e0-aa37-33b6a36a90ef None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:53:28.553677 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6fa488-9ec2-48e0-aa37-33b6a36a90ef None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:53:28.553677 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6fa488-9ec2-48e0-aa37-33b6a36a90ef None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:53:28.555162 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 673/1344] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:53:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 11:53:28.560072 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a524a69-8fe8-4643-88ec-88ed6f3bd3bb None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:53:28.560484 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a524a69-8fe8-4643-88ec-88ed6f3bd3bb None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:53:28.560630 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a524a69-8fe8-4643-88ec-88ed6f3bd3bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:53:28.633113 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-7a524a69-8fe8-4643-88ec-88ed6f3bd3bb None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:53:28.634303 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-7a524a69-8fe8-4643-88ec-88ed6f3bd3bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:53:28.735934 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 672/1345] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:53:28 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 11:53:29.021887 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6fa488-9ec2-48e0-aa37-33b6a36a90ef None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:53:29.023508 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-be6fa488-9ec2-48e0-aa37-33b6a36a90ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:53:29.111753 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:53:29.129353 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6fa488-9ec2-48e0-aa37-33b6a36a90ef None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:53:29.209287 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc525f83-4e49-4902-a68e-1b627d287af7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7289515c5c44914a19daa439de98cb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:53:29.209888 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc525f83-4e49-4902-a68e-1b627d287af7 service neutron] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:53:29.210162 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc525f83-4e49-4902-a68e-1b627d287af7 service neutron] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:53:29.210428 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc525f83-4e49-4902-a68e-1b627d287af7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:53:29.212136 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-bc525f83-4e49-4902-a68e-1b627d287af7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:53:29.349594 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc525f83-4e49-4902-a68e-1b627d287af7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:53:29.353584 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc525f83-4e49-4902-a68e-1b627d287af7 service neutron] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:53:29.373409 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 674/1346] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 11:53:29 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 11:53:34.197009 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8b0382-2180-4d13-b66e-ce2784995684 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:53:34.197537 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8b0382-2180-4d13-b66e-ce2784995684 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:53:34.197537 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8b0382-2180-4d13-b66e-ce2784995684 None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:53:34.198887 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 673/1347] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:53:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:53:34.205038 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e826c2-564b-41ba-b73c-2b1d06bb32d8 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:53:34.205494 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e826c2-564b-41ba-b73c-2b1d06bb32d8 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:53:34.205600 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e826c2-564b-41ba-b73c-2b1d06bb32d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:53:34.222472 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:53:34.278133 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-06e826c2-564b-41ba-b73c-2b1d06bb32d8 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:53:34.279354 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-06e826c2-564b-41ba-b73c-2b1d06bb32d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:53:34.381909 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 675/1348] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:53:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 11:53:34.668983 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8b0382-2180-4d13-b66e-ce2784995684 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:53:34.670682 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-bf8b0382-2180-4d13-b66e-ce2784995684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:53:34.738495 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:53:34.785571 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8b0382-2180-4d13-b66e-ce2784995684 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:53:34.860538 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b95204-b34b-4895-960d-8605d3453be7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7289515c5c44914a19daa439de98cb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:53:34.862825 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b95204-b34b-4895-960d-8605d3453be7 service neutron] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:53:34.862825 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b95204-b34b-4895-960d-8605d3453be7 service neutron] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:53:34.862825 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b95204-b34b-4895-960d-8605d3453be7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:53:34.863757 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-97b95204-b34b-4895-960d-8605d3453be7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:53:34.972215 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:53:34.975807 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b95204-b34b-4895-960d-8605d3453be7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:53:34.977280 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b95204-b34b-4895-960d-8605d3453be7 service neutron] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:53:34.995764 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 674/1349] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 11:53:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 11:53:40.011251 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3c3071-c89b-45b8-8075-c5f75992f7b4 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:53:40.011677 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3c3071-c89b-45b8-8075-c5f75992f7b4 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:53:40.011864 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3c3071-c89b-45b8-8075-c5f75992f7b4 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:53:40.013488 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 676/1350] 10.222.0.59 () {54 vars in 921 bytes} [Tue Oct 4 11:53:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:53:40.019317 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c3c214-b352-4c70-a22c-da27f6e877b5 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:53:40.019764 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c3c214-b352-4c70-a22c-da27f6e877b5 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:53:40.019867 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c3c214-b352-4c70-a22c-da27f6e877b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:53:40.113721 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-70c3c214-b352-4c70-a22c-da27f6e877b5 None None] MFA Rules not processed for user `be119968b02440adbbbc85c553077b92`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:53:40.115372 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-70c3c214-b352-4c70-a22c-da27f6e877b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:53:40.282871 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 675/1351] 10.222.0.59 () {58 vars in 1018 bytes} [Tue Oct 4 11:53:40 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 11:53:44.380308 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=59 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:53:44.510046 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfeb4ff-9d9d-42f1-b0a1-0c3fd0b20f4f None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:53:44.510046 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfeb4ff-9d9d-42f1-b0a1-0c3fd0b20f4f None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:53:44.510046 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfeb4ff-9d9d-42f1-b0a1-0c3fd0b20f4f None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:53:44.511519 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 677/1352] 10.222.0.59 () {54 vars in 921 bytes} [Tue Oct 4 11:53:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:53:44.517075 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bfb621-2c47-4dd8-ad2e-c8e92c7f7f93 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:53:44.517547 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bfb621-2c47-4dd8-ad2e-c8e92c7f7f93 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:53:44.517632 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bfb621-2c47-4dd8-ad2e-c8e92c7f7f93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:53:44.572471 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:53:44.598756 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-f1bfb621-2c47-4dd8-ad2e-c8e92c7f7f93 None None] MFA Rules not processed for user `be119968b02440adbbbc85c553077b92`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:53:44.599984 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-f1bfb621-2c47-4dd8-ad2e-c8e92c7f7f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:53:44.714228 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 676/1353] 10.222.0.59 () {58 vars in 1018 bytes} [Tue Oct 4 11:53:44 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 11:53:46.254977 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696d6440-f55d-49a3-90fe-3ac2a4062106 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:53:46.255473 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696d6440-f55d-49a3-90fe-3ac2a4062106 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:53:46.255473 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696d6440-f55d-49a3-90fe-3ac2a4062106 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:53:46.256821 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 678/1354] 10.222.0.59 () {54 vars in 921 bytes} [Tue Oct 4 11:53:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:53:46.261899 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99073aa4-4f18-4285-a690-10c98104b54f None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:53:46.262325 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99073aa4-4f18-4285-a690-10c98104b54f None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:53:46.262582 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99073aa4-4f18-4285-a690-10c98104b54f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:53:46.340086 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-99073aa4-4f18-4285-a690-10c98104b54f None None] MFA Rules not processed for user `be119968b02440adbbbc85c553077b92`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:53:46.341321 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-99073aa4-4f18-4285-a690-10c98104b54f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:53:46.385367 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:53:46.457598 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 677/1355] 10.222.0.59 () {58 vars in 1018 bytes} [Tue Oct 4 11:53:46 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 11:53:49.941466 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38a34df-6abc-43ec-aac3-5cb611229798 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:53:49.941965 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38a34df-6abc-43ec-aac3-5cb611229798 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:53:49.941965 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38a34df-6abc-43ec-aac3-5cb611229798 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:53:49.943425 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 679/1356] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:53:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:53:49.948718 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a061a16-4c73-4f0c-89da-a439919f3eab None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:53:49.949124 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a061a16-4c73-4f0c-89da-a439919f3eab None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:53:49.949325 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a061a16-4c73-4f0c-89da-a439919f3eab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:53:50.022392 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-3a061a16-4c73-4f0c-89da-a439919f3eab None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:53:50.023586 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-3a061a16-4c73-4f0c-89da-a439919f3eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:53:50.129564 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 678/1357] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:53:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 11:53:50.429904 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce775f5-2271-41b4-9ca6-a9c2471dea66 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:53:50.430187 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce775f5-2271-41b4-9ca6-a9c2471dea66 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:53:50.430594 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce775f5-2271-41b4-9ca6-a9c2471dea66 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:53:50.432035 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 680/1358] 10.222.0.59 () {54 vars in 961 bytes} [Tue Oct 4 11:53:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:53:50.440818 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8f96b3-d8a5-444f-94a8-c2101e642135 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:53:50.442135 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8f96b3-d8a5-444f-94a8-c2101e642135 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:53:50.442808 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8f96b3-d8a5-444f-94a8-c2101e642135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:53:50.460713 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:53:50.530914 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-9c8f96b3-d8a5-444f-94a8-c2101e642135 None None] MFA Rules not processed for user `a8e23d1d2fe24bdf9552e7c2f0ae3424`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:53:50.532742 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-9c8f96b3-d8a5-444f-94a8-c2101e642135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:53:50.674751 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 679/1359] 10.222.0.59 () {58 vars in 1058 bytes} [Tue Oct 4 11:53:50 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 11:53:50.677091 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce775f5-2271-41b4-9ca6-a9c2471dea66 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:53:50.678599 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-dce775f5-2271-41b4-9ca6-a9c2471dea66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:53:50.838464 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce775f5-2271-41b4-9ca6-a9c2471dea66 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:53:50.923598 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:53:50.967892 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df28d9e6-0972-4c2f-85d3-b60de2e2a933 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8e23d1d2fe24bdf9552e7c2f0ae3424', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:53:50.968563 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df28d9e6-0972-4c2f-85d3-b60de2e2a933 service nova] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:53:50.968900 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df28d9e6-0972-4c2f-85d3-b60de2e2a933 service nova] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:53:50.969278 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df28d9e6-0972-4c2f-85d3-b60de2e2a933 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:53:50.971566 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-df28d9e6-0972-4c2f-85d3-b60de2e2a933 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:53:51.098704 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df28d9e6-0972-4c2f-85d3-b60de2e2a933 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:53:51.101458 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df28d9e6-0972-4c2f-85d3-b60de2e2a933 service nova] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:53:51.123578 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 681/1360] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 11:53:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 11:53:53.538987 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3846cf21-49d5-4511-9b76-6e41ffae1670 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:53:53.539488 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3846cf21-49d5-4511-9b76-6e41ffae1670 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:53:53.539488 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3846cf21-49d5-4511-9b76-6e41ffae1670 None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:53:53.541012 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 680/1361] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:53:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:53:53.546640 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418fa344-ae96-42ac-b834-05d3ffe2eddb None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:53:53.547336 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418fa344-ae96-42ac-b834-05d3ffe2eddb None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:53:53.547513 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418fa344-ae96-42ac-b834-05d3ffe2eddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:53:53.651567 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-418fa344-ae96-42ac-b834-05d3ffe2eddb None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:53:53.652895 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-418fa344-ae96-42ac-b834-05d3ffe2eddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:53:53.696146 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:53:53.758994 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 682/1362] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:53:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 11:53:54.052723 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3846cf21-49d5-4511-9b76-6e41ffae1670 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:53:54.054530 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-3846cf21-49d5-4511-9b76-6e41ffae1670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:53:54.132354 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:53:54.235365 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3846cf21-49d5-4511-9b76-6e41ffae1670 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:53:54.367060 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d243a82-d929-4653-a14e-108fc4e79fb3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8e23d1d2fe24bdf9552e7c2f0ae3424', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:53:54.367670 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d243a82-d929-4653-a14e-108fc4e79fb3 service nova] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:53:54.367955 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d243a82-d929-4653-a14e-108fc4e79fb3 service nova] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:53:54.368219 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d243a82-d929-4653-a14e-108fc4e79fb3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:53:54.370027 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-0d243a82-d929-4653-a14e-108fc4e79fb3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:53:54.395062 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:53:54.465251 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d243a82-d929-4653-a14e-108fc4e79fb3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:53:54.467142 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d243a82-d929-4653-a14e-108fc4e79fb3 service nova] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:53:54.486719 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 681/1363] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 11:53:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 11:53:57.398253 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2729b660-505a-4e3b-be2c-0d6386d7ae9a None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:53:57.398815 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2729b660-505a-4e3b-be2c-0d6386d7ae9a None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:53:57.398815 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2729b660-505a-4e3b-be2c-0d6386d7ae9a None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:53:57.400137 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 683/1364] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:53:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:53:57.406435 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c60bf7a-b0b2-4bc9-bf59-76d246dba7ba None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:53:57.406945 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c60bf7a-b0b2-4bc9-bf59-76d246dba7ba None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:53:57.406945 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c60bf7a-b0b2-4bc9-bf59-76d246dba7ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:53:57.477075 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-8c60bf7a-b0b2-4bc9-bf59-76d246dba7ba None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:53:57.478281 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-8c60bf7a-b0b2-4bc9-bf59-76d246dba7ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:53:57.584973 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:53:57.589066 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 682/1365] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:53:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 11:53:57.884912 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dded78-fbc9-4b5b-8f74-a4cfa720c672 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:53:57.885219 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dded78-fbc9-4b5b-8f74-a4cfa720c672 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:53:57.885474 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dded78-fbc9-4b5b-8f74-a4cfa720c672 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:53:57.887005 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 684/1366] 10.222.0.59 () {54 vars in 961 bytes} [Tue Oct 4 11:53:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:53:57.893256 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bff1e7-fd06-482d-ad1b-7952129f0e09 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:53:57.899263 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bff1e7-fd06-482d-ad1b-7952129f0e09 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:53:57.899263 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bff1e7-fd06-482d-ad1b-7952129f0e09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:53:57.979585 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-00bff1e7-fd06-482d-ad1b-7952129f0e09 None None] MFA Rules not processed for user `a8e23d1d2fe24bdf9552e7c2f0ae3424`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:53:57.980816 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-00bff1e7-fd06-482d-ad1b-7952129f0e09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:53:58.119828 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 683/1367] 10.222.0.59 () {58 vars in 1058 bytes} [Tue Oct 4 11:53:57 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 11:53:58.128117 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dded78-fbc9-4b5b-8f74-a4cfa720c672 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:53:58.129857 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-38dded78-fbc9-4b5b-8f74-a4cfa720c672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:53:58.295276 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dded78-fbc9-4b5b-8f74-a4cfa720c672 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:53:58.316801 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:53:58.368975 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c30cd07-96fb-4992-931b-a7b0f8e5c0ab None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:53:58.369268 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c30cd07-96fb-4992-931b-a7b0f8e5c0ab None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:53:58.370105 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c30cd07-96fb-4992-931b-a7b0f8e5c0ab None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:53:58.371916 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 684/1368] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:53:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:53:58.377648 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbebc976-ba11-42b9-bb58-f2e23f872a4b None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:53:58.377936 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbebc976-ba11-42b9-bb58-f2e23f872a4b None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:53:58.378380 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbebc976-ba11-42b9-bb58-f2e23f872a4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:53:58.417375 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1fbc00-bd94-444d-90c5-8fa09d937ca0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8e23d1d2fe24bdf9552e7c2f0ae3424', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:53:58.418117 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1fbc00-bd94-444d-90c5-8fa09d937ca0 service nova] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:53:58.418300 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1fbc00-bd94-444d-90c5-8fa09d937ca0 service nova] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:53:58.418834 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1fbc00-bd94-444d-90c5-8fa09d937ca0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:53:58.420472 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-8d1fbc00-bd94-444d-90c5-8fa09d937ca0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:53:58.457849 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:53:58.465955 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-cbebc976-ba11-42b9-bb58-f2e23f872a4b None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:53:58.470904 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-cbebc976-ba11-42b9-bb58-f2e23f872a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:53:58.531740 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1fbc00-bd94-444d-90c5-8fa09d937ca0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:53:58.533836 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1fbc00-bd94-444d-90c5-8fa09d937ca0 service nova] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:53:58.554084 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 685/1369] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 11:53:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 11:53:58.584640 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 685/1370] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:53:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 11:53:58.920535 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84d9e1c-7667-4de2-83a8-e0037a7f578c None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:53:58.921522 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84d9e1c-7667-4de2-83a8-e0037a7f578c None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:53:58.921806 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84d9e1c-7667-4de2-83a8-e0037a7f578c None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:53:58.923450 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 686/1371] 10.222.0.59 () {54 vars in 963 bytes} [Tue Oct 4 11:53:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:53:58.929029 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932ff0e1-5b30-4b84-8976-d0749ae274e0 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:53:58.929293 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932ff0e1-5b30-4b84-8976-d0749ae274e0 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:53:58.929564 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932ff0e1-5b30-4b84-8976-d0749ae274e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:53:59.017122 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-932ff0e1-5b30-4b84-8976-d0749ae274e0 None None] MFA Rules not processed for user `6e2a05b782424ab2928b5864f1bfd556`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:53:59.018374 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-932ff0e1-5b30-4b84-8976-d0749ae274e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:53:59.093051 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:53:59.100545 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 686/1372] 10.222.0.59 () {58 vars in 1060 bytes} [Tue Oct 4 11:53:58 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 11:53:59.108862 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84d9e1c-7667-4de2-83a8-e0037a7f578c None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:53:59.110633 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-b84d9e1c-7667-4de2-83a8-e0037a7f578c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:53:59.151817 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:53:59.230813 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84d9e1c-7667-4de2-83a8-e0037a7f578c None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:53:59.310883 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414c91a3-3aab-4baf-ae71-6e4ca2161412 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e2a05b782424ab2928b5864f1bfd556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:53:59.311673 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414c91a3-3aab-4baf-ae71-6e4ca2161412 service cinder] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:53:59.312057 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414c91a3-3aab-4baf-ae71-6e4ca2161412 service cinder] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:53:59.312436 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414c91a3-3aab-4baf-ae71-6e4ca2161412 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:53:59.314152 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-414c91a3-3aab-4baf-ae71-6e4ca2161412 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:53:59.410507 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:53:59.445756 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414c91a3-3aab-4baf-ae71-6e4ca2161412 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:53:59.447332 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414c91a3-3aab-4baf-ae71-6e4ca2161412 service cinder] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:53:59.466864 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 687/1373] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 11:53:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 11:54:01.002237 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304faf6b-24e3-435e-a5c2-8ed29a4e4c37 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:54:01.002803 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304faf6b-24e3-435e-a5c2-8ed29a4e4c37 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:54:01.002803 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304faf6b-24e3-435e-a5c2-8ed29a4e4c37 None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:54:01.004101 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 687/1374] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:54:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:54:01.009329 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74016300-fa22-4a4b-b2a2-92fea7429846 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:54:01.009786 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74016300-fa22-4a4b-b2a2-92fea7429846 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:54:01.009885 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74016300-fa22-4a4b-b2a2-92fea7429846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:54:01.077657 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-74016300-fa22-4a4b-b2a2-92fea7429846 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:54:01.078999 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-74016300-fa22-4a4b-b2a2-92fea7429846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:54:01.188451 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 688/1375] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:54:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 11:54:01.479991 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304faf6b-24e3-435e-a5c2-8ed29a4e4c37 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:54:01.481612 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-304faf6b-24e3-435e-a5c2-8ed29a4e4c37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:54:01.639284 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304faf6b-24e3-435e-a5c2-8ed29a4e4c37 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:54:01.718256 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:54:01.770823 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ce9b59-3138-4f40-b73e-7e61eed49c94 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8e23d1d2fe24bdf9552e7c2f0ae3424', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:54:01.771796 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce9b59-3138-4f40-b73e-7e61eed49c94 service nova] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:54:01.772194 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce9b59-3138-4f40-b73e-7e61eed49c94 service nova] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:54:01.772471 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce9b59-3138-4f40-b73e-7e61eed49c94 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:54:01.774399 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-84ce9b59-3138-4f40-b73e-7e61eed49c94 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:54:01.881968 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ce9b59-3138-4f40-b73e-7e61eed49c94 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:54:01.883630 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ce9b59-3138-4f40-b73e-7e61eed49c94 service nova] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:54:01.904213 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 688/1376] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 11:54:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 11:54:04.284752 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9ef176-7fdb-45fa-a192-d2fe0daab0b4 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:54:04.285320 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9ef176-7fdb-45fa-a192-d2fe0daab0b4 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:54:04.285320 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9ef176-7fdb-45fa-a192-d2fe0daab0b4 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:54:04.286889 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 689/1377] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:54:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:54:04.292059 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a20230-c9fa-4f9b-9731-085d386128fb None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:54:04.292515 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a20230-c9fa-4f9b-9731-085d386128fb None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:54:04.292624 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a20230-c9fa-4f9b-9731-085d386128fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:54:04.360082 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-56a20230-c9fa-4f9b-9731-085d386128fb None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:54:04.361559 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-56a20230-c9fa-4f9b-9731-085d386128fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:54:04.392052 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:54:04.461472 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 689/1378] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:54:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 11:54:04.754776 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9ef176-7fdb-45fa-a192-d2fe0daab0b4 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:54:04.756883 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-7e9ef176-7fdb-45fa-a192-d2fe0daab0b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:54:04.803805 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:54:04.923315 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9ef176-7fdb-45fa-a192-d2fe0daab0b4 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:54:05.042345 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:54:05.050133 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449c4c99-1b15-4e8c-9490-a7564cd5e74a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8e23d1d2fe24bdf9552e7c2f0ae3424', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:54:05.050747 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449c4c99-1b15-4e8c-9490-a7564cd5e74a service nova] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:54:05.051031 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449c4c99-1b15-4e8c-9490-a7564cd5e74a service nova] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:54:05.051306 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449c4c99-1b15-4e8c-9490-a7564cd5e74a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:54:05.052965 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-449c4c99-1b15-4e8c-9490-a7564cd5e74a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:54:05.162594 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449c4c99-1b15-4e8c-9490-a7564cd5e74a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:54:05.164310 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449c4c99-1b15-4e8c-9490-a7564cd5e74a service nova] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:54:05.188703 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 690/1379] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 11:54:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 11:54:07.581589 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabcd64c-e291-4877-8958-c8f2a7e2b4bd None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:54:07.582155 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabcd64c-e291-4877-8958-c8f2a7e2b4bd None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:54:07.582155 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabcd64c-e291-4877-8958-c8f2a7e2b4bd None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:54:07.583535 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 690/1380] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:54:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 11:54:07.589114 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ae9b7c-33b7-48a8-916b-dbb86aa5aea5 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:54:07.589529 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ae9b7c-33b7-48a8-916b-dbb86aa5aea5 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:54:07.589664 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ae9b7c-33b7-48a8-916b-dbb86aa5aea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:54:07.658612 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-61ae9b7c-33b7-48a8-916b-dbb86aa5aea5 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:54:07.659819 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-61ae9b7c-33b7-48a8-916b-dbb86aa5aea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:54:07.725787 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:54:07.770625 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 691/1381] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:54:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 11:54:08.062709 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabcd64c-e291-4877-8958-c8f2a7e2b4bd None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:54:08.064227 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-cabcd64c-e291-4877-8958-c8f2a7e2b4bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:54:08.214865 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabcd64c-e291-4877-8958-c8f2a7e2b4bd None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:54:08.228436 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:54:08.332314 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d3205b-2fa3-4def-a538-776342661c7d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8e23d1d2fe24bdf9552e7c2f0ae3424', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:54:08.333015 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d3205b-2fa3-4def-a538-776342661c7d service nova] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:54:08.333307 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d3205b-2fa3-4def-a538-776342661c7d service nova] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:54:08.333591 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d3205b-2fa3-4def-a538-776342661c7d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:54:08.335262 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-e7d3205b-2fa3-4def-a538-776342661c7d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:54:08.433275 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d3205b-2fa3-4def-a538-776342661c7d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:54:08.435648 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d3205b-2fa3-4def-a538-776342661c7d service nova] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:54:08.454358 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 691/1382] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 11:54:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 11:54:10.992902 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdb772d-add7-41c3-ba69-611644fac9c3 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:54:10.993768 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdb772d-add7-41c3-ba69-611644fac9c3 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:54:10.993768 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdb772d-add7-41c3-ba69-611644fac9c3 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:54:10.994791 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 692/1383] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:54:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:54:11.002014 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a7efa1-d3d9-4ddc-9ba5-d3f974f429c7 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:54:11.002492 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a7efa1-d3d9-4ddc-9ba5-d3f974f429c7 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:54:11.002587 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a7efa1-d3d9-4ddc-9ba5-d3f974f429c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:54:11.025409 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:54:11.079165 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-09a7efa1-d3d9-4ddc-9ba5-d3f974f429c7 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:54:11.080383 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-09a7efa1-d3d9-4ddc-9ba5-d3f974f429c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:54:11.196525 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 692/1384] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:54:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 11:54:11.488785 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdb772d-add7-41c3-ba69-611644fac9c3 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:54:11.490326 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-2cdb772d-add7-41c3-ba69-611644fac9c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:54:11.680681 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdb772d-add7-41c3-ba69-611644fac9c3 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:54:11.747534 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:54:11.863425 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e199ed-8e44-4197-bc9c-34dbd39a81bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8e23d1d2fe24bdf9552e7c2f0ae3424', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:54:11.864501 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e199ed-8e44-4197-bc9c-34dbd39a81bf service nova] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:54:11.865009 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e199ed-8e44-4197-bc9c-34dbd39a81bf service nova] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:54:11.865596 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e199ed-8e44-4197-bc9c-34dbd39a81bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:54:11.872642 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-a5e199ed-8e44-4197-bc9c-34dbd39a81bf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:54:11.975050 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e199ed-8e44-4197-bc9c-34dbd39a81bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:54:11.977152 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e199ed-8e44-4197-bc9c-34dbd39a81bf service nova] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:54:12.005600 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 693/1385] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 11:54:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 11:54:14.194258 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eadca21-9e7a-4414-afd6-94ef7823e0f0 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:54:14.194832 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eadca21-9e7a-4414-afd6-94ef7823e0f0 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:54:14.194832 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eadca21-9e7a-4414-afd6-94ef7823e0f0 None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:54:14.196155 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 693/1386] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:54:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 11:54:14.201431 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8a7292-3109-4231-bfd3-5fdc9d91b5ac None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:54:14.201871 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8a7292-3109-4231-bfd3-5fdc9d91b5ac None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:54:14.202023 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8a7292-3109-4231-bfd3-5fdc9d91b5ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:54:14.270071 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-3d8a7292-3109-4231-bfd3-5fdc9d91b5ac None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:54:14.271276 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-3d8a7292-3109-4231-bfd3-5fdc9d91b5ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:54:14.280316 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:54:14.371759 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 694/1387] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:54:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 11:54:14.665270 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eadca21-9e7a-4414-afd6-94ef7823e0f0 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:54:14.667111 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-7eadca21-9e7a-4414-afd6-94ef7823e0f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:54:14.762487 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:54:14.819355 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eadca21-9e7a-4414-afd6-94ef7823e0f0 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:54:14.936856 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5280589-fd94-4eda-9bd6-ef55e9e79d9d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8e23d1d2fe24bdf9552e7c2f0ae3424', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:54:14.937477 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5280589-fd94-4eda-9bd6-ef55e9e79d9d service nova] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:54:14.937778 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5280589-fd94-4eda-9bd6-ef55e9e79d9d service nova] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:54:14.938181 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5280589-fd94-4eda-9bd6-ef55e9e79d9d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:54:14.939873 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-a5280589-fd94-4eda-9bd6-ef55e9e79d9d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:54:15.007599 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:54:15.040262 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5280589-fd94-4eda-9bd6-ef55e9e79d9d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:54:15.042214 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5280589-fd94-4eda-9bd6-ef55e9e79d9d service nova] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:54:15.061634 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 694/1388] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 11:54:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 11:54:15.230106 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46e35b7-c233-4e08-bd06-9df53962e1c1 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:54:15.241973 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46e35b7-c233-4e08-bd06-9df53962e1c1 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:54:15.241973 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46e35b7-c233-4e08-bd06-9df53962e1c1 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:54:15.241973 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 695/1389] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:54:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:54:15.242306 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e41fd2e-7293-4eda-8789-e6538beb3804 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:54:15.242306 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e41fd2e-7293-4eda-8789-e6538beb3804 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:54:15.242306 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e41fd2e-7293-4eda-8789-e6538beb3804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:54:15.307445 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-8e41fd2e-7293-4eda-8789-e6538beb3804 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:54:15.308706 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-8e41fd2e-7293-4eda-8789-e6538beb3804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:54:15.427808 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 695/1390] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:54:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 11:54:15.744231 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bf2e0e-158d-4368-8d14-e9a89931132b None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:54:15.744517 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bf2e0e-158d-4368-8d14-e9a89931132b None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:54:15.744851 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bf2e0e-158d-4368-8d14-e9a89931132b None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:54:15.746235 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 696/1391] 10.222.0.59 () {54 vars in 962 bytes} [Tue Oct 4 11:54:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:54:15.752453 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cb2133-0115-47a3-b018-dd2646100bed None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:54:15.752784 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cb2133-0115-47a3-b018-dd2646100bed None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:54:15.753056 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cb2133-0115-47a3-b018-dd2646100bed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:54:15.798619 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:54:15.830745 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-b7cb2133-0115-47a3-b018-dd2646100bed None None] MFA Rules not processed for user `d516d0755be84b7293156625df1b13b3`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:54:15.831948 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-b7cb2133-0115-47a3-b018-dd2646100bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:54:15.924994 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 696/1392] 10.222.0.59 () {58 vars in 1059 bytes} [Tue Oct 4 11:54:15 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 11:54:15.935416 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bf2e0e-158d-4368-8d14-e9a89931132b None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:54:15.937065 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-f7bf2e0e-158d-4368-8d14-e9a89931132b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:54:16.060899 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bf2e0e-158d-4368-8d14-e9a89931132b None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:54:16.100260 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:54:16.137815 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e62581-8d3f-4e07-afe8-f7efb52dc3e6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd516d0755be84b7293156625df1b13b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:54:16.138389 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e62581-8d3f-4e07-afe8-f7efb52dc3e6 service glance] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:54:16.138664 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e62581-8d3f-4e07-afe8-f7efb52dc3e6 service glance] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:54:16.138929 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e62581-8d3f-4e07-afe8-f7efb52dc3e6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:54:16.140539 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-93e62581-8d3f-4e07-afe8-f7efb52dc3e6 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:54:16.252383 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e62581-8d3f-4e07-afe8-f7efb52dc3e6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:54:16.253860 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e62581-8d3f-4e07-afe8-f7efb52dc3e6 service glance] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:54:16.273234 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 697/1393] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 11:54:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 11:54:17.293564 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d99cbe2-089b-40a4-893f-c32db84fc40a None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:54:17.294292 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d99cbe2-089b-40a4-893f-c32db84fc40a None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:54:17.294966 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d99cbe2-089b-40a4-893f-c32db84fc40a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:54:17.371626 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-1d99cbe2-089b-40a4-893f-c32db84fc40a None None] MFA Rules not processed for user `06d1850ea27c483780eed67ede9cc1e3`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:54:17.373376 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-1d99cbe2-089b-40a4-893f-c32db84fc40a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:54:17.458129 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:54:17.465270 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 697/1394] 10.222.0.59 () {58 vars in 1009 bytes} [Tue Oct 4 11:54:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 11:54:17.509099 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8411259-cf6c-4903-8c74-b4988dd5351d None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:54:17.510126 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8411259-cf6c-4903-8c74-b4988dd5351d None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:54:17.510566 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8411259-cf6c-4903-8c74-b4988dd5351d None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:54:17.515965 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 698/1395] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:54:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:54:17.517851 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915964f6-f29d-4742-8767-fa59b16d52cd None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:54:17.517998 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b3f842-81b1-44f0-8a86-f1539678eb62 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:54:17.518135 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915964f6-f29d-4742-8767-fa59b16d52cd None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:54:17.518243 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b3f842-81b1-44f0-8a86-f1539678eb62 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:54:17.518405 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915964f6-f29d-4742-8767-fa59b16d52cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:54:17.518510 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b3f842-81b1-44f0-8a86-f1539678eb62 None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:54:17.523451 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 698/1396] 10.222.0.59 () {54 vars in 943 bytes} [Tue Oct 4 11:54:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:54:17.527016 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e543639d-61b2-45c0-bc11-ac47a0fd12df None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:54:17.527308 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e543639d-61b2-45c0-bc11-ac47a0fd12df None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:54:17.527589 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e543639d-61b2-45c0-bc11-ac47a0fd12df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:54:17.585733 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-915964f6-f29d-4742-8767-fa59b16d52cd None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:54:17.586976 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-915964f6-f29d-4742-8767-fa59b16d52cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:54:17.605204 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:54:17.605745 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-e543639d-61b2-45c0-bc11-ac47a0fd12df None None] MFA Rules not processed for user `1605c3e03b7a4bcba4e19f0d92c671bc`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:54:17.607975 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-e543639d-61b2-45c0-bc11-ac47a0fd12df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:54:17.732495 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 699/1397] 10.222.0.59 () {58 vars in 1040 bytes} [Tue Oct 4 11:54:17 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 11:54:17.742858 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e543639d-61b2-45c0-bc11-ac47a0fd12df None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:54:17.754374 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e543639d-61b2-45c0-bc11-ac47a0fd12df None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:54:17.806998 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:54:17.814574 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 699/1398] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:54:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 11:54:17.865289 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b979be-6ff8-4199-865f-2d9580f41084 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1605c3e03b7a4bcba4e19f0d92c671bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:54:17.865839 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b979be-6ff8-4199-865f-2d9580f41084 service swift] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:54:17.866115 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b979be-6ff8-4199-865f-2d9580f41084 service swift] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:54:17.866387 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b979be-6ff8-4199-865f-2d9580f41084 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:54:17.868002 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-51b979be-6ff8-4199-865f-2d9580f41084 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:54:17.962349 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b979be-6ff8-4199-865f-2d9580f41084 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:54:17.963935 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b979be-6ff8-4199-865f-2d9580f41084 service swift] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:54:17.972362 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 700/1399] 10.222.0.59 () {60 vars in 1384 bytes} [Tue Oct 4 11:54:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 04 11:54:18.118654 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915964f6-f29d-4742-8767-fa59b16d52cd None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:54:18.119860 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-915964f6-f29d-4742-8767-fa59b16d52cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:54:18.232483 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915964f6-f29d-4742-8767-fa59b16d52cd None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:54:18.271444 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:54:18.348047 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d442f0-e084-43c9-9ec4-01e09a0f5896 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8e23d1d2fe24bdf9552e7c2f0ae3424', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:54:18.348682 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d442f0-e084-43c9-9ec4-01e09a0f5896 service nova] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:54:18.348964 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d442f0-e084-43c9-9ec4-01e09a0f5896 service nova] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:54:18.349240 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d442f0-e084-43c9-9ec4-01e09a0f5896 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:54:18.350830 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-c8d442f0-e084-43c9-9ec4-01e09a0f5896 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:54:18.453402 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d442f0-e084-43c9-9ec4-01e09a0f5896 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:54:18.454998 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d442f0-e084-43c9-9ec4-01e09a0f5896 service nova] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:54:18.475325 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 700/1400] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 11:54:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 11:54:20.891473 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218b40d1-7ed8-45a5-94cc-1a09573d7378 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:54:20.892112 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218b40d1-7ed8-45a5-94cc-1a09573d7378 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:54:20.892112 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218b40d1-7ed8-45a5-94cc-1a09573d7378 None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:54:20.896920 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 701/1401] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:54:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:54:20.903428 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a36e58-0605-4180-9616-cef4d6684877 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:54:20.903937 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a36e58-0605-4180-9616-cef4d6684877 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:54:20.904341 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a36e58-0605-4180-9616-cef4d6684877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:54:20.972570 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:54:20.993772 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-e5a36e58-0605-4180-9616-cef4d6684877 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:54:20.995073 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-e5a36e58-0605-4180-9616-cef4d6684877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:54:21.125456 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 701/1402] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:54:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 11:54:21.432465 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218b40d1-7ed8-45a5-94cc-1a09573d7378 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:54:21.434071 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-218b40d1-7ed8-45a5-94cc-1a09573d7378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:54:21.528898 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:54:21.607779 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218b40d1-7ed8-45a5-94cc-1a09573d7378 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:54:21.732159 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241c87aa-86de-4b6c-8a4b-370a1b18f4fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8e23d1d2fe24bdf9552e7c2f0ae3424', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:54:21.732799 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241c87aa-86de-4b6c-8a4b-370a1b18f4fd service nova] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:54:21.733082 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241c87aa-86de-4b6c-8a4b-370a1b18f4fd service nova] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:54:21.733352 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241c87aa-86de-4b6c-8a4b-370a1b18f4fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:54:21.735014 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-241c87aa-86de-4b6c-8a4b-370a1b18f4fd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:54:21.780812 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:54:21.838434 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241c87aa-86de-4b6c-8a4b-370a1b18f4fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:54:21.840037 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241c87aa-86de-4b6c-8a4b-370a1b18f4fd service nova] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:54:21.859772 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 702/1403] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 11:54:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 11:54:24.379185 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e81fbc5-e1b3-4e0f-9df7-3e18f904bf56 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:54:24.379773 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e81fbc5-e1b3-4e0f-9df7-3e18f904bf56 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:54:24.379773 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e81fbc5-e1b3-4e0f-9df7-3e18f904bf56 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:54:24.381620 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 702/1404] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:54:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:54:24.386484 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37213b99-38c1-4871-b1a0-1c13f10769d9 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:54:24.386935 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37213b99-38c1-4871-b1a0-1c13f10769d9 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:54:24.387619 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37213b99-38c1-4871-b1a0-1c13f10769d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:54:24.467439 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-37213b99-38c1-4871-b1a0-1c13f10769d9 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:54:24.468857 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-37213b99-38c1-4871-b1a0-1c13f10769d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:54:24.589105 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 703/1405] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:54:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 11:54:24.885631 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e81fbc5-e1b3-4e0f-9df7-3e18f904bf56 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:54:24.887329 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-3e81fbc5-e1b3-4e0f-9df7-3e18f904bf56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:54:25.018560 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:54:25.054043 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e81fbc5-e1b3-4e0f-9df7-3e18f904bf56 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:54:25.191616 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b55ddc-7e0a-4cda-bcbd-12d0ace30fb4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8e23d1d2fe24bdf9552e7c2f0ae3424', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:54:25.192228 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b55ddc-7e0a-4cda-bcbd-12d0ace30fb4 service nova] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:54:25.192504 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b55ddc-7e0a-4cda-bcbd-12d0ace30fb4 service nova] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:54:25.192815 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b55ddc-7e0a-4cda-bcbd-12d0ace30fb4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:54:25.194619 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-96b55ddc-7e0a-4cda-bcbd-12d0ace30fb4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:54:25.290831 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:54:25.304226 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b55ddc-7e0a-4cda-bcbd-12d0ace30fb4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:54:25.312432 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b55ddc-7e0a-4cda-bcbd-12d0ace30fb4 service nova] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:54:25.345593 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 703/1406] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 11:54:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 11:54:27.819924 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0412d8-41c2-4dd2-b4d4-866020dd0cd6 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:54:27.820564 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0412d8-41c2-4dd2-b4d4-866020dd0cd6 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:54:27.820564 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0412d8-41c2-4dd2-b4d4-866020dd0cd6 None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:54:27.824961 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 704/1407] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:54:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:54:27.827170 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a1171b-e139-45ba-bdd4-bd6f31ba36e9 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:54:27.827659 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a1171b-e139-45ba-bdd4-bd6f31ba36e9 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:54:27.827761 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a1171b-e139-45ba-bdd4-bd6f31ba36e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:54:27.907274 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-32a1171b-e139-45ba-bdd4-bd6f31ba36e9 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:54:27.908496 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-32a1171b-e139-45ba-bdd4-bd6f31ba36e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:54:28.024265 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 704/1408] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:54:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 11:54:28.322645 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0412d8-41c2-4dd2-b4d4-866020dd0cd6 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:54:28.325029 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-7c0412d8-41c2-4dd2-b4d4-866020dd0cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:54:28.348969 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:54:28.493277 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0412d8-41c2-4dd2-b4d4-866020dd0cd6 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:54:28.624323 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:54:28.624323 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca860b7-bea7-4851-b6c0-cc42c6da515e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8e23d1d2fe24bdf9552e7c2f0ae3424', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:54:28.624323 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca860b7-bea7-4851-b6c0-cc42c6da515e service nova] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:54:28.624323 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca860b7-bea7-4851-b6c0-cc42c6da515e service nova] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:54:28.625031 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca860b7-bea7-4851-b6c0-cc42c6da515e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:54:28.625500 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-1ca860b7-bea7-4851-b6c0-cc42c6da515e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:54:28.725421 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca860b7-bea7-4851-b6c0-cc42c6da515e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:54:28.727154 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca860b7-bea7-4851-b6c0-cc42c6da515e service nova] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:54:28.749712 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 705/1409] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 11:54:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 11:54:38.022687 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=74 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:54:38.744644 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=54 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:54:43.535169 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ab53ae-9f9b-4ad6-9327-aa3bdaa8f241 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:54:43.535653 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ab53ae-9f9b-4ad6-9327-aa3bdaa8f241 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:54:43.535768 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ab53ae-9f9b-4ad6-9327-aa3bdaa8f241 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:54:43.537101 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 705/1410] 10.222.0.59 () {54 vars in 918 bytes} [Tue Oct 4 11:54:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:54:43.542256 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346e04e9-6c95-4b22-858e-0817376e6edd None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:54:43.543310 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346e04e9-6c95-4b22-858e-0817376e6edd None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:54:43.543422 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346e04e9-6c95-4b22-858e-0817376e6edd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:54:43.621948 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-346e04e9-6c95-4b22-858e-0817376e6edd None None] MFA Rules not processed for user `be119968b02440adbbbc85c553077b92`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:54:43.623147 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-346e04e9-6c95-4b22-858e-0817376e6edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:54:43.726284 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 706/1411] 10.222.0.59 () {58 vars in 1015 bytes} [Tue Oct 4 11:54:43 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 11:54:43.741455 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460aa6f7-a519-4a04-8456-57cc87e463d7 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:54:43.741733 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460aa6f7-a519-4a04-8456-57cc87e463d7 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:54:43.742001 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460aa6f7-a519-4a04-8456-57cc87e463d7 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:54:43.743316 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 706/1412] 10.222.0.59 () {54 vars in 918 bytes} [Tue Oct 4 11:54:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:54:43.748907 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ca3f83-9f61-4fa9-8fa8-950ad9ffcada None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:54:43.749190 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ca3f83-9f61-4fa9-8fa8-950ad9ffcada None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:54:43.749463 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ca3f83-9f61-4fa9-8fa8-950ad9ffcada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:54:43.820385 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:54:43.823304 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-c8ca3f83-9f61-4fa9-8fa8-950ad9ffcada None None] MFA Rules not processed for user `a8e23d1d2fe24bdf9552e7c2f0ae3424`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:54:43.824790 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-c8ca3f83-9f61-4fa9-8fa8-950ad9ffcada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:54:43.940534 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 707/1413] 10.222.0.59 () {58 vars in 1015 bytes} [Tue Oct 4 11:54:43 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 11:54:46.603932 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f5343a-57c3-4e98-84b8-e5f071aacf04 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:54:46.604473 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f5343a-57c3-4e98-84b8-e5f071aacf04 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:54:46.604591 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f5343a-57c3-4e98-84b8-e5f071aacf04 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:54:46.606603 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 707/1414] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 11:54:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:54:46.612067 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a9907b-f8d4-4edc-8b28-3dd47a01a6d4 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:54:46.612502 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a9907b-f8d4-4edc-8b28-3dd47a01a6d4 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:54:46.612645 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a9907b-f8d4-4edc-8b28-3dd47a01a6d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:54:46.679743 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-25a9907b-f8d4-4edc-8b28-3dd47a01a6d4 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:54:46.680970 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-25a9907b-f8d4-4edc-8b28-3dd47a01a6d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:54:46.738632 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:54:46.781416 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 708/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 11:54:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 11:54:47.082080 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f5343a-57c3-4e98-84b8-e5f071aacf04 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:54:47.083591 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-54f5343a-57c3-4e98-84b8-e5f071aacf04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:54:47.232855 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f5343a-57c3-4e98-84b8-e5f071aacf04 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:54:47.306083 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:54:47.351668 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ee0d48-1168-4de9-a361-629d5c6f7336 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8e23d1d2fe24bdf9552e7c2f0ae3424', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:54:47.351668 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ee0d48-1168-4de9-a361-629d5c6f7336 service nova] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:54:47.351668 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ee0d48-1168-4de9-a361-629d5c6f7336 service nova] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:54:47.351668 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ee0d48-1168-4de9-a361-629d5c6f7336 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:54:47.352143 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-e4ee0d48-1168-4de9-a361-629d5c6f7336 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:54:47.438152 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ee0d48-1168-4de9-a361-629d5c6f7336 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:54:47.439877 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ee0d48-1168-4de9-a361-629d5c6f7336 service nova] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:54:47.458044 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 708/1416] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 11:54:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 11:54:48.608171 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83abec41-a93f-41f0-96ee-208ae8a4fad3 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:54:48.608755 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83abec41-a93f-41f0-96ee-208ae8a4fad3 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:54:48.608873 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83abec41-a93f-41f0-96ee-208ae8a4fad3 None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:54:48.610295 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 709/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 4 11:54:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:54:48.617017 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61410e91-40ee-48c5-be1f-a7979becb4c7 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:54:48.617462 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61410e91-40ee-48c5-be1f-a7979becb4c7 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:54:48.617567 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61410e91-40ee-48c5-be1f-a7979becb4c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:54:48.694325 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-61410e91-40ee-48c5-be1f-a7979becb4c7 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:54:48.695526 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-61410e91-40ee-48c5-be1f-a7979becb4c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:54:48.722915 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:54:48.794690 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 709/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 4 11:54:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 11:54:48.961008 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83abec41-a93f-41f0-96ee-208ae8a4fad3 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:54:48.962671 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-83abec41-a93f-41f0-96ee-208ae8a4fad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:54:49.113701 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83abec41-a93f-41f0-96ee-208ae8a4fad3 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:54:49.154981 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:54:49.227675 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a129dd-5228-49bc-a61e-614f2bef6bc8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8e23d1d2fe24bdf9552e7c2f0ae3424', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:54:49.228292 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a129dd-5228-49bc-a61e-614f2bef6bc8 service nova] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:54:49.228574 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a129dd-5228-49bc-a61e-614f2bef6bc8 service nova] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:54:49.228883 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a129dd-5228-49bc-a61e-614f2bef6bc8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:54:49.231151 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-35a129dd-5228-49bc-a61e-614f2bef6bc8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:54:49.320088 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a129dd-5228-49bc-a61e-614f2bef6bc8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:54:49.321697 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a129dd-5228-49bc-a61e-614f2bef6bc8 service nova] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:54:49.340314 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 710/1419] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 11:54:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 11:54:50.478710 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8139daa8-4b77-4afe-9827-ea2daf71a646 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:54:50.479278 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8139daa8-4b77-4afe-9827-ea2daf71a646 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:54:50.479278 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8139daa8-4b77-4afe-9827-ea2daf71a646 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:54:50.480679 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 710/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 4 11:54:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:54:50.487225 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837c79d3-d393-41cf-9bc2-1e20e18ac90b None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:54:50.487667 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837c79d3-d393-41cf-9bc2-1e20e18ac90b None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:54:50.487772 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837c79d3-d393-41cf-9bc2-1e20e18ac90b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:54:50.543335 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:54:50.565109 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-837c79d3-d393-41cf-9bc2-1e20e18ac90b None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:54:50.566254 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-837c79d3-d393-41cf-9bc2-1e20e18ac90b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:54:50.663858 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 711/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 4 11:54:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 11:54:50.815751 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8139daa8-4b77-4afe-9827-ea2daf71a646 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:54:50.817223 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-8139daa8-4b77-4afe-9827-ea2daf71a646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:54:50.962704 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8139daa8-4b77-4afe-9827-ea2daf71a646 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:54:50.974615 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:54:51.074848 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2000af95-d023-4e3b-908c-318ddba9722f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8e23d1d2fe24bdf9552e7c2f0ae3424', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:54:51.075376 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2000af95-d023-4e3b-908c-318ddba9722f service nova] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:54:51.075651 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2000af95-d023-4e3b-908c-318ddba9722f service nova] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:54:51.075919 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2000af95-d023-4e3b-908c-318ddba9722f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:54:51.077553 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-2000af95-d023-4e3b-908c-318ddba9722f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:54:51.166377 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2000af95-d023-4e3b-908c-318ddba9722f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:54:51.167995 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2000af95-d023-4e3b-908c-318ddba9722f service nova] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:54:51.186323 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 711/1422] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 11:54:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 11:54:52.331391 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa0cf50-2145-4182-99e5-76770bb9b9d6 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:54:52.332001 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa0cf50-2145-4182-99e5-76770bb9b9d6 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:54:52.332001 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa0cf50-2145-4182-99e5-76770bb9b9d6 None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:54:52.333351 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 712/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 4 11:54:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:54:52.340539 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a261cb0-0c74-4c8b-b964-9a4e58827ee0 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:54:52.341143 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a261cb0-0c74-4c8b-b964-9a4e58827ee0 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:54:52.341143 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a261cb0-0c74-4c8b-b964-9a4e58827ee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:54:52.363158 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:54:52.423310 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-4a261cb0-0c74-4c8b-b964-9a4e58827ee0 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:54:52.424527 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-4a261cb0-0c74-4c8b-b964-9a4e58827ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:54:52.529759 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 712/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 4 11:54:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 11:54:52.696785 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa0cf50-2145-4182-99e5-76770bb9b9d6 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:54:52.699085 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-0fa0cf50-2145-4182-99e5-76770bb9b9d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:54:52.810659 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:54:52.845852 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa0cf50-2145-4182-99e5-76770bb9b9d6 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:54:52.962225 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676001eb-d9fe-4bde-aa08-146cc0a54f93 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8e23d1d2fe24bdf9552e7c2f0ae3424', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:54:52.962841 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676001eb-d9fe-4bde-aa08-146cc0a54f93 service nova] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:54:52.963124 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676001eb-d9fe-4bde-aa08-146cc0a54f93 service nova] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:54:52.963398 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676001eb-d9fe-4bde-aa08-146cc0a54f93 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:54:52.966088 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-676001eb-d9fe-4bde-aa08-146cc0a54f93 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:54:53.042278 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:54:53.055356 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676001eb-d9fe-4bde-aa08-146cc0a54f93 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:54:53.065056 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676001eb-d9fe-4bde-aa08-146cc0a54f93 service nova] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:54:53.075852 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 713/1425] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 11:54:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 11:54:54.217258 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eb56e4-ce2b-4961-9a83-36cbb1125dcc None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:54:54.217814 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eb56e4-ce2b-4961-9a83-36cbb1125dcc None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:54:54.217814 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eb56e4-ce2b-4961-9a83-36cbb1125dcc None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:54:54.219207 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 713/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 4 11:54:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:54:54.226096 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5368fe95-93d6-421e-8d9a-f27b19dd3e9f None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:54:54.226546 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5368fe95-93d6-421e-8d9a-f27b19dd3e9f None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:54:54.226652 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5368fe95-93d6-421e-8d9a-f27b19dd3e9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:54:54.320245 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-5368fe95-93d6-421e-8d9a-f27b19dd3e9f None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:54:54.321482 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-5368fe95-93d6-421e-8d9a-f27b19dd3e9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:54:54.422922 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 714/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 4 11:54:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 11:54:54.593238 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eb56e4-ce2b-4961-9a83-36cbb1125dcc None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:54:54.595058 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-40eb56e4-ce2b-4961-9a83-36cbb1125dcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:54:54.682971 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:54:54.751174 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eb56e4-ce2b-4961-9a83-36cbb1125dcc None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:54:54.875038 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad00e00-6704-4e42-a03c-3bec27a6bca7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8e23d1d2fe24bdf9552e7c2f0ae3424', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:54:54.875641 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad00e00-6704-4e42-a03c-3bec27a6bca7 service nova] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:54:54.875939 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad00e00-6704-4e42-a03c-3bec27a6bca7 service nova] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:54:54.876259 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad00e00-6704-4e42-a03c-3bec27a6bca7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:54:54.878125 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-aad00e00-6704-4e42-a03c-3bec27a6bca7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:54:54.931757 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:54:54.972887 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad00e00-6704-4e42-a03c-3bec27a6bca7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:54:54.974470 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad00e00-6704-4e42-a03c-3bec27a6bca7 service nova] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:54:54.993747 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 714/1428] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 11:54:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 11:54:56.270712 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96184c59-bb25-4654-9fca-d0a90bffa2d0 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:54:56.271304 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96184c59-bb25-4654-9fca-d0a90bffa2d0 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:54:56.271304 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96184c59-bb25-4654-9fca-d0a90bffa2d0 None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:54:56.272565 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 715/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 4 11:54:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 11:54:56.281897 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ce6945-9028-44aa-913b-d1f8dc33da66 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:54:56.282596 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ce6945-9028-44aa-913b-d1f8dc33da66 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:54:56.282823 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ce6945-9028-44aa-913b-d1f8dc33da66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:54:56.374430 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-c3ce6945-9028-44aa-913b-d1f8dc33da66 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:54:56.375668 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-c3ce6945-9028-44aa-913b-d1f8dc33da66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:54:56.497369 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 715/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 4 11:54:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 11:54:56.664739 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96184c59-bb25-4654-9fca-d0a90bffa2d0 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:54:56.666275 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-96184c59-bb25-4654-9fca-d0a90bffa2d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:54:56.716262 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:54:56.843814 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96184c59-bb25-4654-9fca-d0a90bffa2d0 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:54:56.959328 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a2a987-3585-4282-8be0-7df83829112f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8e23d1d2fe24bdf9552e7c2f0ae3424', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:54:56.959946 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a2a987-3585-4282-8be0-7df83829112f service nova] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:54:56.960263 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a2a987-3585-4282-8be0-7df83829112f service nova] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:54:56.960538 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a2a987-3585-4282-8be0-7df83829112f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:54:56.962209 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-12a2a987-3585-4282-8be0-7df83829112f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:54:56.970083 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:54:57.055002 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a2a987-3585-4282-8be0-7df83829112f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:54:57.056628 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a2a987-3585-4282-8be0-7df83829112f service nova] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:54:57.074927 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 716/1431] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 11:54:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 11:54:58.289593 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079790c2-d640-44a9-bb4a-4650a8f26970 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:54:58.290174 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079790c2-d640-44a9-bb4a-4650a8f26970 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:54:58.290174 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079790c2-d640-44a9-bb4a-4650a8f26970 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:54:58.291513 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 716/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 4 11:54:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:54:58.298442 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75ae6cb-353d-4cef-8aee-1427cc83fc3b None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:54:58.298900 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75ae6cb-353d-4cef-8aee-1427cc83fc3b None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:54:58.299026 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75ae6cb-353d-4cef-8aee-1427cc83fc3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:54:58.379175 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-f75ae6cb-353d-4cef-8aee-1427cc83fc3b None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:54:58.380391 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-f75ae6cb-353d-4cef-8aee-1427cc83fc3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:54:58.462873 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:54:58.493092 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 717/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 4 11:54:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 11:54:58.645609 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079790c2-d640-44a9-bb4a-4650a8f26970 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:54:58.647119 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-079790c2-d640-44a9-bb4a-4650a8f26970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:54:58.665152 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:54:58.801090 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079790c2-d640-44a9-bb4a-4650a8f26970 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:54:58.887957 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:54:58.913361 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bf6043-02f7-4b91-823d-c3ba490f3ee7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8e23d1d2fe24bdf9552e7c2f0ae3424', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:54:58.913901 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bf6043-02f7-4b91-823d-c3ba490f3ee7 service nova] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:54:58.914174 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bf6043-02f7-4b91-823d-c3ba490f3ee7 service nova] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:54:58.914439 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bf6043-02f7-4b91-823d-c3ba490f3ee7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:54:58.916022 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-43bf6043-02f7-4b91-823d-c3ba490f3ee7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:54:59.004852 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bf6043-02f7-4b91-823d-c3ba490f3ee7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:54:59.006414 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bf6043-02f7-4b91-823d-c3ba490f3ee7 service nova] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:54:59.024703 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 717/1434] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 11:54:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 11:55:00.252140 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14851b93-7c7e-4c7d-a639-1f3cabbfad25 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:55:00.252750 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14851b93-7c7e-4c7d-a639-1f3cabbfad25 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:55:00.252750 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14851b93-7c7e-4c7d-a639-1f3cabbfad25 None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:55:00.254107 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 718/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 4 11:55:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:55:00.260126 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cb0a9b-ee9d-4d59-a6ab-9cfdb2452965 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:55:00.261084 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cb0a9b-ee9d-4d59-a6ab-9cfdb2452965 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:55:00.261364 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cb0a9b-ee9d-4d59-a6ab-9cfdb2452965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:55:00.347985 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-e5cb0a9b-ee9d-4d59-a6ab-9cfdb2452965 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:55:00.349312 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-e5cb0a9b-ee9d-4d59-a6ab-9cfdb2452965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:55:00.393337 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:55:00.452863 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 718/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 4 11:55:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 11:55:00.602480 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14851b93-7c7e-4c7d-a639-1f3cabbfad25 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:55:00.604018 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-14851b93-7c7e-4c7d-a639-1f3cabbfad25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:55:00.762477 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14851b93-7c7e-4c7d-a639-1f3cabbfad25 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:55:00.824718 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:55:00.882263 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e575662-c14c-44c5-9c4c-aa2fe59e3b56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8e23d1d2fe24bdf9552e7c2f0ae3424', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:55:00.882865 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e575662-c14c-44c5-9c4c-aa2fe59e3b56 service nova] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:55:00.883137 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e575662-c14c-44c5-9c4c-aa2fe59e3b56 service nova] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:55:00.883406 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e575662-c14c-44c5-9c4c-aa2fe59e3b56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:55:00.885927 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-1e575662-c14c-44c5-9c4c-aa2fe59e3b56 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:55:00.974272 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e575662-c14c-44c5-9c4c-aa2fe59e3b56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:55:00.975862 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e575662-c14c-44c5-9c4c-aa2fe59e3b56 service nova] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:55:00.994685 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 719/1437] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 11:55:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 11:55:02.205097 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109a999f-d673-4273-9309-86fe01263d09 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:55:02.205661 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109a999f-d673-4273-9309-86fe01263d09 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:55:02.205661 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109a999f-d673-4273-9309-86fe01263d09 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:55:02.206905 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 719/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 4 11:55:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:55:02.213010 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c144041-a28a-48e9-8583-9747eb3b1160 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:55:02.213992 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c144041-a28a-48e9-8583-9747eb3b1160 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:55:02.214106 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c144041-a28a-48e9-8583-9747eb3b1160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:55:02.290446 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-1c144041-a28a-48e9-8583-9747eb3b1160 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:55:02.292249 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-1c144041-a28a-48e9-8583-9747eb3b1160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:55:02.294289 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:55:02.390328 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 720/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 4 11:55:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 11:55:02.546780 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109a999f-d673-4273-9309-86fe01263d09 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:55:02.548340 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-109a999f-d673-4273-9309-86fe01263d09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:55:02.695923 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109a999f-d673-4273-9309-86fe01263d09 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:55:02.729596 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:55:02.821642 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84172705-1503-4ddf-b321-b28508c2391f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8e23d1d2fe24bdf9552e7c2f0ae3424', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:55:02.822161 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84172705-1503-4ddf-b321-b28508c2391f service nova] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:55:02.822420 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84172705-1503-4ddf-b321-b28508c2391f service nova] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:55:02.823224 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84172705-1503-4ddf-b321-b28508c2391f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:55:02.824828 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-84172705-1503-4ddf-b321-b28508c2391f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:55:02.913358 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84172705-1503-4ddf-b321-b28508c2391f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:55:02.914936 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84172705-1503-4ddf-b321-b28508c2391f service nova] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:55:02.933598 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 720/1440] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 11:55:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 11:55:05.086517 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdf1b02-cf73-47d4-b86f-a7e067b684f0 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:55:05.087150 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdf1b02-cf73-47d4-b86f-a7e067b684f0 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:55:05.087150 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdf1b02-cf73-47d4-b86f-a7e067b684f0 None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:55:05.089323 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 721/1441] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 11:55:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:55:05.094827 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e31d37-a6ab-4b3f-8028-a3a5f888ec2c None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:55:05.095241 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e31d37-a6ab-4b3f-8028-a3a5f888ec2c None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:55:05.095379 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e31d37-a6ab-4b3f-8028-a3a5f888ec2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:55:05.138641 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:55:05.163354 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-d7e31d37-a6ab-4b3f-8028-a3a5f888ec2c None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:55:05.164568 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-d7e31d37-a6ab-4b3f-8028-a3a5f888ec2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:55:05.264181 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 721/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 11:55:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 11:55:05.557317 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdf1b02-cf73-47d4-b86f-a7e067b684f0 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:55:05.559035 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-0cdf1b02-cf73-47d4-b86f-a7e067b684f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:55:05.664424 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdf1b02-cf73-47d4-b86f-a7e067b684f0 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:55:05.696922 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:55:05.741916 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc88391d-0118-4f53-a7fd-394ae5858cb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7289515c5c44914a19daa439de98cb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:55:05.742692 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc88391d-0118-4f53-a7fd-394ae5858cb6 service neutron] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:55:05.743037 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc88391d-0118-4f53-a7fd-394ae5858cb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:55:05.743313 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc88391d-0118-4f53-a7fd-394ae5858cb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:55:05.745035 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-bc88391d-0118-4f53-a7fd-394ae5858cb6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:55:05.857809 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc88391d-0118-4f53-a7fd-394ae5858cb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:55:05.859118 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc88391d-0118-4f53-a7fd-394ae5858cb6 service neutron] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:55:05.880554 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 722/1443] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 11:55:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 11:55:08.389259 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8214235d-0ac6-4b88-876b-03bf262d6c38 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:55:08.389834 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8214235d-0ac6-4b88-876b-03bf262d6c38 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:55:08.389834 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8214235d-0ac6-4b88-876b-03bf262d6c38 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:55:08.391128 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 722/1444] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 11:55:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:55:08.396297 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628134b1-3880-4a9e-b072-c1ba968c39da None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:55:08.396736 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628134b1-3880-4a9e-b072-c1ba968c39da None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:55:08.396870 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628134b1-3880-4a9e-b072-c1ba968c39da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:55:08.462839 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-628134b1-3880-4a9e-b072-c1ba968c39da None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:55:08.464170 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-628134b1-3880-4a9e-b072-c1ba968c39da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:55:08.476493 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:55:08.559831 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 723/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 11:55:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 11:55:08.845432 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8214235d-0ac6-4b88-876b-03bf262d6c38 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:55:08.846962 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-8214235d-0ac6-4b88-876b-03bf262d6c38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:55:08.949913 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8214235d-0ac6-4b88-876b-03bf262d6c38 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:55:08.962481 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:55:09.021452 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05885e1-3365-4864-83d9-451d317392a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7289515c5c44914a19daa439de98cb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:55:09.021969 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05885e1-3365-4864-83d9-451d317392a9 service neutron] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:55:09.022244 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05885e1-3365-4864-83d9-451d317392a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:55:09.022511 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05885e1-3365-4864-83d9-451d317392a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:55:09.024082 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-f05885e1-3365-4864-83d9-451d317392a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:55:09.131412 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05885e1-3365-4864-83d9-451d317392a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:55:09.132860 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05885e1-3365-4864-83d9-451d317392a9 service neutron] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:55:09.151045 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 723/1446] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 11:55:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 11:55:11.732894 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6990d5a8-8445-4c5b-b5fd-ac211e069135 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:55:11.733455 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6990d5a8-8445-4c5b-b5fd-ac211e069135 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:55:11.733455 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6990d5a8-8445-4c5b-b5fd-ac211e069135 None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:55:11.734839 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 724/1447] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 11:55:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:55:11.740338 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cab2a4a-75e6-48b9-8670-e1292dd2aaeb None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:55:11.740819 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cab2a4a-75e6-48b9-8670-e1292dd2aaeb None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:55:11.740925 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cab2a4a-75e6-48b9-8670-e1292dd2aaeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:55:11.788708 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:55:11.807528 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-2cab2a4a-75e6-48b9-8670-e1292dd2aaeb None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:55:11.808887 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-2cab2a4a-75e6-48b9-8670-e1292dd2aaeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:55:11.906062 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 724/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 11:55:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 11:55:12.191200 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6990d5a8-8445-4c5b-b5fd-ac211e069135 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:55:12.192771 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-6990d5a8-8445-4c5b-b5fd-ac211e069135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:55:12.295901 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6990d5a8-8445-4c5b-b5fd-ac211e069135 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:55:12.335243 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:55:12.368390 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435166a6-2b21-4168-9747-86946a148ed1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7289515c5c44914a19daa439de98cb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:55:12.369021 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435166a6-2b21-4168-9747-86946a148ed1 service neutron] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:55:12.369351 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435166a6-2b21-4168-9747-86946a148ed1 service neutron] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:55:12.369619 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435166a6-2b21-4168-9747-86946a148ed1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:55:12.371199 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-435166a6-2b21-4168-9747-86946a148ed1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:55:12.489165 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435166a6-2b21-4168-9747-86946a148ed1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:55:12.490595 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435166a6-2b21-4168-9747-86946a148ed1 service neutron] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:55:12.508086 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 725/1449] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 11:55:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 11:55:14.817313 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f69d7ff-3641-433f-80c9-dd082c5ef483 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:55:14.817839 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f69d7ff-3641-433f-80c9-dd082c5ef483 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:55:14.817839 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f69d7ff-3641-433f-80c9-dd082c5ef483 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:55:14.819194 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 725/1450] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 11:55:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:55:14.824780 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39262e3e-d749-48e4-a482-cd084f90a467 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:55:14.825212 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39262e3e-d749-48e4-a482-cd084f90a467 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:55:14.825320 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39262e3e-d749-48e4-a482-cd084f90a467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:55:14.897675 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-39262e3e-d749-48e4-a482-cd084f90a467 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:55:14.898895 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-39262e3e-d749-48e4-a482-cd084f90a467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:55:14.920152 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:55:15.111725 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 726/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 11:55:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 11:55:15.396015 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f69d7ff-3641-433f-80c9-dd082c5ef483 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:55:15.397601 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-6f69d7ff-3641-433f-80c9-dd082c5ef483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:55:15.500723 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f69d7ff-3641-433f-80c9-dd082c5ef483 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:55:15.521556 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:55:15.575523 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8a1f33-812f-4677-b06a-b22de809d475 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7289515c5c44914a19daa439de98cb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:55:15.576123 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8a1f33-812f-4677-b06a-b22de809d475 service neutron] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:55:15.576404 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8a1f33-812f-4677-b06a-b22de809d475 service neutron] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:55:15.576696 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8a1f33-812f-4677-b06a-b22de809d475 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:55:15.578279 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-fc8a1f33-812f-4677-b06a-b22de809d475 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:55:15.687896 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8a1f33-812f-4677-b06a-b22de809d475 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:55:15.689270 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8a1f33-812f-4677-b06a-b22de809d475 service neutron] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:55:15.707212 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 726/1452] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 11:55:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 11:55:17.960146 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed2b65a-da28-4a90-99cd-b16da79bc57c None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:55:17.960749 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed2b65a-da28-4a90-99cd-b16da79bc57c None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:55:17.960749 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed2b65a-da28-4a90-99cd-b16da79bc57c None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:55:17.962051 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 727/1453] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 11:55:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:55:17.967885 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622eced7-4e19-46d9-8cc8-de2adf8c683c None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:55:17.968295 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622eced7-4e19-46d9-8cc8-de2adf8c683c None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:55:17.968465 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622eced7-4e19-46d9-8cc8-de2adf8c683c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:55:18.032797 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:55:18.035160 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-622eced7-4e19-46d9-8cc8-de2adf8c683c None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:55:18.036367 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-622eced7-4e19-46d9-8cc8-de2adf8c683c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:55:18.133606 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 727/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 11:55:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 11:55:18.428795 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed2b65a-da28-4a90-99cd-b16da79bc57c None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:55:18.430343 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-2ed2b65a-da28-4a90-99cd-b16da79bc57c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:55:18.551657 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed2b65a-da28-4a90-99cd-b16da79bc57c None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:55:18.602756 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:55:18.630794 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1be5b72-3e62-4773-add5-4a20aac045b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7289515c5c44914a19daa439de98cb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:55:18.631409 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1be5b72-3e62-4773-add5-4a20aac045b6 service neutron] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:55:18.631691 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1be5b72-3e62-4773-add5-4a20aac045b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:55:18.631965 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1be5b72-3e62-4773-add5-4a20aac045b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:55:18.633592 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-b1be5b72-3e62-4773-add5-4a20aac045b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:55:18.742279 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1be5b72-3e62-4773-add5-4a20aac045b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:55:18.743720 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1be5b72-3e62-4773-add5-4a20aac045b6 service neutron] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:55:18.762142 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 728/1455] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 11:55:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 11:55:21.006776 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6a1786-a1d9-462a-8660-57014b1f0929 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:55:21.007338 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6a1786-a1d9-462a-8660-57014b1f0929 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:55:21.007338 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6a1786-a1d9-462a-8660-57014b1f0929 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:55:21.008698 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 728/1456] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 11:55:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:55:21.014166 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ef2e32-80c3-48ca-a942-f51b3dd2fdeb None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:55:21.014576 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ef2e32-80c3-48ca-a942-f51b3dd2fdeb None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:55:21.014724 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ef2e32-80c3-48ca-a942-f51b3dd2fdeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:55:21.081364 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-a3ef2e32-80c3-48ca-a942-f51b3dd2fdeb None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:55:21.082583 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-a3ef2e32-80c3-48ca-a942-f51b3dd2fdeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:55:21.112004 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:55:21.177599 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 729/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 11:55:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 11:55:21.459717 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6a1786-a1d9-462a-8660-57014b1f0929 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:55:21.461263 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-fe6a1786-a1d9-462a-8660-57014b1f0929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:55:21.566847 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6a1786-a1d9-462a-8660-57014b1f0929 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:55:21.596465 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:55:21.641313 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d894e25-62a3-4b99-a4fc-8903dff07e4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7289515c5c44914a19daa439de98cb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:55:21.641909 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d894e25-62a3-4b99-a4fc-8903dff07e4f service neutron] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:55:21.642182 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d894e25-62a3-4b99-a4fc-8903dff07e4f service neutron] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:55:21.642447 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d894e25-62a3-4b99-a4fc-8903dff07e4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:55:21.644021 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-8d894e25-62a3-4b99-a4fc-8903dff07e4f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:55:21.752826 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d894e25-62a3-4b99-a4fc-8903dff07e4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:55:21.754253 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d894e25-62a3-4b99-a4fc-8903dff07e4f service neutron] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:55:21.771991 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 729/1458] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 11:55:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 11:55:24.001222 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35552b3c-1c83-4ffc-94a6-d00bda527ecf None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:55:24.001764 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35552b3c-1c83-4ffc-94a6-d00bda527ecf None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:55:24.001764 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35552b3c-1c83-4ffc-94a6-d00bda527ecf None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:55:24.003114 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 730/1459] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 11:55:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:55:24.008392 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7308e5df-ab0d-4cc8-9b7f-5915e2364ada None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:55:24.008833 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7308e5df-ab0d-4cc8-9b7f-5915e2364ada None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:55:24.008967 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7308e5df-ab0d-4cc8-9b7f-5915e2364ada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:55:24.073843 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-7308e5df-ab0d-4cc8-9b7f-5915e2364ada None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:55:24.075028 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-7308e5df-ab0d-4cc8-9b7f-5915e2364ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:55:24.083357 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:55:24.171462 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 730/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 11:55:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 11:55:24.459491 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35552b3c-1c83-4ffc-94a6-d00bda527ecf None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:55:24.461108 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-35552b3c-1c83-4ffc-94a6-d00bda527ecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:55:24.571085 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35552b3c-1c83-4ffc-94a6-d00bda527ecf None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:55:24.628371 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:55:24.647261 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df26a315-e292-46f6-a507-19878d43279f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7289515c5c44914a19daa439de98cb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:55:24.647863 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df26a315-e292-46f6-a507-19878d43279f service neutron] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:55:24.648167 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df26a315-e292-46f6-a507-19878d43279f service neutron] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:55:24.648439 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df26a315-e292-46f6-a507-19878d43279f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:55:24.650592 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-df26a315-e292-46f6-a507-19878d43279f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:55:24.760955 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df26a315-e292-46f6-a507-19878d43279f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:55:24.762381 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df26a315-e292-46f6-a507-19878d43279f service neutron] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:55:24.780872 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 731/1461] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 11:55:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 11:55:26.972188 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008fa11a-0d24-47a5-b766-ed34de50636d None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:55:26.972773 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008fa11a-0d24-47a5-b766-ed34de50636d None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:55:26.972773 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008fa11a-0d24-47a5-b766-ed34de50636d None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:55:26.974132 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 731/1462] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 11:55:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:55:26.980238 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b19d040-65c5-42df-bdba-cda3c4626abb None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:55:26.980700 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b19d040-65c5-42df-bdba-cda3c4626abb None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:55:26.980808 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b19d040-65c5-42df-bdba-cda3c4626abb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:55:27.046646 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-6b19d040-65c5-42df-bdba-cda3c4626abb None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:55:27.047855 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-6b19d040-65c5-42df-bdba-cda3c4626abb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:55:27.091634 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:55:27.149449 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 732/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 11:55:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 11:55:27.434671 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008fa11a-0d24-47a5-b766-ed34de50636d None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:55:27.436207 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-008fa11a-0d24-47a5-b766-ed34de50636d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:55:27.540743 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008fa11a-0d24-47a5-b766-ed34de50636d None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:55:27.578122 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:55:27.613399 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a64c04-609b-4a6a-98e2-6587f13e75f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7289515c5c44914a19daa439de98cb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:55:27.613997 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a64c04-609b-4a6a-98e2-6587f13e75f9 service neutron] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:55:27.614273 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a64c04-609b-4a6a-98e2-6587f13e75f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:55:27.614540 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a64c04-609b-4a6a-98e2-6587f13e75f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:55:27.616118 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-96a64c04-609b-4a6a-98e2-6587f13e75f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:55:27.725449 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a64c04-609b-4a6a-98e2-6587f13e75f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:55:27.726884 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a64c04-609b-4a6a-98e2-6587f13e75f9 service neutron] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:55:27.745510 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 732/1464] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 11:55:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 11:55:29.945423 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c22b158-556c-4a9d-a5d8-b9d00f8f2997 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:55:29.945959 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c22b158-556c-4a9d-a5d8-b9d00f8f2997 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:55:29.945959 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c22b158-556c-4a9d-a5d8-b9d00f8f2997 None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:55:29.948057 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 733/1465] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 11:55:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:55:29.953489 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0f3004-76af-4435-90bd-957e5ff7468e None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:55:29.953876 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0f3004-76af-4435-90bd-957e5ff7468e None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:55:29.954061 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0f3004-76af-4435-90bd-957e5ff7468e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:55:30.023295 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-fc0f3004-76af-4435-90bd-957e5ff7468e None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:55:30.024563 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-fc0f3004-76af-4435-90bd-957e5ff7468e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:55:30.044450 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:55:30.126804 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 733/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 11:55:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 11:55:30.410950 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c22b158-556c-4a9d-a5d8-b9d00f8f2997 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:55:30.412527 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-5c22b158-556c-4a9d-a5d8-b9d00f8f2997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:55:30.516873 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c22b158-556c-4a9d-a5d8-b9d00f8f2997 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:55:30.587479 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:55:30.596064 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc71e93-65f2-48de-9769-c5e03c7135f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7289515c5c44914a19daa439de98cb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:55:30.596719 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc71e93-65f2-48de-9769-c5e03c7135f7 service neutron] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:55:30.597003 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc71e93-65f2-48de-9769-c5e03c7135f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:55:30.597279 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc71e93-65f2-48de-9769-c5e03c7135f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:55:30.598887 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-3dc71e93-65f2-48de-9769-c5e03c7135f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:55:30.707693 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc71e93-65f2-48de-9769-c5e03c7135f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:55:30.709173 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc71e93-65f2-48de-9769-c5e03c7135f7 service neutron] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:55:30.727289 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 734/1467] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 11:55:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 11:55:32.999030 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0032f94-84af-4d52-ada7-8fbbfc05376f None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:55:32.999567 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0032f94-84af-4d52-ada7-8fbbfc05376f None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:55:32.999662 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0032f94-84af-4d52-ada7-8fbbfc05376f None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:55:33.001031 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 734/1468] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 11:55:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:55:33.006448 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dbabad-1a32-4702-82c1-beaf950f365c None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:55:33.006878 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dbabad-1a32-4702-82c1-beaf950f365c None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:55:33.006987 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dbabad-1a32-4702-82c1-beaf950f365c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:55:33.071397 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-53dbabad-1a32-4702-82c1-beaf950f365c None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:55:33.072631 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-53dbabad-1a32-4702-82c1-beaf950f365c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:55:33.125578 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:55:33.173613 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 735/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 11:55:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 11:55:33.457643 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0032f94-84af-4d52-ada7-8fbbfc05376f None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:55:33.459182 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-e0032f94-84af-4d52-ada7-8fbbfc05376f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:55:33.568248 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0032f94-84af-4d52-ada7-8fbbfc05376f None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:55:33.617555 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:55:33.644030 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7e7e60-32e5-4bf6-9a9b-7883d6c8d95c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7289515c5c44914a19daa439de98cb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:55:33.644662 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7e7e60-32e5-4bf6-9a9b-7883d6c8d95c service neutron] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:55:33.644939 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7e7e60-32e5-4bf6-9a9b-7883d6c8d95c service neutron] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:55:33.645209 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7e7e60-32e5-4bf6-9a9b-7883d6c8d95c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:55:33.646784 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-6f7e7e60-32e5-4bf6-9a9b-7883d6c8d95c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:55:33.757110 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7e7e60-32e5-4bf6-9a9b-7883d6c8d95c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:55:33.758735 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7e7e60-32e5-4bf6-9a9b-7883d6c8d95c service neutron] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:55:33.781039 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 735/1470] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 11:55:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 11:55:43.171996 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=22 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:55:43.778751 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=66 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:55:54.880450 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbf774d-c971-4738-9670-2bfe6ff8ce17 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:55:54.881026 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbf774d-c971-4738-9670-2bfe6ff8ce17 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:55:54.881026 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbf774d-c971-4738-9670-2bfe6ff8ce17 None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:55:54.882267 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 736/1471] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:55:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:55:54.887700 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eab3c16-d944-419d-9575-2fc649a03409 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:55:54.888132 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eab3c16-d944-419d-9575-2fc649a03409 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:55:54.888247 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eab3c16-d944-419d-9575-2fc649a03409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:55:54.962802 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-7eab3c16-d944-419d-9575-2fc649a03409 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:55:54.963993 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-7eab3c16-d944-419d-9575-2fc649a03409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:55:55.062599 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 736/1472] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:55:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 11:55:55.388629 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caf94b1-e02c-48c2-bebc-f04feb597084 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:55:55.388929 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caf94b1-e02c-48c2-bebc-f04feb597084 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:55:55.389208 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caf94b1-e02c-48c2-bebc-f04feb597084 None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:55:55.390537 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 737/1473] 10.222.0.59 () {54 vars in 962 bytes} [Tue Oct 4 11:55:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:55:55.395666 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dead98a-e82b-482d-8d28-84ef255abfee None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:55:55.395965 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dead98a-e82b-482d-8d28-84ef255abfee None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:55:55.396218 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dead98a-e82b-482d-8d28-84ef255abfee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:55:55.477146 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-8dead98a-e82b-482d-8d28-84ef255abfee None None] MFA Rules not processed for user `d516d0755be84b7293156625df1b13b3`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:55:55.478362 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-8dead98a-e82b-482d-8d28-84ef255abfee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:55:55.510874 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:55:55.577384 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 737/1474] 10.222.0.59 () {58 vars in 1059 bytes} [Tue Oct 4 11:55:55 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 11:55:55.585285 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caf94b1-e02c-48c2-bebc-f04feb597084 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:55:55.586815 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-0caf94b1-e02c-48c2-bebc-f04feb597084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:55:55.694527 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caf94b1-e02c-48c2-bebc-f04feb597084 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:55:55.771010 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7f8154-6de8-4d84-8a07-ed4bd0ce7cca service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd516d0755be84b7293156625df1b13b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:55:55.771621 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f8154-6de8-4d84-8a07-ed4bd0ce7cca service glance] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:55:55.771903 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f8154-6de8-4d84-8a07-ed4bd0ce7cca service glance] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:55:55.772176 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f8154-6de8-4d84-8a07-ed4bd0ce7cca service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:55:55.773947 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-0d7f8154-6de8-4d84-8a07-ed4bd0ce7cca service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:55:55.830492 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:55:55.884921 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7f8154-6de8-4d84-8a07-ed4bd0ce7cca service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:55:55.886629 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7f8154-6de8-4d84-8a07-ed4bd0ce7cca service glance] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:55:55.905087 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 738/1475] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 11:55:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 11:55:58.330909 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7686ac02-a9b4-48d5-a583-8ec8464b5456 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:55:58.331507 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7686ac02-a9b4-48d5-a583-8ec8464b5456 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:55:58.331507 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7686ac02-a9b4-48d5-a583-8ec8464b5456 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:55:58.332871 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 738/1476] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:55:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:55:58.339287 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47868974-e048-4952-a94d-5ce47a61d0ab None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:55:58.339752 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47868974-e048-4952-a94d-5ce47a61d0ab None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:55:58.339868 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47868974-e048-4952-a94d-5ce47a61d0ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:55:58.421865 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-47868974-e048-4952-a94d-5ce47a61d0ab None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:55:58.423090 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-47868974-e048-4952-a94d-5ce47a61d0ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:55:58.540078 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 739/1477] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:55:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 11:55:58.825118 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7686ac02-a9b4-48d5-a583-8ec8464b5456 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:55:58.826657 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-7686ac02-a9b4-48d5-a583-8ec8464b5456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:55:58.968486 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7686ac02-a9b4-48d5-a583-8ec8464b5456 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:55:59.017561 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:55:59.061735 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a785d359-c775-4d12-a669-468310981267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:55:59.062337 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a785d359-c775-4d12-a669-468310981267 admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:55:59.062610 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a785d359-c775-4d12-a669-468310981267 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:55:59.062875 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a785d359-c775-4d12-a669-468310981267 admin admin] PATH_INFO: `/v3/projects` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:55:59.063500 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a785d359-c775-4d12-a669-468310981267 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:55:59.065294 dv-cinder-860212-2-smb devstack@keystone.service[98475]: WARNING py.warnings [None req-a785d359-c775-4d12-a669-468310981267 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 11:55:59.065294 dv-cinder-860212-2-smb devstack@keystone.service[98475]: warnings.warn(msg) Oct 04 11:55:59.065294 dv-cinder-860212-2-smb devstack@keystone.service[98475]: Oct 04 11:55:59.066421 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a785d359-c775-4d12-a669-468310981267 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:55:59.085581 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 739/1478] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Oct 4 11:55:58 2022] GET /identity/v3/projects => generated 2553 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 11:56:01.405666 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888ed107-5f92-4f33-bf06-e999363402f3 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:56:01.406240 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888ed107-5f92-4f33-bf06-e999363402f3 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:56:01.406240 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888ed107-5f92-4f33-bf06-e999363402f3 None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:56:01.407554 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 740/1479] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:56:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:56:01.412826 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff87193-f1c0-4e04-864d-4458a4199685 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:56:01.413251 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff87193-f1c0-4e04-864d-4458a4199685 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:56:01.413358 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff87193-f1c0-4e04-864d-4458a4199685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:56:01.479711 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-9ff87193-f1c0-4e04-864d-4458a4199685 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:56:01.480938 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-9ff87193-f1c0-4e04-864d-4458a4199685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:56:01.580251 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 740/1480] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:56:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 11:56:01.887696 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888ed107-5f92-4f33-bf06-e999363402f3 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:56:01.889281 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-888ed107-5f92-4f33-bf06-e999363402f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:56:01.900306 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:56:02.037860 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888ed107-5f92-4f33-bf06-e999363402f3 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:56:02.121957 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:56:02.157922 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27816db-fff2-4aad-86d6-743248e1bd34 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8e23d1d2fe24bdf9552e7c2f0ae3424', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:56:02.162580 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27816db-fff2-4aad-86d6-743248e1bd34 service nova] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:56:02.162580 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27816db-fff2-4aad-86d6-743248e1bd34 service nova] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:56:02.162580 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27816db-fff2-4aad-86d6-743248e1bd34 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:56:02.162580 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-d27816db-fff2-4aad-86d6-743248e1bd34 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:56:02.250453 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27816db-fff2-4aad-86d6-743248e1bd34 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:56:02.252021 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27816db-fff2-4aad-86d6-743248e1bd34 service nova] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:56:02.270371 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 741/1481] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 11:56:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 11:56:04.929733 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0fb50f-9fc1-47ab-8728-cbbbae76e69f None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:56:04.929733 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0fb50f-9fc1-47ab-8728-cbbbae76e69f None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:56:04.929733 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0fb50f-9fc1-47ab-8728-cbbbae76e69f None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:56:04.931149 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 741/1482] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:56:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:56:04.936424 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41359397-4e5a-4d65-b6e9-e5bb055bf2b2 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:56:04.937018 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41359397-4e5a-4d65-b6e9-e5bb055bf2b2 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:56:04.937018 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41359397-4e5a-4d65-b6e9-e5bb055bf2b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:56:05.007036 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-41359397-4e5a-4d65-b6e9-e5bb055bf2b2 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:56:05.008345 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-41359397-4e5a-4d65-b6e9-e5bb055bf2b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:56:05.057150 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:56:05.108767 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 742/1483] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:56:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 11:56:05.457731 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0fb50f-9fc1-47ab-8728-cbbbae76e69f None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:56:05.459277 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-3c0fb50f-9fc1-47ab-8728-cbbbae76e69f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:56:05.484558 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:56:05.568765 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0fb50f-9fc1-47ab-8728-cbbbae76e69f None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:56:05.648224 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a8631a-5e94-42c9-8ee1-2fe5a5655e06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7289515c5c44914a19daa439de98cb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:56:05.649177 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a8631a-5e94-42c9-8ee1-2fe5a5655e06 service neutron] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:56:05.649439 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a8631a-5e94-42c9-8ee1-2fe5a5655e06 service neutron] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:56:05.649721 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a8631a-5e94-42c9-8ee1-2fe5a5655e06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:56:05.651303 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-d3a8631a-5e94-42c9-8ee1-2fe5a5655e06 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:56:05.724368 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:56:05.760671 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a8631a-5e94-42c9-8ee1-2fe5a5655e06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:56:05.762175 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a8631a-5e94-42c9-8ee1-2fe5a5655e06 service neutron] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:56:05.781085 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 742/1484] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 11:56:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 11:56:08.333171 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982a700a-2cce-4497-8670-1ecf0c706b1d None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:56:08.333773 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982a700a-2cce-4497-8670-1ecf0c706b1d None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:56:08.333773 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982a700a-2cce-4497-8670-1ecf0c706b1d None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:56:08.335156 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 743/1485] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:56:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:56:08.343245 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8585512e-7878-414a-9cc7-722762093d11 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:56:08.343680 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8585512e-7878-414a-9cc7-722762093d11 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:56:08.343783 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8585512e-7878-414a-9cc7-722762093d11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:56:08.413679 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-8585512e-7878-414a-9cc7-722762093d11 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:56:08.414883 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-8585512e-7878-414a-9cc7-722762093d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:56:08.526669 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 743/1486] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:56:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 11:56:08.875101 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982a700a-2cce-4497-8670-1ecf0c706b1d None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:56:08.876841 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-982a700a-2cce-4497-8670-1ecf0c706b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:56:08.999954 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982a700a-2cce-4497-8670-1ecf0c706b1d None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:56:09.091220 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:56:09.092530 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1615ce1e-9824-4977-b9d7-2de79d3df9d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7289515c5c44914a19daa439de98cb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:56:09.093223 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1615ce1e-9824-4977-b9d7-2de79d3df9d3 service neutron] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:56:09.093505 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1615ce1e-9824-4977-b9d7-2de79d3df9d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:56:09.093777 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1615ce1e-9824-4977-b9d7-2de79d3df9d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:56:09.095393 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-1615ce1e-9824-4977-b9d7-2de79d3df9d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:56:09.214057 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1615ce1e-9824-4977-b9d7-2de79d3df9d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:56:09.215488 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1615ce1e-9824-4977-b9d7-2de79d3df9d3 service neutron] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:56:09.234285 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 744/1487] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 11:56:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 11:56:11.501422 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0d679d-4240-4ded-8e95-33b0b040aa6e None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:56:11.502005 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0d679d-4240-4ded-8e95-33b0b040aa6e None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:56:11.502005 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0d679d-4240-4ded-8e95-33b0b040aa6e None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:56:11.503312 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 744/1488] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:56:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:56:11.510087 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f5ace7-19df-49ed-b8c0-dee798884e89 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:56:11.510549 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f5ace7-19df-49ed-b8c0-dee798884e89 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:56:11.510659 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f5ace7-19df-49ed-b8c0-dee798884e89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:56:11.578370 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-95f5ace7-19df-49ed-b8c0-dee798884e89 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:56:11.579576 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-95f5ace7-19df-49ed-b8c0-dee798884e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:56:11.634501 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:56:11.683936 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 745/1489] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:56:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 11:56:11.976736 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0d679d-4240-4ded-8e95-33b0b040aa6e None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:56:11.978377 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-dd0d679d-4240-4ded-8e95-33b0b040aa6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:56:12.015899 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:56:12.092991 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0d679d-4240-4ded-8e95-33b0b040aa6e None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:56:12.177814 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3192ad5c-3091-413f-8d22-5e6abaacb41a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7289515c5c44914a19daa439de98cb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:56:12.178342 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3192ad5c-3091-413f-8d22-5e6abaacb41a service neutron] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:56:12.178716 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3192ad5c-3091-413f-8d22-5e6abaacb41a service neutron] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:56:12.178989 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3192ad5c-3091-413f-8d22-5e6abaacb41a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:56:12.180620 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-3192ad5c-3091-413f-8d22-5e6abaacb41a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:56:12.263408 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:56:12.293097 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3192ad5c-3091-413f-8d22-5e6abaacb41a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:56:12.294582 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3192ad5c-3091-413f-8d22-5e6abaacb41a service neutron] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:56:12.313544 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 745/1490] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 11:56:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 11:56:14.908949 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f0a7f5-af21-41f1-9f85-ab37a21c395d None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:56:14.909488 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f0a7f5-af21-41f1-9f85-ab37a21c395d None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:56:14.909488 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f0a7f5-af21-41f1-9f85-ab37a21c395d None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:56:14.910765 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 746/1491] 10.222.0.59 () {54 vars in 927 bytes} [Tue Oct 4 11:56:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:56:14.917025 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f70e080-5751-484d-a56f-ed7660256320 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:56:14.917533 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f70e080-5751-484d-a56f-ed7660256320 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:56:14.917637 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f70e080-5751-484d-a56f-ed7660256320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:56:14.984030 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-6f70e080-5751-484d-a56f-ed7660256320 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:56:14.985278 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-6f70e080-5751-484d-a56f-ed7660256320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:56:15.086607 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 746/1492] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Oct 4 11:56:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 11:56:15.387473 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f0a7f5-af21-41f1-9f85-ab37a21c395d None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:56:15.389044 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-d0f0a7f5-af21-41f1-9f85-ab37a21c395d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:56:15.494182 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f0a7f5-af21-41f1-9f85-ab37a21c395d None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:56:15.570162 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d361e0c-cc2f-43c6-842c-9206a2dd90f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7289515c5c44914a19daa439de98cb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:56:15.575762 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d361e0c-cc2f-43c6-842c-9206a2dd90f5 service neutron] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:56:15.575762 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d361e0c-cc2f-43c6-842c-9206a2dd90f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:56:15.575762 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d361e0c-cc2f-43c6-842c-9206a2dd90f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:56:15.575762 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-0d361e0c-cc2f-43c6-842c-9206a2dd90f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:56:15.582448 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:56:15.686812 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d361e0c-cc2f-43c6-842c-9206a2dd90f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:56:15.688164 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d361e0c-cc2f-43c6-842c-9206a2dd90f5 service neutron] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:56:15.706937 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 747/1493] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 11:56:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 11:56:25.085060 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=82 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:56:25.704632 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=50 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:57:40.832637 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd91c448-9bc8-40cd-a06f-237baba4ffb5 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:57:40.833148 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd91c448-9bc8-40cd-a06f-237baba4ffb5 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:57:40.833256 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd91c448-9bc8-40cd-a06f-237baba4ffb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:57:40.909213 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-bd91c448-9bc8-40cd-a06f-237baba4ffb5 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:57:40.910454 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-bd91c448-9bc8-40cd-a06f-237baba4ffb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:57:41.006655 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 747/1494] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 11:57:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 11:57:41.014696 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c1b078-e5f7-4345-a065-5a1f76b478db None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:57:41.015248 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c1b078-e5f7-4345-a065-5a1f76b478db None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:57:41.015361 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c1b078-e5f7-4345-a065-5a1f76b478db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:57:41.092704 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-a3c1b078-e5f7-4345-a065-5a1f76b478db None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:57:41.093821 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-a3c1b078-e5f7-4345-a065-5a1f76b478db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:57:41.192569 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 748/1495] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 11:57:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 11:57:41.197302 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd91c448-9bc8-40cd-a06f-237baba4ffb5 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:57:41.198529 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-bd91c448-9bc8-40cd-a06f-237baba4ffb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:57:41.210332 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd91c448-9bc8-40cd-a06f-237baba4ffb5 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:57:41.277107 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:57:41.311079 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a34d91-5c8e-46af-bd9b-5da44f435c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:57:41.311682 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a34d91-5c8e-46af-bd9b-5da44f435c90 admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:57:41.311960 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a34d91-5c8e-46af-bd9b-5da44f435c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:57:41.312229 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a34d91-5c8e-46af-bd9b-5da44f435c90 admin admin] PATH_INFO: `/v3/domains` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:57:41.312987 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a34d91-5c8e-46af-bd9b-5da44f435c90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 11:57:41.313288 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a34d91-5c8e-46af-bd9b-5da44f435c90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:57:41.314307 dv-cinder-860212-2-smb devstack@keystone.service[98475]: WARNING py.warnings [None req-a4a34d91-5c8e-46af-bd9b-5da44f435c90 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 04 11:57:41.314307 dv-cinder-860212-2-smb devstack@keystone.service[98475]: warnings.warn(msg) Oct 04 11:57:41.314307 dv-cinder-860212-2-smb devstack@keystone.service[98475]: Oct 04 11:57:41.315905 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a34d91-5c8e-46af-bd9b-5da44f435c90 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:57:41.327055 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 748/1496] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Oct 4 11:57:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:57:41.337648 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c1b078-e5f7-4345-a065-5a1f76b478db None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:57:41.350641 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c1b078-e5f7-4345-a065-5a1f76b478db None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:57:41.416851 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:57:41.452428 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76272ea7-3cb9-4eef-b85d-fc58fbd1583d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:57:41.453072 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76272ea7-3cb9-4eef-b85d-fc58fbd1583d admin admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:57:41.453345 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76272ea7-3cb9-4eef-b85d-fc58fbd1583d admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:57:41.453608 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76272ea7-3cb9-4eef-b85d-fc58fbd1583d admin admin] PATH_INFO: `/v3/projects` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:57:41.454224 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76272ea7-3cb9-4eef-b85d-fc58fbd1583d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:57:41.456508 dv-cinder-860212-2-smb devstack@keystone.service[98474]: WARNING py.warnings [None req-76272ea7-3cb9-4eef-b85d-fc58fbd1583d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 11:57:41.456508 dv-cinder-860212-2-smb devstack@keystone.service[98474]: warnings.warn(msg) Oct 04 11:57:41.456508 dv-cinder-860212-2-smb devstack@keystone.service[98474]: Oct 04 11:57:41.457713 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76272ea7-3cb9-4eef-b85d-fc58fbd1583d admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:57:41.623623 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 749/1497] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Oct 4 11:57:41 2022] POST /identity/v3/projects => generated 375 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 11:57:41.624688 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a34d91-5c8e-46af-bd9b-5da44f435c90 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:57:41.626228 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-a4a34d91-5c8e-46af-bd9b-5da44f435c90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:57:41.661578 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a34d91-5c8e-46af-bd9b-5da44f435c90 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:57:41.762006 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9353a95-89d0-4d11-8d06-c998801760fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:57:41.762604 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9353a95-89d0-4d11-8d06-c998801760fc admin admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:57:41.762882 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9353a95-89d0-4d11-8d06-c998801760fc admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:57:41.763153 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9353a95-89d0-4d11-8d06-c998801760fc admin admin] PATH_INFO: `/v3/users` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:57:41.763771 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9353a95-89d0-4d11-8d06-c998801760fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:57:41.764809 dv-cinder-860212-2-smb devstack@keystone.service[98475]: WARNING py.warnings [None req-e9353a95-89d0-4d11-8d06-c998801760fc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 11:57:41.764809 dv-cinder-860212-2-smb devstack@keystone.service[98475]: warnings.warn(msg) Oct 04 11:57:41.764809 dv-cinder-860212-2-smb devstack@keystone.service[98475]: Oct 04 11:57:41.766007 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9353a95-89d0-4d11-8d06-c998801760fc admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:57:41.927386 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 749/1498] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Oct 4 11:57:41 2022] POST /identity/v3/users => generated 288 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 11:57:41.931579 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76272ea7-3cb9-4eef-b85d-fc58fbd1583d admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:57:41.933156 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-76272ea7-3cb9-4eef-b85d-fc58fbd1583d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:57:41.996973 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76272ea7-3cb9-4eef-b85d-fc58fbd1583d admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:57:42.087885 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:57:42.098892 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec14efda-6e1e-42a3-9bb8-c63377854d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:57:42.099503 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec14efda-6e1e-42a3-9bb8-c63377854d94 admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:57:42.099777 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec14efda-6e1e-42a3-9bb8-c63377854d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:57:42.100049 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec14efda-6e1e-42a3-9bb8-c63377854d94 admin admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:57:42.100715 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec14efda-6e1e-42a3-9bb8-c63377854d94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:57:42.101734 dv-cinder-860212-2-smb devstack@keystone.service[98474]: WARNING py.warnings [None req-ec14efda-6e1e-42a3-9bb8-c63377854d94 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 04 11:57:42.101734 dv-cinder-860212-2-smb devstack@keystone.service[98474]: warnings.warn(msg) Oct 04 11:57:42.101734 dv-cinder-860212-2-smb devstack@keystone.service[98474]: Oct 04 11:57:42.102620 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec14efda-6e1e-42a3-9bb8-c63377854d94 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:57:42.116490 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 750/1499] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 11:57:41 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 11:57:42.120903 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9353a95-89d0-4d11-8d06-c998801760fc admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:57:42.122382 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-e9353a95-89d0-4d11-8d06-c998801760fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:57:42.134175 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9353a95-89d0-4d11-8d06-c998801760fc admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:57:42.161806 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:57:42.235679 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39b3d4a-8cba-420a-b40c-0624bd3db344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:57:42.236263 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b3d4a-8cba-420a-b40c-0624bd3db344 admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:57:42.237124 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b3d4a-8cba-420a-b40c-0624bd3db344 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:57:42.237421 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b3d4a-8cba-420a-b40c-0624bd3db344 admin admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:57:42.238105 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39b3d4a-8cba-420a-b40c-0624bd3db344 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:57:42.239119 dv-cinder-860212-2-smb devstack@keystone.service[98475]: WARNING py.warnings [None req-b39b3d4a-8cba-420a-b40c-0624bd3db344 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 04 11:57:42.239119 dv-cinder-860212-2-smb devstack@keystone.service[98475]: warnings.warn(msg) Oct 04 11:57:42.239119 dv-cinder-860212-2-smb devstack@keystone.service[98475]: Oct 04 11:57:42.240001 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39b3d4a-8cba-420a-b40c-0624bd3db344 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:57:42.253343 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 750/1500] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 11:57:42 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 11:57:42.257677 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec14efda-6e1e-42a3-9bb8-c63377854d94 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:57:42.259200 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-ec14efda-6e1e-42a3-9bb8-c63377854d94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:57:42.293836 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec14efda-6e1e-42a3-9bb8-c63377854d94 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:57:42.388331 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e058f3-5876-427f-b35f-0f32dff79afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:57:42.389112 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e058f3-5876-427f-b35f-0f32dff79afb admin admin] REQUEST_METHOD: `PUT` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:57:42.389392 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e058f3-5876-427f-b35f-0f32dff79afb admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:57:42.389658 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e058f3-5876-427f-b35f-0f32dff79afb admin admin] PATH_INFO: `/v3/projects/4894e134dd834a22b5d91afd4d453960/users/afe267249c184e039dc5c20eb54be892/roles/ab4307f3b7994c1c80036fa7db93b6b9` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:57:42.413836 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e058f3-5876-427f-b35f-0f32dff79afb admin admin] RBAC: Authorizing `identity:create_grant(project_id=4894e134dd834a22b5d91afd4d453960, user_id=afe267249c184e039dc5c20eb54be892, role_id=ab4307f3b7994c1c80036fa7db93b6b9)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:57:42.414782 dv-cinder-860212-2-smb devstack@keystone.service[98474]: WARNING py.warnings [None req-41e058f3-5876-427f-b35f-0f32dff79afb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 11:57:42.414782 dv-cinder-860212-2-smb devstack@keystone.service[98474]: warnings.warn(msg) Oct 04 11:57:42.414782 dv-cinder-860212-2-smb devstack@keystone.service[98474]: Oct 04 11:57:42.416775 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e058f3-5876-427f-b35f-0f32dff79afb admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:57:42.653720 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 751/1501] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Oct 4 11:57:42 2022] PUT /identity/v3/projects/4894e134dd834a22b5d91afd4d453960/users/afe267249c184e039dc5c20eb54be892/roles/ab4307f3b7994c1c80036fa7db93b6b9 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 11:57:42.666059 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e4c793-2721-4497-a2d8-70d06a990b43 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:57:42.666365 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e4c793-2721-4497-a2d8-70d06a990b43 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:57:42.666636 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e4c793-2721-4497-a2d8-70d06a990b43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:57:42.724092 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-80e4c793-2721-4497-a2d8-70d06a990b43 None None] MFA Rules not processed for user `afe267249c184e039dc5c20eb54be892`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:57:42.725441 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-80e4c793-2721-4497-a2d8-70d06a990b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:57:42.812793 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 751/1502] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 11:57:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 11:57:42.826616 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa5bebc-b90f-422f-a347-ee62618852c7 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:57:42.826906 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa5bebc-b90f-422f-a347-ee62618852c7 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:57:42.827186 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa5bebc-b90f-422f-a347-ee62618852c7 None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:57:42.828511 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 752/1503] 10.222.0.59 () {54 vars in 963 bytes} [Tue Oct 4 11:57:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:57:42.834011 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8de86e0-b141-4129-9977-db60f1a71d24 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:57:42.834302 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8de86e0-b141-4129-9977-db60f1a71d24 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:57:42.834574 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8de86e0-b141-4129-9977-db60f1a71d24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:57:42.867381 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:57:42.913771 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-e8de86e0-b141-4129-9977-db60f1a71d24 None None] MFA Rules not processed for user `6e2a05b782424ab2928b5864f1bfd556`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:57:42.914978 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-e8de86e0-b141-4129-9977-db60f1a71d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:57:42.992487 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 752/1504] 10.222.0.59 () {58 vars in 1060 bytes} [Tue Oct 4 11:57:42 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 11:57:43.000294 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa5bebc-b90f-422f-a347-ee62618852c7 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:57:43.002017 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-0aa5bebc-b90f-422f-a347-ee62618852c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:57:43.052047 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:57:43.104440 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa5bebc-b90f-422f-a347-ee62618852c7 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:57:43.177364 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b45d49b-606e-4a0a-b36c-b4172e956996 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e2a05b782424ab2928b5864f1bfd556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:57:43.177960 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b45d49b-606e-4a0a-b36c-b4172e956996 service cinder] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:57:43.178242 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b45d49b-606e-4a0a-b36c-b4172e956996 service cinder] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:57:43.178509 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b45d49b-606e-4a0a-b36c-b4172e956996 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:57:43.180094 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-4b45d49b-606e-4a0a-b36c-b4172e956996 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:57:43.283852 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b45d49b-606e-4a0a-b36c-b4172e956996 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:57:43.285081 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b45d49b-606e-4a0a-b36c-b4172e956996 service cinder] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:57:43.288438 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:57:43.303072 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 753/1505] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 11:57:42 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 11:57:43.349004 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde491b7-e1e3-422b-8d33-4ba92ca87ace None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:57:43.349289 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde491b7-e1e3-422b-8d33-4ba92ca87ace None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:57:43.349563 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde491b7-e1e3-422b-8d33-4ba92ca87ace None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:57:43.350806 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 753/1506] 10.222.0.59 () {52 vars in 830 bytes} [Tue Oct 4 11:57:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:57:43.354457 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b45d49b-606e-4a0a-b36c-b4172e956996 service cinder] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:57:43.355727 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-4b45d49b-606e-4a0a-b36c-b4172e956996 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:57:43.459120 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b45d49b-606e-4a0a-b36c-b4172e956996 service cinder] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:57:43.553439 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf00675-c92b-4a97-97ff-ef914eec7f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:57:43.554002 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf00675-c92b-4a97-97ff-ef914eec7f65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:57:43.554280 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf00675-c92b-4a97-97ff-ef914eec7f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:57:43.554605 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf00675-c92b-4a97-97ff-ef914eec7f65 admin admin] PATH_INFO: `/v3/users/afe267249c184e039dc5c20eb54be892` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:57:43.570130 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf00675-c92b-4a97-97ff-ef914eec7f65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=afe267249c184e039dc5c20eb54be892)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:57:43.571159 dv-cinder-860212-2-smb devstack@keystone.service[98474]: WARNING py.warnings [None req-cbf00675-c92b-4a97-97ff-ef914eec7f65 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 11:57:43.571159 dv-cinder-860212-2-smb devstack@keystone.service[98474]: warnings.warn(msg) Oct 04 11:57:43.571159 dv-cinder-860212-2-smb devstack@keystone.service[98474]: Oct 04 11:57:43.572368 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf00675-c92b-4a97-97ff-ef914eec7f65 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:57:43.582373 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:57:43.862333 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-cbf00675-c92b-4a97-97ff-ef914eec7f65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afe267249c184e039dc5c20eb54be892'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 11:57:43.876845 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-cbf00675-c92b-4a97-97ff-ef914eec7f65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afe267249c184e039dc5c20eb54be892'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 11:57:43.877406 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-cbf00675-c92b-4a97-97ff-ef914eec7f65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afe267249c184e039dc5c20eb54be892'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 11:57:43.877821 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-cbf00675-c92b-4a97-97ff-ef914eec7f65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afe267249c184e039dc5c20eb54be892'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 11:57:43.942509 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-cbf00675-c92b-4a97-97ff-ef914eec7f65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afe267249c184e039dc5c20eb54be892'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 11:57:43.973038 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 754/1507] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Oct 4 11:57:43 2022] DELETE /identity/v3/users/afe267249c184e039dc5c20eb54be892 => generated 0 bytes in 619 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 11:57:43.977542 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37b96aa-2700-4dad-8658-4bfea97e41c2 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:57:43.977834 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37b96aa-2700-4dad-8658-4bfea97e41c2 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:57:43.981561 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37b96aa-2700-4dad-8658-4bfea97e41c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:57:44.039801 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-b37b96aa-2700-4dad-8658-4bfea97e41c2 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:57:44.041059 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-b37b96aa-2700-4dad-8658-4bfea97e41c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:57:44.133565 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:57:44.146826 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 754/1508] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 11:57:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 11:57:44.156555 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf00675-c92b-4a97-97ff-ef914eec7f65 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:57:44.157828 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-cbf00675-c92b-4a97-97ff-ef914eec7f65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:57:44.268263 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf00675-c92b-4a97-97ff-ef914eec7f65 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:57:44.322515 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:57:44.341725 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00b608c-4081-44d8-a8ec-a883f0ba2e35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7289515c5c44914a19daa439de98cb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:57:44.342341 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00b608c-4081-44d8-a8ec-a883f0ba2e35 service neutron] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:57:44.342623 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00b608c-4081-44d8-a8ec-a883f0ba2e35 service neutron] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:57:44.342897 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00b608c-4081-44d8-a8ec-a883f0ba2e35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:57:44.344507 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-b00b608c-4081-44d8-a8ec-a883f0ba2e35 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:57:44.459024 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00b608c-4081-44d8-a8ec-a883f0ba2e35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:57:44.460257 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00b608c-4081-44d8-a8ec-a883f0ba2e35 service neutron] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:57:44.485608 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 755/1509] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 11:57:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 11:57:45.020072 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37b96aa-2700-4dad-8658-4bfea97e41c2 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:57:45.021433 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-b37b96aa-2700-4dad-8658-4bfea97e41c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:57:45.032762 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37b96aa-2700-4dad-8658-4bfea97e41c2 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:57:45.134982 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5831cdc-6093-4d8c-87cd-bd2c846299f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:57:45.135685 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5831cdc-6093-4d8c-87cd-bd2c846299f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:57:45.135900 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5831cdc-6093-4d8c-87cd-bd2c846299f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:57:45.136168 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5831cdc-6093-4d8c-87cd-bd2c846299f6 admin admin] PATH_INFO: `/v3/projects/4894e134dd834a22b5d91afd4d453960` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:57:45.148496 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5831cdc-6093-4d8c-87cd-bd2c846299f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4894e134dd834a22b5d91afd4d453960)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:57:45.149549 dv-cinder-860212-2-smb devstack@keystone.service[98475]: WARNING py.warnings [None req-a5831cdc-6093-4d8c-87cd-bd2c846299f6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 11:57:45.149549 dv-cinder-860212-2-smb devstack@keystone.service[98475]: warnings.warn(msg) Oct 04 11:57:45.149549 dv-cinder-860212-2-smb devstack@keystone.service[98475]: Oct 04 11:57:45.150726 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5831cdc-6093-4d8c-87cd-bd2c846299f6 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:57:45.342554 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-a5831cdc-6093-4d8c-87cd-bd2c846299f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4894e134dd834a22b5d91afd4d453960', 'request_id': 'req-a5831cdc-6093-4d8c-87cd-bd2c846299f6'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 11:57:45.462079 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-a5831cdc-6093-4d8c-87cd-bd2c846299f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4894e134dd834a22b5d91afd4d453960', 'request_id': 'req-a5831cdc-6093-4d8c-87cd-bd2c846299f6'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 11:57:45.476392 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-a5831cdc-6093-4d8c-87cd-bd2c846299f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4894e134dd834a22b5d91afd4d453960', 'request_id': 'req-a5831cdc-6093-4d8c-87cd-bd2c846299f6'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 11:57:45.500442 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-a5831cdc-6093-4d8c-87cd-bd2c846299f6 admin admin] The token cache is being invalidate because project 4894e134dd834a22b5d91afd4d453960 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 11:57:45.500765 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-a5831cdc-6093-4d8c-87cd-bd2c846299f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 11:57:45.501198 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-a5831cdc-6093-4d8c-87cd-bd2c846299f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 11:57:45.503355 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 755/1510] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Oct 4 11:57:45 2022] DELETE /identity/v3/projects/4894e134dd834a22b5d91afd4d453960 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 11:57:54.482739 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=62 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:57:55.498325 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:59:19.277660 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e336ee-5894-4b22-9bd6-ea3a2db65cc2 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:59:19.278259 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e336ee-5894-4b22-9bd6-ea3a2db65cc2 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:59:19.278259 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e336ee-5894-4b22-9bd6-ea3a2db65cc2 None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:59:19.279801 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 756/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 4 11:59:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:59:19.284827 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66506a3c-db47-48e4-8cd8-8eb5ad94c746 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:59:19.285290 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66506a3c-db47-48e4-8cd8-8eb5ad94c746 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:59:19.285426 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66506a3c-db47-48e4-8cd8-8eb5ad94c746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:59:19.366594 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-66506a3c-db47-48e4-8cd8-8eb5ad94c746 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:59:19.367801 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-66506a3c-db47-48e4-8cd8-8eb5ad94c746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:59:19.472427 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 756/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 4 11:59:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 11:59:19.629899 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e336ee-5894-4b22-9bd6-ea3a2db65cc2 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:59:19.631997 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-c0e336ee-5894-4b22-9bd6-ea3a2db65cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:59:19.762127 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e336ee-5894-4b22-9bd6-ea3a2db65cc2 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:59:19.767581 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570ead66-1b74-4653-9786-313f484b0b4a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8e23d1d2fe24bdf9552e7c2f0ae3424', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:59:19.768193 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570ead66-1b74-4653-9786-313f484b0b4a service nova] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:59:19.768474 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570ead66-1b74-4653-9786-313f484b0b4a service nova] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:59:19.768785 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570ead66-1b74-4653-9786-313f484b0b4a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:59:19.776807 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570ead66-1b74-4653-9786-313f484b0b4a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:59:19.779046 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570ead66-1b74-4653-9786-313f484b0b4a service nova] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:59:19.788257 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 757/1513] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 11:59:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 11:59:20.890692 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52abf4ad-90cc-456f-9eef-773acbd92cb2 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:59:20.891241 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52abf4ad-90cc-456f-9eef-773acbd92cb2 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:59:20.891241 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52abf4ad-90cc-456f-9eef-773acbd92cb2 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:59:20.892591 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 757/1514] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 4 11:59:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:59:20.899175 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5f7787-ec89-4d79-b66d-17b0248fbc8d None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:59:20.899622 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5f7787-ec89-4d79-b66d-17b0248fbc8d None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:59:20.899733 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5f7787-ec89-4d79-b66d-17b0248fbc8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:59:20.920209 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-ff5f7787-ec89-4d79-b66d-17b0248fbc8d None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:59:20.921515 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-ff5f7787-ec89-4d79-b66d-17b0248fbc8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:59:20.929452 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 758/1515] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 4 11:59:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 11:59:21.087036 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52abf4ad-90cc-456f-9eef-773acbd92cb2 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:59:21.101473 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52abf4ad-90cc-456f-9eef-773acbd92cb2 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:59:21.107652 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4918b7ad-6dc8-48d6-b155-0efb8fa629dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8e23d1d2fe24bdf9552e7c2f0ae3424', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:59:21.108258 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4918b7ad-6dc8-48d6-b155-0efb8fa629dd service nova] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:59:21.108540 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4918b7ad-6dc8-48d6-b155-0efb8fa629dd service nova] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:59:21.108846 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4918b7ad-6dc8-48d6-b155-0efb8fa629dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:59:21.117415 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4918b7ad-6dc8-48d6-b155-0efb8fa629dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:59:21.118950 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4918b7ad-6dc8-48d6-b155-0efb8fa629dd service nova] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:59:21.129296 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 758/1516] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 11:59:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 11:59:21.244985 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cca608-9567-481a-a204-dc849ffb622b None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:59:21.245295 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cca608-9567-481a-a204-dc849ffb622b None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:59:21.245573 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cca608-9567-481a-a204-dc849ffb622b None None] PATH_INFO: `/v3` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:59:21.248189 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 759/1517] 10.222.0.13 () {54 vars in 925 bytes} [Tue Oct 4 11:59:21 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 11:59:21.253506 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb624ef-c435-4f98-ac22-22c7cec6fd82 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:59:21.253790 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb624ef-c435-4f98-ac22-22c7cec6fd82 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:59:21.254062 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb624ef-c435-4f98-ac22-22c7cec6fd82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:59:21.321723 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-2cb624ef-c435-4f98-ac22-22c7cec6fd82 None None] MFA Rules not processed for user `be119968b02440adbbbc85c553077b92`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:59:21.322939 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-2cb624ef-c435-4f98-ac22-22c7cec6fd82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:59:21.347481 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:59:21.405912 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 759/1518] 10.222.0.13 () {58 vars in 1015 bytes} [Tue Oct 4 11:59:21 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 11:59:25.174911 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73bb86b-c793-4301-81b5-2ff8786eaa47 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:59:25.175364 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73bb86b-c793-4301-81b5-2ff8786eaa47 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:59:25.175468 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73bb86b-c793-4301-81b5-2ff8786eaa47 None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:59:25.176848 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 760/1519] 10.222.0.59 () {54 vars in 961 bytes} [Tue Oct 4 11:59:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:59:25.182004 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c045b4-8664-45c6-9cbb-3a9b3a0ae7c1 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:59:25.182440 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c045b4-8664-45c6-9cbb-3a9b3a0ae7c1 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:59:25.182549 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c045b4-8664-45c6-9cbb-3a9b3a0ae7c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:59:25.203360 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-31c045b4-8664-45c6-9cbb-3a9b3a0ae7c1 None None] MFA Rules not processed for user `be119968b02440adbbbc85c553077b92`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:59:25.204562 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-31c045b4-8664-45c6-9cbb-3a9b3a0ae7c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:59:25.213042 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 760/1520] 10.222.0.59 () {58 vars in 1058 bytes} [Tue Oct 4 11:59:25 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 11:59:25.223971 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73bb86b-c793-4301-81b5-2ff8786eaa47 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:59:25.237138 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73bb86b-c793-4301-81b5-2ff8786eaa47 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:59:25.242119 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a33519b-2be1-4c4c-b2ee-b2963174fec7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be119968b02440adbbbc85c553077b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:59:25.242720 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a33519b-2be1-4c4c-b2ee-b2963174fec7 service placement] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:59:25.243003 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a33519b-2be1-4c4c-b2ee-b2963174fec7 service placement] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:59:25.243280 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a33519b-2be1-4c4c-b2ee-b2963174fec7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:59:25.252204 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a33519b-2be1-4c4c-b2ee-b2963174fec7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:59:25.254949 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a33519b-2be1-4c4c-b2ee-b2963174fec7 service placement] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:59:25.264050 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 761/1521] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 11:59:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 11:59:32.776287 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6c41ee-8bcb-4e05-aa58-8b5934e58844 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:59:32.776905 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6c41ee-8bcb-4e05-aa58-8b5934e58844 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:59:32.776905 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6c41ee-8bcb-4e05-aa58-8b5934e58844 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:59:32.778812 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 761/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 4 11:59:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:59:32.785676 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e181a52d-65c4-4ddb-b387-a0509f099562 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:59:32.786389 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e181a52d-65c4-4ddb-b387-a0509f099562 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:59:32.786526 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e181a52d-65c4-4ddb-b387-a0509f099562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:59:32.809073 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-e181a52d-65c4-4ddb-b387-a0509f099562 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:59:32.810483 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-e181a52d-65c4-4ddb-b387-a0509f099562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:59:32.821535 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 762/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 4 11:59:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 11:59:32.995162 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6c41ee-8bcb-4e05-aa58-8b5934e58844 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:59:33.010428 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6c41ee-8bcb-4e05-aa58-8b5934e58844 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:59:33.016923 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed565c4-0c3a-4d51-8724-087dc5342021 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8e23d1d2fe24bdf9552e7c2f0ae3424', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:59:33.017585 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed565c4-0c3a-4d51-8724-087dc5342021 service nova] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:59:33.017952 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed565c4-0c3a-4d51-8724-087dc5342021 service nova] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:59:33.018272 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed565c4-0c3a-4d51-8724-087dc5342021 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:59:33.028062 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed565c4-0c3a-4d51-8724-087dc5342021 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:59:33.029743 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed565c4-0c3a-4d51-8724-087dc5342021 service nova] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:59:33.039795 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 762/1524] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 11:59:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 11:59:34.171696 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9fda04-0d97-4e8e-99a0-5080ed7395b1 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:59:34.172335 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9fda04-0d97-4e8e-99a0-5080ed7395b1 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:59:34.172335 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9fda04-0d97-4e8e-99a0-5080ed7395b1 None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:59:34.173620 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 763/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 4 11:59:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:59:34.180187 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a375551-17d5-4d04-b71f-d58e57eace91 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:59:34.180950 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a375551-17d5-4d04-b71f-d58e57eace91 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:59:34.180950 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a375551-17d5-4d04-b71f-d58e57eace91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:59:34.203275 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-2a375551-17d5-4d04-b71f-d58e57eace91 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:59:34.204518 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-2a375551-17d5-4d04-b71f-d58e57eace91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:59:34.212578 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 763/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 4 11:59:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 11:59:34.369699 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9fda04-0d97-4e8e-99a0-5080ed7395b1 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:59:34.387256 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9fda04-0d97-4e8e-99a0-5080ed7395b1 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:59:34.393639 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62937502-4d12-4b6c-80b8-bfc1f4624707 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8e23d1d2fe24bdf9552e7c2f0ae3424', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:59:34.394274 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62937502-4d12-4b6c-80b8-bfc1f4624707 service nova] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:59:34.394659 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62937502-4d12-4b6c-80b8-bfc1f4624707 service nova] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:59:34.395159 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62937502-4d12-4b6c-80b8-bfc1f4624707 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:59:34.406827 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62937502-4d12-4b6c-80b8-bfc1f4624707 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:59:34.408412 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62937502-4d12-4b6c-80b8-bfc1f4624707 service nova] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:59:34.419731 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 764/1527] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 11:59:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 11:59:38.680821 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84245491-18f0-469a-ac29-6764670ffb1d None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:59:38.681394 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84245491-18f0-469a-ac29-6764670ffb1d None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:59:38.681394 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84245491-18f0-469a-ac29-6764670ffb1d None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:59:38.682783 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 764/1528] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 11:59:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:59:38.690847 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7913b5bd-79f0-434e-b817-fdb7a987e24b None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:59:38.691285 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7913b5bd-79f0-434e-b817-fdb7a987e24b None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:59:38.691398 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7913b5bd-79f0-434e-b817-fdb7a987e24b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:59:38.710901 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-7913b5bd-79f0-434e-b817-fdb7a987e24b None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:59:38.712114 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-7913b5bd-79f0-434e-b817-fdb7a987e24b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:59:38.721734 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 765/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 11:59:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 11:59:39.024292 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84245491-18f0-469a-ac29-6764670ffb1d None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:59:39.026060 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-84245491-18f0-469a-ac29-6764670ffb1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:59:39.106637 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84245491-18f0-469a-ac29-6764670ffb1d None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:59:39.110490 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1debb6e3-93e8-4a4e-a239-ffc33d4c5dda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7289515c5c44914a19daa439de98cb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:59:39.111090 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1debb6e3-93e8-4a4e-a239-ffc33d4c5dda service neutron] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:59:39.111367 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1debb6e3-93e8-4a4e-a239-ffc33d4c5dda service neutron] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:59:39.111638 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1debb6e3-93e8-4a4e-a239-ffc33d4c5dda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:59:39.120489 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1debb6e3-93e8-4a4e-a239-ffc33d4c5dda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:59:39.122591 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1debb6e3-93e8-4a4e-a239-ffc33d4c5dda service neutron] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:59:39.131779 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 765/1530] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 11:59:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 11:59:41.291372 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2f61de-a352-47ce-b083-74be6a416872 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:59:41.292283 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2f61de-a352-47ce-b083-74be6a416872 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:59:41.292283 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2f61de-a352-47ce-b083-74be6a416872 None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:59:41.293554 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 766/1531] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 11:59:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 11:59:41.299417 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8cb65b-847e-43fd-907f-e399f74ae3fa None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:59:41.299877 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8cb65b-847e-43fd-907f-e399f74ae3fa None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:59:41.299877 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8cb65b-847e-43fd-907f-e399f74ae3fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:59:41.319509 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-bb8cb65b-847e-43fd-907f-e399f74ae3fa None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:59:41.320713 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-bb8cb65b-847e-43fd-907f-e399f74ae3fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:59:41.329090 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 766/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 11:59:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 11:59:41.621665 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2f61de-a352-47ce-b083-74be6a416872 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:59:41.632432 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2f61de-a352-47ce-b083-74be6a416872 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:59:41.635908 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456665ed-f604-43e0-a16b-136924a42c50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7289515c5c44914a19daa439de98cb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:59:41.637119 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456665ed-f604-43e0-a16b-136924a42c50 service neutron] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:59:41.637400 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456665ed-f604-43e0-a16b-136924a42c50 service neutron] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:59:41.637681 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456665ed-f604-43e0-a16b-136924a42c50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:59:41.646320 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456665ed-f604-43e0-a16b-136924a42c50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:59:41.647735 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456665ed-f604-43e0-a16b-136924a42c50 service neutron] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:59:41.657576 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 767/1533] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 11:59:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 11:59:45.320847 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c343b1d-f576-431f-b017-b0d0113167d5 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:59:45.321421 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c343b1d-f576-431f-b017-b0d0113167d5 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:59:45.321421 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c343b1d-f576-431f-b017-b0d0113167d5 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:59:45.322738 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 767/1534] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 11:59:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:59:45.328573 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9845f5c7-044e-4958-bcf6-8778e699ff0b None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:59:45.329081 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9845f5c7-044e-4958-bcf6-8778e699ff0b None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:59:45.329192 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9845f5c7-044e-4958-bcf6-8778e699ff0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:59:45.337061 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=81 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:59:45.350062 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-9845f5c7-044e-4958-bcf6-8778e699ff0b None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:59:45.351473 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-9845f5c7-044e-4958-bcf6-8778e699ff0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:59:45.359811 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 768/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 11:59:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 11:59:45.668979 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c343b1d-f576-431f-b017-b0d0113167d5 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:59:45.670637 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-3c343b1d-f576-431f-b017-b0d0113167d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:59:45.735145 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:59:45.748635 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c343b1d-f576-431f-b017-b0d0113167d5 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:59:45.752165 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70deddc8-3318-46c3-8bec-1facf672bd98 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e2a05b782424ab2928b5864f1bfd556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:59:45.752797 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70deddc8-3318-46c3-8bec-1facf672bd98 service cinder] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:59:45.753103 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70deddc8-3318-46c3-8bec-1facf672bd98 service cinder] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:59:45.753378 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70deddc8-3318-46c3-8bec-1facf672bd98 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:59:45.762668 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70deddc8-3318-46c3-8bec-1facf672bd98 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:59:45.764085 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70deddc8-3318-46c3-8bec-1facf672bd98 service cinder] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:59:45.773303 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 768/1536] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 11:59:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 11:59:47.922199 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf829ca1-14bb-415f-8814-3e9199fb6dbb None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:59:47.922790 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf829ca1-14bb-415f-8814-3e9199fb6dbb None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:59:47.922790 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf829ca1-14bb-415f-8814-3e9199fb6dbb None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:59:47.924080 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 769/1537] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 11:59:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 11:59:47.929206 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82bbeea-45b8-4722-b35d-3f8149273455 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:59:47.929646 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82bbeea-45b8-4722-b35d-3f8149273455 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:59:47.929768 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82bbeea-45b8-4722-b35d-3f8149273455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:59:47.951107 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-d82bbeea-45b8-4722-b35d-3f8149273455 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 11:59:47.952299 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-d82bbeea-45b8-4722-b35d-3f8149273455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:59:47.960090 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 769/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 11:59:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 11:59:48.276286 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf829ca1-14bb-415f-8814-3e9199fb6dbb None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 11:59:48.277981 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-bf829ca1-14bb-415f-8814-3e9199fb6dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 11:59:48.290800 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf829ca1-14bb-415f-8814-3e9199fb6dbb None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 11:59:48.294800 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a45c34c-d557-4c2f-a40e-daf4b99f9057 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e2a05b782424ab2928b5864f1bfd556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 11:59:48.295397 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a45c34c-d557-4c2f-a40e-daf4b99f9057 service cinder] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 11:59:48.295678 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a45c34c-d557-4c2f-a40e-daf4b99f9057 service cinder] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 11:59:48.295950 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a45c34c-d557-4c2f-a40e-daf4b99f9057 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 11:59:48.304918 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a45c34c-d557-4c2f-a40e-daf4b99f9057 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 11:59:48.306323 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a45c34c-d557-4c2f-a40e-daf4b99f9057 service cinder] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 11:59:48.320551 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 770/1539] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 11:59:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 11:59:57.945332 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=11 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:59:58.315573 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=8 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:01:15.760922 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd7fbcf-1971-4685-a50d-112633ccb31c None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:15.762716 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd7fbcf-1971-4685-a50d-112633ccb31c None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:15.762716 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd7fbcf-1971-4685-a50d-112633ccb31c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:15.785067 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-dbd7fbcf-1971-4685-a50d-112633ccb31c None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:01:15.786651 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-dbd7fbcf-1971-4685-a50d-112633ccb31c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:01:15.801585 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 770/1540] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:01:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:01:15.823412 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21970e31-52b6-40ae-a587-d5be6445ff83 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:15.824112 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21970e31-52b6-40ae-a587-d5be6445ff83 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:15.824112 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21970e31-52b6-40ae-a587-d5be6445ff83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:15.842509 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3861b1e7-6bd4-4f01-a77c-3823243795b0 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:15.843182 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3861b1e7-6bd4-4f01-a77c-3823243795b0 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:15.843781 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3861b1e7-6bd4-4f01-a77c-3823243795b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:15.854140 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-21970e31-52b6-40ae-a587-d5be6445ff83 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:01:15.855396 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-21970e31-52b6-40ae-a587-d5be6445ff83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:01:15.884124 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-3861b1e7-6bd4-4f01-a77c-3823243795b0 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:01:15.884367 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 771/1541] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:01:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:01:15.885944 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-3861b1e7-6bd4-4f01-a77c-3823243795b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:01:15.889462 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21970e31-52b6-40ae-a587-d5be6445ff83 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:15.899361 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 771/1542] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:01:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:01:15.903931 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21970e31-52b6-40ae-a587-d5be6445ff83 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:15.916072 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfb1e11-1f88-4a0a-912e-0b21051ffbef None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:15.917080 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfb1e11-1f88-4a0a-912e-0b21051ffbef None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:15.918525 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfb1e11-1f88-4a0a-912e-0b21051ffbef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:15.935628 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc9f7ac-a785-4e84-9c0b-9b156d2a715f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:15.936327 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc9f7ac-a785-4e84-9c0b-9b156d2a715f admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:15.936628 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc9f7ac-a785-4e84-9c0b-9b156d2a715f admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:15.936919 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc9f7ac-a785-4e84-9c0b-9b156d2a715f admin admin] PATH_INFO: `/v3/domains` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:15.937605 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc9f7ac-a785-4e84-9c0b-9b156d2a715f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:01:15.937937 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc9f7ac-a785-4e84-9c0b-9b156d2a715f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:15.941127 dv-cinder-860212-2-smb devstack@keystone.service[98474]: WARNING py.warnings [None req-abc9f7ac-a785-4e84-9c0b-9b156d2a715f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 04 12:01:15.941127 dv-cinder-860212-2-smb devstack@keystone.service[98474]: warnings.warn(msg) Oct 04 12:01:15.941127 dv-cinder-860212-2-smb devstack@keystone.service[98474]: Oct 04 12:01:15.942107 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc9f7ac-a785-4e84-9c0b-9b156d2a715f admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:15.963302 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 772/1543] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Oct 4 12:01:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:01:15.963976 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-8bfb1e11-1f88-4a0a-912e-0b21051ffbef None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:01:15.965717 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-8bfb1e11-1f88-4a0a-912e-0b21051ffbef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:01:15.971195 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc9f7ac-a785-4e84-9c0b-9b156d2a715f admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:15.981496 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 772/1544] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:01:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 12:01:15.984507 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc9f7ac-a785-4e84-9c0b-9b156d2a715f admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:15.986263 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfb1e11-1f88-4a0a-912e-0b21051ffbef None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:16.000273 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57455ac6-c8d5-4ce5-90a7-599b976e7fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:16.001691 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57455ac6-c8d5-4ce5-90a7-599b976e7fc6 admin admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:16.001691 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57455ac6-c8d5-4ce5-90a7-599b976e7fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:16.001691 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57455ac6-c8d5-4ce5-90a7-599b976e7fc6 admin admin] PATH_INFO: `/v3/projects` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:16.010355 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfb1e11-1f88-4a0a-912e-0b21051ffbef None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:16.010464 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57455ac6-c8d5-4ce5-90a7-599b976e7fc6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:16.010464 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57455ac6-c8d5-4ce5-90a7-599b976e7fc6 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:16.014461 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b7ff32-ef1f-4887-af79-f91a7afc0d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:16.015532 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b7ff32-ef1f-4887-af79-f91a7afc0d3c admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:16.016094 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b7ff32-ef1f-4887-af79-f91a7afc0d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:16.016616 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b7ff32-ef1f-4887-af79-f91a7afc0d3c admin admin] PATH_INFO: `/v3/domains` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:16.017521 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b7ff32-ef1f-4887-af79-f91a7afc0d3c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:01:16.018045 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b7ff32-ef1f-4887-af79-f91a7afc0d3c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:16.020086 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b7ff32-ef1f-4887-af79-f91a7afc0d3c admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:16.065017 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 773/1545] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Oct 4 12:01:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 12:01:16.076267 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b7ff32-ef1f-4887-af79-f91a7afc0d3c admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:16.093407 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b7ff32-ef1f-4887-af79-f91a7afc0d3c admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:16.102141 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638ea988-8594-4468-be94-1a0d17514b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:16.103076 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638ea988-8594-4468-be94-1a0d17514b96 admin admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:16.103586 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638ea988-8594-4468-be94-1a0d17514b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:16.104061 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638ea988-8594-4468-be94-1a0d17514b96 admin admin] PATH_INFO: `/v3/projects` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:16.105636 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638ea988-8594-4468-be94-1a0d17514b96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:16.109170 dv-cinder-860212-2-smb devstack@keystone.service[98475]: WARNING py.warnings [None req-638ea988-8594-4468-be94-1a0d17514b96 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 12:01:16.109170 dv-cinder-860212-2-smb devstack@keystone.service[98475]: warnings.warn(msg) Oct 04 12:01:16.109170 dv-cinder-860212-2-smb devstack@keystone.service[98475]: Oct 04 12:01:16.111087 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638ea988-8594-4468-be94-1a0d17514b96 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:16.241790 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 773/1546] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Oct 4 12:01:15 2022] POST /identity/v3/projects => generated 365 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:01:16.243581 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ccfa5c-c676-4fd6-aa2b-99e3e2b67f0b None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:16.244208 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ccfa5c-c676-4fd6-aa2b-99e3e2b67f0b None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:16.244738 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ccfa5c-c676-4fd6-aa2b-99e3e2b67f0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:16.265880 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-f2ccfa5c-c676-4fd6-aa2b-99e3e2b67f0b None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:01:16.267405 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-f2ccfa5c-c676-4fd6-aa2b-99e3e2b67f0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:01:16.284637 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 774/1547] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Oct 4 12:01:16 2022] POST /identity/v3/projects => generated 385 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 12:01:16.285503 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e704f2-90c1-4a2b-b4d7-06a3fce670ab None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:16.285993 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e704f2-90c1-4a2b-b4d7-06a3fce670ab None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:16.286499 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e704f2-90c1-4a2b-b4d7-06a3fce670ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:16.316317 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-f4e704f2-90c1-4a2b-b4d7-06a3fce670ab None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:01:16.316317 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-f4e704f2-90c1-4a2b-b4d7-06a3fce670ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:01:16.338463 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 774/1548] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:01:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:01:16.345902 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba1a4ab-3061-4236-970d-fafc09db7aa5 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:16.345902 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba1a4ab-3061-4236-970d-fafc09db7aa5 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:16.345902 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba1a4ab-3061-4236-970d-fafc09db7aa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:16.363028 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-fba1a4ab-3061-4236-970d-fafc09db7aa5 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:01:16.364221 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-fba1a4ab-3061-4236-970d-fafc09db7aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:01:16.370801 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 775/1549] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:01:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:01:16.371619 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e704f2-90c1-4a2b-b4d7-06a3fce670ab None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:16.372577 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 775/1550] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:01:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:01:16.373741 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3297218a-8f74-4885-bda6-027c9c2bfc51 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:16.374026 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3297218a-8f74-4885-bda6-027c9c2bfc51 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:16.374610 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3297218a-8f74-4885-bda6-027c9c2bfc51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:16.387592 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e704f2-90c1-4a2b-b4d7-06a3fce670ab None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:16.392543 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de887e5-080b-4f7e-a6f3-868b573e3f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:16.393177 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de887e5-080b-4f7e-a6f3-868b573e3f06 admin admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:16.393457 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de887e5-080b-4f7e-a6f3-868b573e3f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:16.393728 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de887e5-080b-4f7e-a6f3-868b573e3f06 admin admin] PATH_INFO: `/v3/users` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:16.393842 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-3297218a-8f74-4885-bda6-027c9c2bfc51 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:01:16.394423 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de887e5-080b-4f7e-a6f3-868b573e3f06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:16.395025 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-3297218a-8f74-4885-bda6-027c9c2bfc51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:01:16.396349 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de887e5-080b-4f7e-a6f3-868b573e3f06 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:16.403711 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 776/1551] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:01:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:01:16.404915 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05fe6a6-7c83-4a25-8986-84044ae3dd55 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:16.405199 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05fe6a6-7c83-4a25-8986-84044ae3dd55 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:16.405468 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05fe6a6-7c83-4a25-8986-84044ae3dd55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:16.425379 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-a05fe6a6-7c83-4a25-8986-84044ae3dd55 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:01:16.426571 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-a05fe6a6-7c83-4a25-8986-84044ae3dd55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:01:16.434577 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 777/1552] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:01:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:01:16.435744 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c23f19-e1fe-42bb-b8fc-ecb728e8fbde None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:16.436029 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c23f19-e1fe-42bb-b8fc-ecb728e8fbde None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:16.436302 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c23f19-e1fe-42bb-b8fc-ecb728e8fbde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:16.455765 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-a6c23f19-e1fe-42bb-b8fc-ecb728e8fbde None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:01:16.456982 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-a6c23f19-e1fe-42bb-b8fc-ecb728e8fbde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:01:16.465521 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 778/1553] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:01:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:01:16.466256 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c23f19-e1fe-42bb-b8fc-ecb728e8fbde None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:16.476007 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c23f19-e1fe-42bb-b8fc-ecb728e8fbde None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:16.480667 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25a3259-fe64-4e9d-9bd8-afc2abbd16a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:16.482713 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25a3259-fe64-4e9d-9bd8-afc2abbd16a4 admin admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:16.482713 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25a3259-fe64-4e9d-9bd8-afc2abbd16a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:16.482713 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25a3259-fe64-4e9d-9bd8-afc2abbd16a4 admin admin] PATH_INFO: `/v3/users` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:16.482713 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25a3259-fe64-4e9d-9bd8-afc2abbd16a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:16.483477 dv-cinder-860212-2-smb devstack@keystone.service[98474]: WARNING py.warnings [None req-a25a3259-fe64-4e9d-9bd8-afc2abbd16a4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 12:01:16.483477 dv-cinder-860212-2-smb devstack@keystone.service[98474]: warnings.warn(msg) Oct 04 12:01:16.483477 dv-cinder-860212-2-smb devstack@keystone.service[98474]: Oct 04 12:01:16.485022 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25a3259-fe64-4e9d-9bd8-afc2abbd16a4 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:16.508322 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 776/1554] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Oct 4 12:01:16 2022] POST /identity/v3/users => generated 283 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:01:16.512763 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fdcd8a-7af3-4601-9cfd-906925371b7f None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:16.512763 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fdcd8a-7af3-4601-9cfd-906925371b7f None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:16.512763 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fdcd8a-7af3-4601-9cfd-906925371b7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:16.530862 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-92fdcd8a-7af3-4601-9cfd-906925371b7f None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:01:16.532047 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-92fdcd8a-7af3-4601-9cfd-906925371b7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:01:16.540556 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 777/1555] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:01:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:01:16.541730 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34982123-a055-40ab-a40d-84e4cada1caa None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:16.542008 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34982123-a055-40ab-a40d-84e4cada1caa None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:16.542278 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34982123-a055-40ab-a40d-84e4cada1caa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:16.560917 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-34982123-a055-40ab-a40d-84e4cada1caa None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:01:16.562077 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-34982123-a055-40ab-a40d-84e4cada1caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:01:16.571274 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 778/1556] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:01:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:01:16.572408 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbff36ef-80cc-4b09-a8b3-e32c300ecd57 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:16.572721 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbff36ef-80cc-4b09-a8b3-e32c300ecd57 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:16.572997 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbff36ef-80cc-4b09-a8b3-e32c300ecd57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:16.593257 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-cbff36ef-80cc-4b09-a8b3-e32c300ecd57 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:01:16.594444 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-cbff36ef-80cc-4b09-a8b3-e32c300ecd57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:01:16.598666 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 779/1557] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Oct 4 12:01:16 2022] POST /identity/v3/users => generated 293 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:01:16.600482 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a53a32-c908-496f-bd22-f8ca3f91c0f2 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:16.603300 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a53a32-c908-496f-bd22-f8ca3f91c0f2 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:16.603300 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a53a32-c908-496f-bd22-f8ca3f91c0f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:16.605906 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 779/1558] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:01:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:01:16.607131 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b5502f-1cc5-4b2d-8cf7-be115820c57b None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:16.607386 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b5502f-1cc5-4b2d-8cf7-be115820c57b None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:16.607654 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b5502f-1cc5-4b2d-8cf7-be115820c57b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:16.621788 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-f5a53a32-c908-496f-bd22-f8ca3f91c0f2 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:01:16.622990 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-f5a53a32-c908-496f-bd22-f8ca3f91c0f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:01:16.627550 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-36b5502f-1cc5-4b2d-8cf7-be115820c57b None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:01:16.628758 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-36b5502f-1cc5-4b2d-8cf7-be115820c57b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:01:16.631767 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 780/1559] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:01:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:01:16.632880 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856f1e7f-0425-45cc-b8f2-54f3edd1a6dc None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:16.633153 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856f1e7f-0425-45cc-b8f2-54f3edd1a6dc None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:16.633477 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856f1e7f-0425-45cc-b8f2-54f3edd1a6dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:16.637797 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 780/1560] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:01:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:01:16.638577 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b5502f-1cc5-4b2d-8cf7-be115820c57b None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:16.649005 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b5502f-1cc5-4b2d-8cf7-be115820c57b None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:16.653633 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcb4646-0742-4c53-9deb-2808368ddc79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:16.654229 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcb4646-0742-4c53-9deb-2808368ddc79 admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:16.654344 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-856f1e7f-0425-45cc-b8f2-54f3edd1a6dc None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:01:16.654508 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcb4646-0742-4c53-9deb-2808368ddc79 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:16.654782 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcb4646-0742-4c53-9deb-2808368ddc79 admin admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:16.655417 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcb4646-0742-4c53-9deb-2808368ddc79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:16.655523 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-856f1e7f-0425-45cc-b8f2-54f3edd1a6dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:01:16.657043 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcb4646-0742-4c53-9deb-2808368ddc79 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:16.663329 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 781/1561] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:01:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:01:16.664150 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856f1e7f-0425-45cc-b8f2-54f3edd1a6dc None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:16.667676 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 781/1562] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:01:16 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:01:16.668430 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcb4646-0742-4c53-9deb-2808368ddc79 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:16.675526 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856f1e7f-0425-45cc-b8f2-54f3edd1a6dc None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:16.678181 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcb4646-0742-4c53-9deb-2808368ddc79 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:16.680987 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c92568-3588-4fc2-958e-5a37bf94b984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:16.681668 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c92568-3588-4fc2-958e-5a37bf94b984 admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:16.682025 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c92568-3588-4fc2-958e-5a37bf94b984 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:16.682375 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c92568-3588-4fc2-958e-5a37bf94b984 admin admin] PATH_INFO: `/v3/domains` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:16.682706 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d39453-2ac9-4bfd-ac5c-63344ca30e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:16.683286 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d39453-2ac9-4bfd-ac5c-63344ca30e4c admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:16.683396 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c92568-3588-4fc2-958e-5a37bf94b984 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:01:16.683567 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d39453-2ac9-4bfd-ac5c-63344ca30e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:16.683787 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c92568-3588-4fc2-958e-5a37bf94b984 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:16.683899 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d39453-2ac9-4bfd-ac5c-63344ca30e4c admin admin] PATH_INFO: `/v3/domains` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:16.684456 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d39453-2ac9-4bfd-ac5c-63344ca30e4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:01:16.684783 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d39453-2ac9-4bfd-ac5c-63344ca30e4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:16.685678 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c92568-3588-4fc2-958e-5a37bf94b984 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:16.686349 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d39453-2ac9-4bfd-ac5c-63344ca30e4c admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:16.699673 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 782/1563] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Oct 4 12:01:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:01:16.707483 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 782/1564] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Oct 4 12:01:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:01:16.707658 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c92568-3588-4fc2-958e-5a37bf94b984 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:16.707759 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d39453-2ac9-4bfd-ac5c-63344ca30e4c admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:16.711606 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c92568-3588-4fc2-958e-5a37bf94b984 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:16.716151 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ff3b1e-b978-4422-a462-86563170047e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:16.716772 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ff3b1e-b978-4422-a462-86563170047e admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:16.717055 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ff3b1e-b978-4422-a462-86563170047e admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:16.717330 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ff3b1e-b978-4422-a462-86563170047e admin admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:16.717958 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ff3b1e-b978-4422-a462-86563170047e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:16.718067 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d39453-2ac9-4bfd-ac5c-63344ca30e4c admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:16.719549 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ff3b1e-b978-4422-a462-86563170047e admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:16.722732 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3140093c-0f93-41df-be56-aee620872b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:16.723327 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3140093c-0f93-41df-be56-aee620872b63 admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:16.723603 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3140093c-0f93-41df-be56-aee620872b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:16.723875 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3140093c-0f93-41df-be56-aee620872b63 admin admin] PATH_INFO: `/v3/domains` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:16.724507 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3140093c-0f93-41df-be56-aee620872b63 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:01:16.724873 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3140093c-0f93-41df-be56-aee620872b63 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:16.726534 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3140093c-0f93-41df-be56-aee620872b63 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:16.730070 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 783/1565] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:01:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:01:16.730867 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ff3b1e-b978-4422-a462-86563170047e admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:16.738896 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 783/1566] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Oct 4 12:01:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:01:16.739809 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3140093c-0f93-41df-be56-aee620872b63 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:16.742646 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ff3b1e-b978-4422-a462-86563170047e admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:16.748570 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab57b40-812b-4932-96b9-abc0a97ac794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:16.749333 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab57b40-812b-4932-96b9-abc0a97ac794 admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:16.749619 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab57b40-812b-4932-96b9-abc0a97ac794 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:16.749892 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab57b40-812b-4932-96b9-abc0a97ac794 admin admin] PATH_INFO: `/v3/domains` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:16.750063 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3140093c-0f93-41df-be56-aee620872b63 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:16.750528 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab57b40-812b-4932-96b9-abc0a97ac794 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:01:16.750851 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab57b40-812b-4932-96b9-abc0a97ac794 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:16.752418 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab57b40-812b-4932-96b9-abc0a97ac794 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:16.754597 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4cabb1-f661-4d3e-81e8-f9daab0acaf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:16.755179 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4cabb1-f661-4d3e-81e8-f9daab0acaf9 admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:16.755454 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4cabb1-f661-4d3e-81e8-f9daab0acaf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:16.755722 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4cabb1-f661-4d3e-81e8-f9daab0acaf9 admin admin] PATH_INFO: `/v3/domains` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:16.756866 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4cabb1-f661-4d3e-81e8-f9daab0acaf9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:01:16.757199 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4cabb1-f661-4d3e-81e8-f9daab0acaf9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:16.758719 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4cabb1-f661-4d3e-81e8-f9daab0acaf9 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:16.765411 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 784/1567] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Oct 4 12:01:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:01:16.767011 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab57b40-812b-4932-96b9-abc0a97ac794 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:16.779738 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 784/1568] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Oct 4 12:01:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:01:16.779738 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4cabb1-f661-4d3e-81e8-f9daab0acaf9 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:16.782538 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4cabb1-f661-4d3e-81e8-f9daab0acaf9 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:16.786329 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab57b40-812b-4932-96b9-abc0a97ac794 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:16.787164 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b14b87d-055e-42e5-be87-16197d634382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:16.787786 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b14b87d-055e-42e5-be87-16197d634382 admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:16.788172 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b14b87d-055e-42e5-be87-16197d634382 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:16.788332 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b14b87d-055e-42e5-be87-16197d634382 admin admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:16.788987 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b14b87d-055e-42e5-be87-16197d634382 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:16.790606 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b14b87d-055e-42e5-be87-16197d634382 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:16.791674 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3244fea-35c8-42d8-af36-5c779f2467ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:16.792343 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3244fea-35c8-42d8-af36-5c779f2467ac admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:16.792657 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3244fea-35c8-42d8-af36-5c779f2467ac admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:16.792929 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3244fea-35c8-42d8-af36-5c779f2467ac admin admin] PATH_INFO: `/v3/domains` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:16.793554 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3244fea-35c8-42d8-af36-5c779f2467ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:01:16.793853 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3244fea-35c8-42d8-af36-5c779f2467ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:16.795417 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3244fea-35c8-42d8-af36-5c779f2467ac admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:16.795960 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:01:16.801189 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 785/1569] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:01:16 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:01:16.801855 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b14b87d-055e-42e5-be87-16197d634382 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:16.811409 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 785/1570] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Oct 4 12:01:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:01:16.812011 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3244fea-35c8-42d8-af36-5c779f2467ac admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:16.812454 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b14b87d-055e-42e5-be87-16197d634382 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:16.821098 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b1cb9a-7be0-4dcf-bd29-75902928ca50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:16.821765 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b1cb9a-7be0-4dcf-bd29-75902928ca50 admin admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:16.822140 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:01:16.822265 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b1cb9a-7be0-4dcf-bd29-75902928ca50 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:16.822265 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b1cb9a-7be0-4dcf-bd29-75902928ca50 admin admin] PATH_INFO: `/v3/projects` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:16.822842 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b1cb9a-7be0-4dcf-bd29-75902928ca50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:16.824798 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b1cb9a-7be0-4dcf-bd29-75902928ca50 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:16.827515 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3244fea-35c8-42d8-af36-5c779f2467ac admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:16.832263 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f075bb2-cbf2-47ab-94b7-d56b07c582d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:16.832887 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f075bb2-cbf2-47ab-94b7-d56b07c582d3 admin admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:16.833171 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f075bb2-cbf2-47ab-94b7-d56b07c582d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:16.833447 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f075bb2-cbf2-47ab-94b7-d56b07c582d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:16.834122 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f075bb2-cbf2-47ab-94b7-d56b07c582d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:16.836034 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f075bb2-cbf2-47ab-94b7-d56b07c582d3 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:16.965723 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 786/1571] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Oct 4 12:01:16 2022] POST /identity/v3/projects => generated 393 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:01:16.966559 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b1cb9a-7be0-4dcf-bd29-75902928ca50 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:16.995259 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 786/1572] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Oct 4 12:01:16 2022] POST /identity/v3/projects => generated 355 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:01:16.996270 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f075bb2-cbf2-47ab-94b7-d56b07c582d3 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:17.029371 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b1cb9a-7be0-4dcf-bd29-75902928ca50 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:17.058458 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f075bb2-cbf2-47ab-94b7-d56b07c582d3 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:17.063928 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68845052-5fd5-4659-b3ff-a3f5871031d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:17.068367 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68845052-5fd5-4659-b3ff-a3f5871031d5 admin admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:17.068367 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68845052-5fd5-4659-b3ff-a3f5871031d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:17.068367 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68845052-5fd5-4659-b3ff-a3f5871031d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:17.068367 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68845052-5fd5-4659-b3ff-a3f5871031d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:17.068367 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68845052-5fd5-4659-b3ff-a3f5871031d5 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:17.088631 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e84e190-3db2-4e60-8f46-c014ea24d916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:17.089183 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e84e190-3db2-4e60-8f46-c014ea24d916 admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:17.089461 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e84e190-3db2-4e60-8f46-c014ea24d916 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:17.089735 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e84e190-3db2-4e60-8f46-c014ea24d916 admin admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:17.090382 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e84e190-3db2-4e60-8f46-c014ea24d916 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:17.091983 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e84e190-3db2-4e60-8f46-c014ea24d916 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:17.102354 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 787/1573] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:01:16 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:01:17.103339 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e84e190-3db2-4e60-8f46-c014ea24d916 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:17.113524 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e84e190-3db2-4e60-8f46-c014ea24d916 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:17.118300 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5806ccb-146f-4892-a089-f1c6033f6201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:17.118886 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5806ccb-146f-4892-a089-f1c6033f6201 admin admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:17.119183 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5806ccb-146f-4892-a089-f1c6033f6201 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:17.119447 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5806ccb-146f-4892-a089-f1c6033f6201 admin admin] PATH_INFO: `/v3/projects` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:17.120059 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5806ccb-146f-4892-a089-f1c6033f6201 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:17.121972 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5806ccb-146f-4892-a089-f1c6033f6201 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:17.223448 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 787/1574] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Oct 4 12:01:16 2022] POST /identity/v3/projects => generated 385 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:01:17.224344 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68845052-5fd5-4659-b3ff-a3f5871031d5 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:17.264291 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 788/1575] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Oct 4 12:01:17 2022] POST /identity/v3/projects => generated 377 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:01:17.265368 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5806ccb-146f-4892-a089-f1c6033f6201 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:17.298948 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68845052-5fd5-4659-b3ff-a3f5871031d5 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:17.329710 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5806ccb-146f-4892-a089-f1c6033f6201 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:17.334574 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb23a16-3c9d-4f23-b726-ec047ca67c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:17.335224 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb23a16-3c9d-4f23-b726-ec047ca67c7d admin admin] REQUEST_METHOD: `PUT` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:17.335505 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb23a16-3c9d-4f23-b726-ec047ca67c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:17.335774 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb23a16-3c9d-4f23-b726-ec047ca67c7d admin admin] PATH_INFO: `/v3/projects/0280ab10a201437080e40643c7a5d1c7/users/1e4dc3d2afc34b8dad06d34d74c85648/roles/ab4307f3b7994c1c80036fa7db93b6b9` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:17.338129 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:01:17.353743 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb23a16-3c9d-4f23-b726-ec047ca67c7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0280ab10a201437080e40643c7a5d1c7, user_id=1e4dc3d2afc34b8dad06d34d74c85648, role_id=ab4307f3b7994c1c80036fa7db93b6b9)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:17.355033 dv-cinder-860212-2-smb devstack@keystone.service[98475]: WARNING py.warnings [None req-afb23a16-3c9d-4f23-b726-ec047ca67c7d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 12:01:17.355033 dv-cinder-860212-2-smb devstack@keystone.service[98475]: warnings.warn(msg) Oct 04 12:01:17.355033 dv-cinder-860212-2-smb devstack@keystone.service[98475]: Oct 04 12:01:17.356793 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb23a16-3c9d-4f23-b726-ec047ca67c7d admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:17.359185 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac1d6fd-c9e1-4364-94b3-76698bdc9b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:17.359800 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac1d6fd-c9e1-4364-94b3-76698bdc9b62 admin admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:17.360081 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac1d6fd-c9e1-4364-94b3-76698bdc9b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:17.360354 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac1d6fd-c9e1-4364-94b3-76698bdc9b62 admin admin] PATH_INFO: `/v3/projects` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:17.361017 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac1d6fd-c9e1-4364-94b3-76698bdc9b62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:17.362903 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac1d6fd-c9e1-4364-94b3-76698bdc9b62 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:17.466909 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 789/1576] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Oct 4 12:01:17 2022] PUT /identity/v3/projects/0280ab10a201437080e40643c7a5d1c7/users/1e4dc3d2afc34b8dad06d34d74c85648/roles/ab4307f3b7994c1c80036fa7db93b6b9 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:01:17.467898 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb23a16-3c9d-4f23-b726-ec047ca67c7d admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:17.473299 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:01:17.482013 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 788/1577] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Oct 4 12:01:17 2022] POST /identity/v3/projects => generated 389 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:01:17.490316 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac1d6fd-c9e1-4364-94b3-76698bdc9b62 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:17.539275 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb23a16-3c9d-4f23-b726-ec047ca67c7d admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:17.552183 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac1d6fd-c9e1-4364-94b3-76698bdc9b62 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:17.557023 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f6b468-a845-45ea-b246-e09cbd6a54ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:17.559132 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f6b468-a845-45ea-b246-e09cbd6a54ee admin admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:17.559132 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f6b468-a845-45ea-b246-e09cbd6a54ee admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:17.559132 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f6b468-a845-45ea-b246-e09cbd6a54ee admin admin] PATH_INFO: `/v3/users` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:17.559132 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f6b468-a845-45ea-b246-e09cbd6a54ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:17.560728 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f6b468-a845-45ea-b246-e09cbd6a54ee admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:17.595257 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477b5edc-42f5-4db5-95ce-416d7e42b552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:17.595789 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477b5edc-42f5-4db5-95ce-416d7e42b552 admin admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:17.596086 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477b5edc-42f5-4db5-95ce-416d7e42b552 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:17.596351 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477b5edc-42f5-4db5-95ce-416d7e42b552 admin admin] PATH_INFO: `/v3/projects` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:17.597017 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477b5edc-42f5-4db5-95ce-416d7e42b552 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:17.598916 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477b5edc-42f5-4db5-95ce-416d7e42b552 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:17.713518 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 789/1578] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Oct 4 12:01:17 2022] POST /identity/v3/users => generated 297 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:01:17.714330 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f6b468-a845-45ea-b246-e09cbd6a54ee admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:17.723583 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f6b468-a845-45ea-b246-e09cbd6a54ee admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:17.728731 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00cf052-6ca8-41fe-b6ee-fdacc936e4ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:17.729372 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00cf052-6ca8-41fe-b6ee-fdacc936e4ad admin admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:17.729820 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00cf052-6ca8-41fe-b6ee-fdacc936e4ad admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:17.730151 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00cf052-6ca8-41fe-b6ee-fdacc936e4ad admin admin] PATH_INFO: `/v3/users` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:17.730765 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00cf052-6ca8-41fe-b6ee-fdacc936e4ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:17.732673 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00cf052-6ca8-41fe-b6ee-fdacc936e4ad admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:17.746107 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 790/1579] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Oct 4 12:01:17 2022] POST /identity/v3/projects => generated 371 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:01:17.746107 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477b5edc-42f5-4db5-95ce-416d7e42b552 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:17.805719 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477b5edc-42f5-4db5-95ce-416d7e42b552 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:17.810854 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f884112a-637a-4449-afdc-dd96e8767fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:17.811508 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f884112a-637a-4449-afdc-dd96e8767fcf admin admin] REQUEST_METHOD: `PUT` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:17.811843 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f884112a-637a-4449-afdc-dd96e8767fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:17.812063 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f884112a-637a-4449-afdc-dd96e8767fcf admin admin] PATH_INFO: `/v3/projects/2029905a6474474cb6f706995d3e52fc/users/78d48749277d4c689a521aabe12f0ebc/roles/ab4307f3b7994c1c80036fa7db93b6b9` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:17.826974 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f884112a-637a-4449-afdc-dd96e8767fcf admin admin] RBAC: Authorizing `identity:create_grant(project_id=2029905a6474474cb6f706995d3e52fc, user_id=78d48749277d4c689a521aabe12f0ebc, role_id=ab4307f3b7994c1c80036fa7db93b6b9)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:17.829657 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f884112a-637a-4449-afdc-dd96e8767fcf admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:17.839959 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 790/1580] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Oct 4 12:01:17 2022] POST /identity/v3/users => generated 278 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:01:17.845643 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00cf052-6ca8-41fe-b6ee-fdacc936e4ad admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:17.851368 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00cf052-6ca8-41fe-b6ee-fdacc936e4ad admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:17.855913 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0325c32e-5f52-4f9d-9096-8687fe873269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:17.856483 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0325c32e-5f52-4f9d-9096-8687fe873269 admin admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:17.856790 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0325c32e-5f52-4f9d-9096-8687fe873269 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:17.857062 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0325c32e-5f52-4f9d-9096-8687fe873269 admin admin] PATH_INFO: `/v3/users` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:17.857672 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0325c32e-5f52-4f9d-9096-8687fe873269 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:17.859917 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0325c32e-5f52-4f9d-9096-8687fe873269 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:17.965135 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:01:17.971341 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 791/1581] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Oct 4 12:01:17 2022] PUT /identity/v3/projects/2029905a6474474cb6f706995d3e52fc/users/78d48749277d4c689a521aabe12f0ebc/roles/ab4307f3b7994c1c80036fa7db93b6b9 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:01:17.972475 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f884112a-637a-4449-afdc-dd96e8767fcf admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:17.984959 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 791/1582] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Oct 4 12:01:17 2022] POST /identity/v3/users => generated 293 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:01:17.984959 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb36d78c-53e6-4982-b855-013d11dda7b2 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:17.984959 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb36d78c-53e6-4982-b855-013d11dda7b2 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:17.984959 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb36d78c-53e6-4982-b855-013d11dda7b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:18.014688 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-cb36d78c-53e6-4982-b855-013d11dda7b2 None None] MFA Rules not processed for user `1e4dc3d2afc34b8dad06d34d74c85648`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:01:18.015972 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-cb36d78c-53e6-4982-b855-013d11dda7b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:01:18.044054 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f884112a-637a-4449-afdc-dd96e8767fcf admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:18.048910 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ef51e8-99b4-4e3e-8c6c-57184064ba7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:18.049764 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ef51e8-99b4-4e3e-8c6c-57184064ba7b admin admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:18.050268 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ef51e8-99b4-4e3e-8c6c-57184064ba7b admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:18.050680 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ef51e8-99b4-4e3e-8c6c-57184064ba7b admin admin] PATH_INFO: `/v3/users` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:18.051689 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ef51e8-99b4-4e3e-8c6c-57184064ba7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:18.053907 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ef51e8-99b4-4e3e-8c6c-57184064ba7b admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:18.085084 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 792/1583] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:01:17 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:01:18.085907 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb36d78c-53e6-4982-b855-013d11dda7b2 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:18.095847 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb36d78c-53e6-4982-b855-013d11dda7b2 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:18.100267 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1048e8e4-232c-4b81-951b-a56d27964e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:18.100875 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1048e8e4-232c-4b81-951b-a56d27964e56 admin admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:18.101158 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1048e8e4-232c-4b81-951b-a56d27964e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:18.101433 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1048e8e4-232c-4b81-951b-a56d27964e56 admin admin] PATH_INFO: `/v3/users` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:18.102055 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1048e8e4-232c-4b81-951b-a56d27964e56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:18.103953 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1048e8e4-232c-4b81-951b-a56d27964e56 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:18.193241 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 792/1584] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Oct 4 12:01:17 2022] POST /identity/v3/users => generated 289 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:01:18.194739 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ef51e8-99b4-4e3e-8c6c-57184064ba7b admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:18.206155 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ef51e8-99b4-4e3e-8c6c-57184064ba7b admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:18.213410 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441685f1-ad3c-4992-b9b5-5777331c74d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:18.217139 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 793/1585] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Oct 4 12:01:18 2022] POST /identity/v3/users => generated 295 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:01:18.217292 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441685f1-ad3c-4992-b9b5-5777331c74d7 admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:18.217292 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441685f1-ad3c-4992-b9b5-5777331c74d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:18.217292 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441685f1-ad3c-4992-b9b5-5777331c74d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:18.217537 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1048e8e4-232c-4b81-951b-a56d27964e56 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:18.217623 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441685f1-ad3c-4992-b9b5-5777331c74d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:18.219059 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441685f1-ad3c-4992-b9b5-5777331c74d7 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:18.233328 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1048e8e4-232c-4b81-951b-a56d27964e56 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:18.236228 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 793/1586] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:01:18 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:01:18.237630 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441685f1-ad3c-4992-b9b5-5777331c74d7 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:18.241114 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f31bf6c-6010-475a-b31a-95e41c299a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:18.241919 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f31bf6c-6010-475a-b31a-95e41c299a74 admin admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:18.242198 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f31bf6c-6010-475a-b31a-95e41c299a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:18.242470 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f31bf6c-6010-475a-b31a-95e41c299a74 admin admin] PATH_INFO: `/v3/users` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:18.243099 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f31bf6c-6010-475a-b31a-95e41c299a74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:18.245918 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f31bf6c-6010-475a-b31a-95e41c299a74 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:18.248661 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441685f1-ad3c-4992-b9b5-5777331c74d7 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:18.253269 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e158b7-35eb-4264-beb1-bb6aac682a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:18.253890 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e158b7-35eb-4264-beb1-bb6aac682a25 admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:18.254168 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e158b7-35eb-4264-beb1-bb6aac682a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:18.254438 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e158b7-35eb-4264-beb1-bb6aac682a25 admin admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:18.255077 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e158b7-35eb-4264-beb1-bb6aac682a25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:18.257864 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e158b7-35eb-4264-beb1-bb6aac682a25 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:18.269565 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 794/1587] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:01:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:01:18.270890 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fe0d70-055a-48c2-a0fa-c27f016fab93 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:18.272990 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fe0d70-055a-48c2-a0fa-c27f016fab93 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:18.272990 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fe0d70-055a-48c2-a0fa-c27f016fab93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:18.301033 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-23fe0d70-055a-48c2-a0fa-c27f016fab93 None None] MFA Rules not processed for user `78d48749277d4c689a521aabe12f0ebc`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:01:18.302260 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-23fe0d70-055a-48c2-a0fa-c27f016fab93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:01:18.368331 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 794/1588] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Oct 4 12:01:18 2022] POST /identity/v3/users => generated 286 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:01:18.368331 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f31bf6c-6010-475a-b31a-95e41c299a74 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:18.370588 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 795/1589] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:01:18 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:01:18.371460 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fe0d70-055a-48c2-a0fa-c27f016fab93 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:18.383077 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f31bf6c-6010-475a-b31a-95e41c299a74 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:18.383257 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fe0d70-055a-48c2-a0fa-c27f016fab93 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:18.387940 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c8bcfe-bcd8-436d-980e-cd4a5926f2f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:18.388104 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b348491-0617-4710-acb7-478822a801d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:18.388649 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b348491-0617-4710-acb7-478822a801d3 admin admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:18.388781 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c8bcfe-bcd8-436d-980e-cd4a5926f2f3 admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:18.388952 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b348491-0617-4710-acb7-478822a801d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:18.389064 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c8bcfe-bcd8-436d-980e-cd4a5926f2f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:18.389217 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c8bcfe-bcd8-436d-980e-cd4a5926f2f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:18.389315 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b348491-0617-4710-acb7-478822a801d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:18.389838 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b348491-0617-4710-acb7-478822a801d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:18.389947 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c8bcfe-bcd8-436d-980e-cd4a5926f2f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:18.391427 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c8bcfe-bcd8-436d-980e-cd4a5926f2f3 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:18.391727 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b348491-0617-4710-acb7-478822a801d3 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:18.393258 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=85,keystone:INSERT=15 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:01:18.409585 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 795/1590] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:01:18 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:01:18.409585 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c8bcfe-bcd8-436d-980e-cd4a5926f2f3 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:18.418004 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c8bcfe-bcd8-436d-980e-cd4a5926f2f3 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:18.423138 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e567f9b1-b47c-498e-820b-3073841b5f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:18.423720 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e567f9b1-b47c-498e-820b-3073841b5f8d admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:18.426350 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e567f9b1-b47c-498e-820b-3073841b5f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:18.426350 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e567f9b1-b47c-498e-820b-3073841b5f8d admin admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:18.426350 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e567f9b1-b47c-498e-820b-3073841b5f8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:18.426657 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e567f9b1-b47c-498e-820b-3073841b5f8d admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:18.436812 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 796/1591] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:01:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:01:18.437598 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e567f9b1-b47c-498e-820b-3073841b5f8d admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:18.447353 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e567f9b1-b47c-498e-820b-3073841b5f8d admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:18.451844 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdfb339-e55f-4eea-99b7-3ffb4b25bb99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:18.452402 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdfb339-e55f-4eea-99b7-3ffb4b25bb99 admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:18.452721 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdfb339-e55f-4eea-99b7-3ffb4b25bb99 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:18.452995 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdfb339-e55f-4eea-99b7-3ffb4b25bb99 admin admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:18.453603 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdfb339-e55f-4eea-99b7-3ffb4b25bb99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:18.455132 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdfb339-e55f-4eea-99b7-3ffb4b25bb99 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:18.465673 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 797/1592] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:01:18 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:01:18.466425 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdfb339-e55f-4eea-99b7-3ffb4b25bb99 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:18.476269 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdfb339-e55f-4eea-99b7-3ffb4b25bb99 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:18.480913 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923daf3b-6b96-4d92-a727-64e7221ad68e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:18.481462 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923daf3b-6b96-4d92-a727-64e7221ad68e admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:18.481739 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923daf3b-6b96-4d92-a727-64e7221ad68e admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:18.482008 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923daf3b-6b96-4d92-a727-64e7221ad68e admin admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:18.482612 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923daf3b-6b96-4d92-a727-64e7221ad68e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:18.484473 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923daf3b-6b96-4d92-a727-64e7221ad68e admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:18.494702 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 798/1593] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:01:18 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:01:18.495969 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923daf3b-6b96-4d92-a727-64e7221ad68e admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:18.503979 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 796/1594] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Oct 4 12:01:18 2022] POST /identity/v3/projects => generated 365 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:01:18.504848 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b348491-0617-4710-acb7-478822a801d3 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:18.505377 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923daf3b-6b96-4d92-a727-64e7221ad68e admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:18.548290 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:01:18.564810 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb298562-e0ba-482b-bef8-54691dc48ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:18.565436 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb298562-e0ba-482b-bef8-54691dc48ff6 admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:18.570436 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb298562-e0ba-482b-bef8-54691dc48ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:18.570436 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb298562-e0ba-482b-bef8-54691dc48ff6 admin admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:18.570436 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb298562-e0ba-482b-bef8-54691dc48ff6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:18.570436 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb298562-e0ba-482b-bef8-54691dc48ff6 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:18.574930 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b348491-0617-4710-acb7-478822a801d3 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:18.581291 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 799/1595] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:01:18 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:01:18.581291 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f21ba5c-1c0d-44f3-8fc3-e6631683d8c5 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:18.581291 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f21ba5c-1c0d-44f3-8fc3-e6631683d8c5 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:18.581592 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2298b1-2c16-415b-b5e2-e0bc7a5cc62c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:18.581697 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f21ba5c-1c0d-44f3-8fc3-e6631683d8c5 None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:18.581794 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2298b1-2c16-415b-b5e2-e0bc7a5cc62c admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:18.581794 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2298b1-2c16-415b-b5e2-e0bc7a5cc62c admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:18.581794 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2298b1-2c16-415b-b5e2-e0bc7a5cc62c admin admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:18.581794 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2298b1-2c16-415b-b5e2-e0bc7a5cc62c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:18.583170 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2298b1-2c16-415b-b5e2-e0bc7a5cc62c admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:18.584720 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 800/1596] 10.222.0.59 () {54 vars in 961 bytes} [Tue Oct 4 12:01:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:01:18.586273 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f21ba5c-1c0d-44f3-8fc3-e6631683d8c5 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:18.596634 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 797/1597] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:01:18 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:01:18.596634 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2298b1-2c16-415b-b5e2-e0bc7a5cc62c admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:18.602351 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f21ba5c-1c0d-44f3-8fc3-e6631683d8c5 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:18.605603 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2298b1-2c16-415b-b5e2-e0bc7a5cc62c admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:18.606955 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a734198-5fa0-47fb-b112-40dfef414cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:18.607521 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a734198-5fa0-47fb-b112-40dfef414cff admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:18.612537 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a734198-5fa0-47fb-b112-40dfef414cff admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:18.612537 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a734198-5fa0-47fb-b112-40dfef414cff admin admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:18.612537 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a734198-5fa0-47fb-b112-40dfef414cff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:18.612900 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141d0cec-7f7d-40fc-8e4b-5345dbe7c923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:18.613007 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a734198-5fa0-47fb-b112-40dfef414cff admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:18.613100 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141d0cec-7f7d-40fc-8e4b-5345dbe7c923 admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:18.613100 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141d0cec-7f7d-40fc-8e4b-5345dbe7c923 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:18.613100 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141d0cec-7f7d-40fc-8e4b-5345dbe7c923 admin admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:18.613100 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141d0cec-7f7d-40fc-8e4b-5345dbe7c923 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:18.613679 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141d0cec-7f7d-40fc-8e4b-5345dbe7c923 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:18.624731 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 801/1598] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:01:18 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:01:18.624731 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a734198-5fa0-47fb-b112-40dfef414cff admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:18.625017 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 798/1599] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:01:18 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:01:18.625017 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141d0cec-7f7d-40fc-8e4b-5345dbe7c923 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:18.634550 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141d0cec-7f7d-40fc-8e4b-5345dbe7c923 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:18.636059 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a734198-5fa0-47fb-b112-40dfef414cff admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:18.639486 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db37d5a-80c2-4530-8d48-1747735525ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:18.640245 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db37d5a-80c2-4530-8d48-1747735525ea admin admin] REQUEST_METHOD: `PUT` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:18.640532 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db37d5a-80c2-4530-8d48-1747735525ea admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:18.640849 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db37d5a-80c2-4530-8d48-1747735525ea admin admin] PATH_INFO: `/v3/projects/7276be9c327849c3bde22ad79fedea72/users/39a8f928f83449d08a766f9c5303b31b/roles/ab4307f3b7994c1c80036fa7db93b6b9` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:18.641027 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cb6b31-a593-4073-93fc-213a2e91e019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:18.641623 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cb6b31-a593-4073-93fc-213a2e91e019 admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:18.641903 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cb6b31-a593-4073-93fc-213a2e91e019 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:18.642172 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cb6b31-a593-4073-93fc-213a2e91e019 admin admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:18.642829 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cb6b31-a593-4073-93fc-213a2e91e019 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:18.644404 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cb6b31-a593-4073-93fc-213a2e91e019 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:18.656239 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 802/1600] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:01:18 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:01:18.656591 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db37d5a-80c2-4530-8d48-1747735525ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=7276be9c327849c3bde22ad79fedea72, user_id=39a8f928f83449d08a766f9c5303b31b, role_id=ab4307f3b7994c1c80036fa7db93b6b9)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:18.657180 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cb6b31-a593-4073-93fc-213a2e91e019 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:18.659563 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db37d5a-80c2-4530-8d48-1747735525ea admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:18.667366 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cb6b31-a593-4073-93fc-213a2e91e019 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:18.672000 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e30eef-1f81-4b49-8556-6a5202d746ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:18.672575 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e30eef-1f81-4b49-8556-6a5202d746ab admin admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:18.672997 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e30eef-1f81-4b49-8556-6a5202d746ab admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:18.673266 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e30eef-1f81-4b49-8556-6a5202d746ab admin admin] PATH_INFO: `/v3/users` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:18.673881 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e30eef-1f81-4b49-8556-6a5202d746ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:18.675760 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e30eef-1f81-4b49-8556-6a5202d746ab admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:18.850962 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 799/1601] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Oct 4 12:01:18 2022] PUT /identity/v3/projects/7276be9c327849c3bde22ad79fedea72/users/39a8f928f83449d08a766f9c5303b31b/roles/ab4307f3b7994c1c80036fa7db93b6b9 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:01:18.850962 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db37d5a-80c2-4530-8d48-1747735525ea admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:18.874552 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 803/1602] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Oct 4 12:01:18 2022] POST /identity/v3/users => generated 289 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:01:18.876592 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61786009-6f27-4972-8afa-1a1038d66146 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:18.876592 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61786009-6f27-4972-8afa-1a1038d66146 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:18.876592 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61786009-6f27-4972-8afa-1a1038d66146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:18.915875 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db37d5a-80c2-4530-8d48-1747735525ea admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:18.917247 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-61786009-6f27-4972-8afa-1a1038d66146 None None] MFA Rules not processed for user `a8e23d1d2fe24bdf9552e7c2f0ae3424`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:01:18.918460 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-61786009-6f27-4972-8afa-1a1038d66146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:01:18.920589 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c4ea78-acb5-4332-a0be-c105403657dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:18.921265 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c4ea78-acb5-4332-a0be-c105403657dd admin admin] REQUEST_METHOD: `PUT` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:18.921538 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c4ea78-acb5-4332-a0be-c105403657dd admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:18.921809 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c4ea78-acb5-4332-a0be-c105403657dd admin admin] PATH_INFO: `/v3/projects/74c11c400c664d3b9ec81296155eb5d4/users/2b9002360ca64c4eb198798944f9bd0e/roles/ab4307f3b7994c1c80036fa7db93b6b9` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:18.937511 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c4ea78-acb5-4332-a0be-c105403657dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=74c11c400c664d3b9ec81296155eb5d4, user_id=2b9002360ca64c4eb198798944f9bd0e, role_id=ab4307f3b7994c1c80036fa7db93b6b9)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:18.940267 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c4ea78-acb5-4332-a0be-c105403657dd admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:18.978580 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:01:18.989783 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 804/1603] 10.222.0.59 () {58 vars in 1058 bytes} [Tue Oct 4 12:01:18 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:01:18.990718 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61786009-6f27-4972-8afa-1a1038d66146 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:19.000171 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61786009-6f27-4972-8afa-1a1038d66146 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:19.004576 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60764086-a1e0-45c5-87f2-94b03a4e582b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:19.005174 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60764086-a1e0-45c5-87f2-94b03a4e582b admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:19.005456 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60764086-a1e0-45c5-87f2-94b03a4e582b admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:19.005726 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60764086-a1e0-45c5-87f2-94b03a4e582b admin admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:19.006942 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60764086-a1e0-45c5-87f2-94b03a4e582b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:19.008556 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60764086-a1e0-45c5-87f2-94b03a4e582b admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:19.018065 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 805/1604] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:01:18 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:01:19.018793 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60764086-a1e0-45c5-87f2-94b03a4e582b admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:19.028473 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60764086-a1e0-45c5-87f2-94b03a4e582b admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:19.035407 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 800/1605] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Oct 4 12:01:18 2022] PUT /identity/v3/projects/74c11c400c664d3b9ec81296155eb5d4/users/2b9002360ca64c4eb198798944f9bd0e/roles/ab4307f3b7994c1c80036fa7db93b6b9 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:01:19.047723 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c4ea78-acb5-4332-a0be-c105403657dd admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:19.085153 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b006b754-cee4-4e03-b111-95fae2d49ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:19.085956 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b006b754-cee4-4e03-b111-95fae2d49ccd admin admin] REQUEST_METHOD: `PUT` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:19.086233 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b006b754-cee4-4e03-b111-95fae2d49ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:19.086536 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b006b754-cee4-4e03-b111-95fae2d49ccd admin admin] PATH_INFO: `/v3/projects/3938a89250d746778d4da015b5f552af/users/74861e3dd6e14d999aeae1f057b24582/roles/ab4307f3b7994c1c80036fa7db93b6b9` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:19.101236 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b006b754-cee4-4e03-b111-95fae2d49ccd admin admin] RBAC: Authorizing `identity:create_grant(project_id=3938a89250d746778d4da015b5f552af, user_id=74861e3dd6e14d999aeae1f057b24582, role_id=ab4307f3b7994c1c80036fa7db93b6b9)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:19.103938 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b006b754-cee4-4e03-b111-95fae2d49ccd admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:19.112362 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c4ea78-acb5-4332-a0be-c105403657dd admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:19.117602 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33cbc1f-9120-4f8a-bb86-118abebb87bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:19.118252 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33cbc1f-9120-4f8a-bb86-118abebb87bd admin admin] REQUEST_METHOD: `PUT` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:19.118528 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33cbc1f-9120-4f8a-bb86-118abebb87bd admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:19.118796 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33cbc1f-9120-4f8a-bb86-118abebb87bd admin admin] PATH_INFO: `/v3/projects/6ed36bb056c24fd1b4a65c96bbb33801/users/4fabb75bbc354ac7a3f109edfaefb291/roles/ab4307f3b7994c1c80036fa7db93b6b9` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:19.133726 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33cbc1f-9120-4f8a-bb86-118abebb87bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ed36bb056c24fd1b4a65c96bbb33801, user_id=4fabb75bbc354ac7a3f109edfaefb291, role_id=ab4307f3b7994c1c80036fa7db93b6b9)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:19.136263 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33cbc1f-9120-4f8a-bb86-118abebb87bd admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:19.204198 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 806/1606] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Oct 4 12:01:19 2022] PUT /identity/v3/projects/3938a89250d746778d4da015b5f552af/users/74861e3dd6e14d999aeae1f057b24582/roles/ab4307f3b7994c1c80036fa7db93b6b9 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:01:19.205183 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b006b754-cee4-4e03-b111-95fae2d49ccd admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:19.258248 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:01:19.263353 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 801/1607] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Oct 4 12:01:19 2022] PUT /identity/v3/projects/6ed36bb056c24fd1b4a65c96bbb33801/users/4fabb75bbc354ac7a3f109edfaefb291/roles/ab4307f3b7994c1c80036fa7db93b6b9 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:01:19.264397 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c58dbb-b030-4bd2-8d9c-1517cbcf8a6d None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:19.264720 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c58dbb-b030-4bd2-8d9c-1517cbcf8a6d None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:19.264989 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c58dbb-b030-4bd2-8d9c-1517cbcf8a6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:19.265998 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b006b754-cee4-4e03-b111-95fae2d49ccd admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:19.291257 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-36c58dbb-b030-4bd2-8d9c-1517cbcf8a6d None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:01:19.292460 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-36c58dbb-b030-4bd2-8d9c-1517cbcf8a6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:01:19.324743 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23431e7b-e884-4b46-a97b-0a8d7c195c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:19.325407 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23431e7b-e884-4b46-a97b-0a8d7c195c0e admin admin] REQUEST_METHOD: `PUT` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:19.325683 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23431e7b-e884-4b46-a97b-0a8d7c195c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:19.325975 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23431e7b-e884-4b46-a97b-0a8d7c195c0e admin admin] PATH_INFO: `/v3/projects/bca736825afb4888a203f4ef789835b9/users/6c95a1206a4a4788b47882c7bb3e7a61/roles/ab4307f3b7994c1c80036fa7db93b6b9` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:19.340362 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23431e7b-e884-4b46-a97b-0a8d7c195c0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=bca736825afb4888a203f4ef789835b9, user_id=6c95a1206a4a4788b47882c7bb3e7a61, role_id=ab4307f3b7994c1c80036fa7db93b6b9)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:19.343068 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23431e7b-e884-4b46-a97b-0a8d7c195c0e admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:19.353572 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 802/1608] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:01:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:01:19.354485 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c58dbb-b030-4bd2-8d9c-1517cbcf8a6d None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:19.364304 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c58dbb-b030-4bd2-8d9c-1517cbcf8a6d None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:19.369565 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf7a64c-224c-4271-9d59-cf69dc4a4701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:19.370146 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf7a64c-224c-4271-9d59-cf69dc4a4701 admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:19.370426 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf7a64c-224c-4271-9d59-cf69dc4a4701 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:19.370806 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf7a64c-224c-4271-9d59-cf69dc4a4701 admin admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:19.371446 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf7a64c-224c-4271-9d59-cf69dc4a4701 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:19.373048 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf7a64c-224c-4271-9d59-cf69dc4a4701 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:19.384665 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 803/1609] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:01:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:01:19.385425 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf7a64c-224c-4271-9d59-cf69dc4a4701 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:19.417096 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:01:19.422676 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 807/1610] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Oct 4 12:01:19 2022] PUT /identity/v3/projects/bca736825afb4888a203f4ef789835b9/users/6c95a1206a4a4788b47882c7bb3e7a61/roles/ab4307f3b7994c1c80036fa7db93b6b9 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:01:19.426398 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23431e7b-e884-4b46-a97b-0a8d7c195c0e admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:19.455974 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf7a64c-224c-4271-9d59-cf69dc4a4701 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:19.487436 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23431e7b-e884-4b46-a97b-0a8d7c195c0e admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:19.493000 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c20e2b-f21c-45e7-93e6-5fb05ab0e755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:19.493690 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c20e2b-f21c-45e7-93e6-5fb05ab0e755 admin admin] REQUEST_METHOD: `PUT` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:19.494087 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c20e2b-f21c-45e7-93e6-5fb05ab0e755 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:19.494362 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c20e2b-f21c-45e7-93e6-5fb05ab0e755 admin admin] PATH_INFO: `/v3/projects/5c2729152cf54940b21eb0234e797f8f/users/d132067762eb4b58ac5d52606f52b3b7/roles/ab4307f3b7994c1c80036fa7db93b6b9` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:19.511378 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c20e2b-f21c-45e7-93e6-5fb05ab0e755 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c2729152cf54940b21eb0234e797f8f, user_id=d132067762eb4b58ac5d52606f52b3b7, role_id=ab4307f3b7994c1c80036fa7db93b6b9)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:19.514427 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c20e2b-f21c-45e7-93e6-5fb05ab0e755 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:19.521889 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b7768b-8f5b-481c-83f4-0e2a79480011 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8e23d1d2fe24bdf9552e7c2f0ae3424', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:19.522501 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b7768b-8f5b-481c-83f4-0e2a79480011 service nova] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:19.522774 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b7768b-8f5b-481c-83f4-0e2a79480011 service nova] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:19.523040 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b7768b-8f5b-481c-83f4-0e2a79480011 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:19.547973 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:01:19.579256 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b7768b-8f5b-481c-83f4-0e2a79480011 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:19.580925 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b7768b-8f5b-481c-83f4-0e2a79480011 service nova] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:19.590704 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 804/1611] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:01:19 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:01:19.591949 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d93ece-f68f-415b-937e-6c34340e6bad None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:19.592229 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d93ece-f68f-415b-937e-6c34340e6bad None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:19.592499 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d93ece-f68f-415b-937e-6c34340e6bad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:19.620853 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-35d93ece-f68f-415b-937e-6c34340e6bad None None] MFA Rules not processed for user `2b9002360ca64c4eb198798944f9bd0e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:01:19.622048 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-35d93ece-f68f-415b-937e-6c34340e6bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:01:19.670057 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 808/1612] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Oct 4 12:01:19 2022] PUT /identity/v3/projects/5c2729152cf54940b21eb0234e797f8f/users/d132067762eb4b58ac5d52606f52b3b7/roles/ab4307f3b7994c1c80036fa7db93b6b9 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:01:19.672095 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533ba6b3-1b55-4358-a792-98a9a531e045 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:19.672421 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533ba6b3-1b55-4358-a792-98a9a531e045 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:19.672740 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533ba6b3-1b55-4358-a792-98a9a531e045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:19.692416 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-533ba6b3-1b55-4358-a792-98a9a531e045 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:01:19.694426 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-533ba6b3-1b55-4358-a792-98a9a531e045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:01:19.703569 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 805/1613] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:01:19 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:01:19.703569 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a43fa16-5b20-4cc6-b9c8-09b2dd49d6ac None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:19.703569 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a43fa16-5b20-4cc6-b9c8-09b2dd49d6ac None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:19.703569 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a43fa16-5b20-4cc6-b9c8-09b2dd49d6ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:19.721531 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-9a43fa16-5b20-4cc6-b9c8-09b2dd49d6ac None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:01:19.722764 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-9a43fa16-5b20-4cc6-b9c8-09b2dd49d6ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:01:19.763881 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 809/1614] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:01:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:01:19.763881 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533ba6b3-1b55-4358-a792-98a9a531e045 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:19.790020 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 806/1615] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:01:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:01:19.791203 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a43fa16-5b20-4cc6-b9c8-09b2dd49d6ac None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:19.807211 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a43fa16-5b20-4cc6-b9c8-09b2dd49d6ac None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:19.812143 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d91f3da-3553-46c2-94c1-678c01818018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:19.813097 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d91f3da-3553-46c2-94c1-678c01818018 admin admin] REQUEST_METHOD: `PUT` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:19.813649 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d91f3da-3553-46c2-94c1-678c01818018 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:19.814112 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d91f3da-3553-46c2-94c1-678c01818018 admin admin] PATH_INFO: `/v3/projects/1153e10b9d5041ae86d16789e8852b86/users/cc47d7b172ad4088a957a3515a0e0aa2/roles/d6e7421d1ff9451c808004b818354550` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:19.827752 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533ba6b3-1b55-4358-a792-98a9a531e045 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:19.831449 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9086ca71-374c-4f83-ae2b-e04c6721ddf3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7289515c5c44914a19daa439de98cb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:19.832065 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9086ca71-374c-4f83-ae2b-e04c6721ddf3 service neutron] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:19.832398 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9086ca71-374c-4f83-ae2b-e04c6721ddf3 service neutron] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:19.832705 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9086ca71-374c-4f83-ae2b-e04c6721ddf3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:19.833653 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d91f3da-3553-46c2-94c1-678c01818018 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1153e10b9d5041ae86d16789e8852b86, user_id=cc47d7b172ad4088a957a3515a0e0aa2, role_id=d6e7421d1ff9451c808004b818354550)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:19.839339 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d91f3da-3553-46c2-94c1-678c01818018 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:19.843507 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9086ca71-374c-4f83-ae2b-e04c6721ddf3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:19.844949 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9086ca71-374c-4f83-ae2b-e04c6721ddf3 service neutron] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:19.854458 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 810/1616] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:01:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:01:19.855794 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24edb1e9-168b-40f0-b908-32336bcf197a None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:19.856080 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24edb1e9-168b-40f0-b908-32336bcf197a None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:19.856431 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24edb1e9-168b-40f0-b908-32336bcf197a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:19.877714 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-24edb1e9-168b-40f0-b908-32336bcf197a None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:01:19.878899 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-24edb1e9-168b-40f0-b908-32336bcf197a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:01:19.887422 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 811/1617] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:01:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:01:19.888805 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d222b18f-4c0c-4ed8-9711-c1c1a7cb0924 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:19.889082 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d222b18f-4c0c-4ed8-9711-c1c1a7cb0924 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:19.889349 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d222b18f-4c0c-4ed8-9711-c1c1a7cb0924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:19.916337 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-d222b18f-4c0c-4ed8-9711-c1c1a7cb0924 None None] MFA Rules not processed for user `d132067762eb4b58ac5d52606f52b3b7`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:01:19.917577 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-d222b18f-4c0c-4ed8-9711-c1c1a7cb0924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:01:19.925711 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:01:19.930917 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 807/1618] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Oct 4 12:01:19 2022] PUT /identity/v3/projects/1153e10b9d5041ae86d16789e8852b86/users/cc47d7b172ad4088a957a3515a0e0aa2/roles/d6e7421d1ff9451c808004b818354550 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:01:19.942780 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d91f3da-3553-46c2-94c1-678c01818018 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:19.969501 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:01:19.989750 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 812/1619] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:01:19 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:01:19.993634 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d222b18f-4c0c-4ed8-9711-c1c1a7cb0924 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:20.008863 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d91f3da-3553-46c2-94c1-678c01818018 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:20.013442 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d222b18f-4c0c-4ed8-9711-c1c1a7cb0924 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:20.014287 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3160fdd-f95b-4019-b8ed-63e440367a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:20.015024 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3160fdd-f95b-4019-b8ed-63e440367a8d admin admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:20.015375 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3160fdd-f95b-4019-b8ed-63e440367a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:20.015724 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3160fdd-f95b-4019-b8ed-63e440367a8d admin admin] PATH_INFO: `/v3/projects` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:20.016522 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3160fdd-f95b-4019-b8ed-63e440367a8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:20.018569 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3160fdd-f95b-4019-b8ed-63e440367a8d admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:20.069726 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c8af64-dac8-49c9-9ebe-e939a95fefbc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7289515c5c44914a19daa439de98cb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:20.070650 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c8af64-dac8-49c9-9ebe-e939a95fefbc service neutron] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:20.070931 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c8af64-dac8-49c9-9ebe-e939a95fefbc service neutron] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:20.071202 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c8af64-dac8-49c9-9ebe-e939a95fefbc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:20.080579 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c8af64-dac8-49c9-9ebe-e939a95fefbc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:20.082094 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c8af64-dac8-49c9-9ebe-e939a95fefbc service neutron] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:20.092748 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 813/1620] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:01:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:01:20.093554 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c8af64-dac8-49c9-9ebe-e939a95fefbc service neutron] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:20.095066 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-64c8af64-dac8-49c9-9ebe-e939a95fefbc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:01:20.106320 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c8af64-dac8-49c9-9ebe-e939a95fefbc service neutron] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:20.110360 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7112df63-fe99-45f1-8741-49dad0954651 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7289515c5c44914a19daa439de98cb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:20.110985 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7112df63-fe99-45f1-8741-49dad0954651 service neutron] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:20.111289 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7112df63-fe99-45f1-8741-49dad0954651 service neutron] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:20.111561 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7112df63-fe99-45f1-8741-49dad0954651 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:20.121127 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7112df63-fe99-45f1-8741-49dad0954651 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:20.122532 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7112df63-fe99-45f1-8741-49dad0954651 service neutron] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:20.131939 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 814/1621] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:01:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:01:20.133290 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e80c2d-053d-429d-9161-22008abe13e0 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:20.133582 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e80c2d-053d-429d-9161-22008abe13e0 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:20.133856 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e80c2d-053d-429d-9161-22008abe13e0 None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:20.139376 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 815/1622] 10.222.0.59 () {54 vars in 912 bytes} [Tue Oct 4 12:01:20 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:01:20.140202 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e80c2d-053d-429d-9161-22008abe13e0 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:20.147421 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 808/1623] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Oct 4 12:01:19 2022] POST /identity/v3/projects => generated 357 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:01:20.147421 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3160fdd-f95b-4019-b8ed-63e440367a8d admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:20.151814 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e80c2d-053d-429d-9161-22008abe13e0 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:20.211673 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0301749-f68a-4a5c-9eae-8bd70930c100 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7289515c5c44914a19daa439de98cb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:20.213249 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0301749-f68a-4a5c-9eae-8bd70930c100 service neutron] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:20.213249 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0301749-f68a-4a5c-9eae-8bd70930c100 service neutron] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:20.213249 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0301749-f68a-4a5c-9eae-8bd70930c100 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:20.213497 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3160fdd-f95b-4019-b8ed-63e440367a8d admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:20.217925 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91965feb-b408-41d3-b754-1aa051787fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:20.218524 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91965feb-b408-41d3-b754-1aa051787fd8 admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:20.218907 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91965feb-b408-41d3-b754-1aa051787fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:20.219104 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91965feb-b408-41d3-b754-1aa051787fd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:20.219773 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91965feb-b408-41d3-b754-1aa051787fd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:20.221428 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91965feb-b408-41d3-b754-1aa051787fd8 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:20.222845 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0301749-f68a-4a5c-9eae-8bd70930c100 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:20.224176 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0301749-f68a-4a5c-9eae-8bd70930c100 service neutron] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:20.233584 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 809/1624] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:01:20 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:01:20.235214 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72105c1e-c95b-4c1f-9e5f-7eb97f4bd596 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:20.235499 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72105c1e-c95b-4c1f-9e5f-7eb97f4bd596 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:20.235774 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72105c1e-c95b-4c1f-9e5f-7eb97f4bd596 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:20.237439 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 810/1626] 10.222.0.59 () {54 vars in 961 bytes} [Tue Oct 4 12:01:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:01:20.242004 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 816/1626] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:01:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:01:20.242004 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0301749-f68a-4a5c-9eae-8bd70930c100 service neutron] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:20.244738 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d184f4-aa31-4137-9ecd-780f8090bedd None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:20.244738 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d184f4-aa31-4137-9ecd-780f8090bedd None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:20.244738 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d184f4-aa31-4137-9ecd-780f8090bedd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:20.250250 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0301749-f68a-4a5c-9eae-8bd70930c100 service neutron] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:20.255518 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17834992-d4ae-46c7-a4a7-aa697bec5c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:20.256971 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17834992-d4ae-46c7-a4a7-aa697bec5c6c admin admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:20.256971 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17834992-d4ae-46c7-a4a7-aa697bec5c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:20.256971 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17834992-d4ae-46c7-a4a7-aa697bec5c6c admin admin] PATH_INFO: `/v3/users` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:20.257365 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17834992-d4ae-46c7-a4a7-aa697bec5c6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:20.259376 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17834992-d4ae-46c7-a4a7-aa697bec5c6c admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:20.271131 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-f9d184f4-aa31-4137-9ecd-780f8090bedd None None] MFA Rules not processed for user `a8e23d1d2fe24bdf9552e7c2f0ae3424`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:01:20.272530 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-f9d184f4-aa31-4137-9ecd-780f8090bedd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:01:20.371598 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 811/1627] 10.222.0.59 () {58 vars in 1009 bytes} [Tue Oct 4 12:01:20 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:01:20.372581 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d184f4-aa31-4137-9ecd-780f8090bedd None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:20.391664 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d184f4-aa31-4137-9ecd-780f8090bedd None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:20.397643 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ab2227-5daa-4736-bc9a-2208b4577a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:20.398532 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ab2227-5daa-4736-bc9a-2208b4577a85 admin admin] REQUEST_METHOD: `PUT` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:20.398818 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ab2227-5daa-4736-bc9a-2208b4577a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:20.399164 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ab2227-5daa-4736-bc9a-2208b4577a85 admin admin] PATH_INFO: `/v3/projects/1153e10b9d5041ae86d16789e8852b86/users/cc47d7b172ad4088a957a3515a0e0aa2/roles/d6e7421d1ff9451c808004b818354550` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:20.401428 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ab2227-5daa-4736-bc9a-2208b4577a85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1153e10b9d5041ae86d16789e8852b86, user_id=cc47d7b172ad4088a957a3515a0e0aa2, role_id=d6e7421d1ff9451c808004b818354550)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:20.402007 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 817/1628] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Oct 4 12:01:20 2022] POST /identity/v3/users => generated 285 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:01:20.403410 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6e5f0e-bbba-4c70-a598-9fd1539165e3 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:20.404383 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6e5f0e-bbba-4c70-a598-9fd1539165e3 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:20.404737 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6e5f0e-bbba-4c70-a598-9fd1539165e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:20.407421 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ab2227-5daa-4736-bc9a-2208b4577a85 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:20.419124 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 812/1629] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Oct 4 12:01:20 2022] PUT /identity/v3/projects/1153e10b9d5041ae86d16789e8852b86/users/cc47d7b172ad4088a957a3515a0e0aa2/roles/d6e7421d1ff9451c808004b818354550 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:01:20.419955 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ab2227-5daa-4736-bc9a-2208b4577a85 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:20.434544 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-dd6e5f0e-bbba-4c70-a598-9fd1539165e3 None None] MFA Rules not processed for user `a8e23d1d2fe24bdf9552e7c2f0ae3424`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:01:20.435906 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-dd6e5f0e-bbba-4c70-a598-9fd1539165e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:01:20.456830 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:01:20.476388 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ab2227-5daa-4736-bc9a-2208b4577a85 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:20.484758 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02db408-6a1c-4dea-96e3-9923baf088db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e2a05b782424ab2928b5864f1bfd556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:20.484758 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02db408-6a1c-4dea-96e3-9923baf088db service cinder] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:20.484758 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02db408-6a1c-4dea-96e3-9923baf088db service cinder] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:20.484758 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02db408-6a1c-4dea-96e3-9923baf088db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:20.516778 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 818/1630] 10.222.0.59 () {58 vars in 1058 bytes} [Tue Oct 4 12:01:20 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:01:20.526926 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6e5f0e-bbba-4c70-a598-9fd1539165e3 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:20.587116 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02db408-6a1c-4dea-96e3-9923baf088db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:20.588580 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02db408-6a1c-4dea-96e3-9923baf088db service cinder] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:20.604430 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 813/1631] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:01:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:01:20.606028 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcf7c7e-fb58-4104-8959-e6f3426fea7e None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:20.606402 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcf7c7e-fb58-4104-8959-e6f3426fea7e None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:20.606678 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcf7c7e-fb58-4104-8959-e6f3426fea7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:20.658967 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-9dcf7c7e-fb58-4104-8959-e6f3426fea7e None None] MFA Rules not processed for user `cc47d7b172ad4088a957a3515a0e0aa2`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:01:20.658967 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-9dcf7c7e-fb58-4104-8959-e6f3426fea7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:01:20.669005 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6e5f0e-bbba-4c70-a598-9fd1539165e3 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:20.684851 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99ea099-3b0e-452a-b450-ea3910326fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:20.684851 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99ea099-3b0e-452a-b450-ea3910326fd5 admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:20.684851 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99ea099-3b0e-452a-b450-ea3910326fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:20.684851 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99ea099-3b0e-452a-b450-ea3910326fd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:20.688696 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99ea099-3b0e-452a-b450-ea3910326fd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:20.694763 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99ea099-3b0e-452a-b450-ea3910326fd5 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:20.741391 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 819/1632] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:01:20 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:01:20.741391 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99ea099-3b0e-452a-b450-ea3910326fd5 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:20.768925 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99ea099-3b0e-452a-b450-ea3910326fd5 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:20.783674 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4363f408-99cf-4d1c-9282-d74cf3ab0841 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8e23d1d2fe24bdf9552e7c2f0ae3424', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:20.785566 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4363f408-99cf-4d1c-9282-d74cf3ab0841 service nova] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:20.785918 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4363f408-99cf-4d1c-9282-d74cf3ab0841 service nova] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:20.786201 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4363f408-99cf-4d1c-9282-d74cf3ab0841 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:20.811312 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 814/1633] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:01:20 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:01:20.812162 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcf7c7e-fb58-4104-8959-e6f3426fea7e None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:20.825674 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcf7c7e-fb58-4104-8959-e6f3426fea7e None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:20.831961 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd91b72-7aa3-437b-873d-e0f28b845cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:20.832496 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd91b72-7aa3-437b-873d-e0f28b845cc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:20.832823 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd91b72-7aa3-437b-873d-e0f28b845cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:20.833096 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd91b72-7aa3-437b-873d-e0f28b845cc8 admin admin] PATH_INFO: `/v3/projects/7d54b0bcd5d5451ba84a644daac950d1/users/38fa39eba2094094bf3e7b53d4330c42/roles/d6e7421d1ff9451c808004b818354550` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:20.852722 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd91b72-7aa3-437b-873d-e0f28b845cc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d54b0bcd5d5451ba84a644daac950d1, user_id=38fa39eba2094094bf3e7b53d4330c42, role_id=d6e7421d1ff9451c808004b818354550)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:20.872047 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd91b72-7aa3-437b-873d-e0f28b845cc8 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:20.874493 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4363f408-99cf-4d1c-9282-d74cf3ab0841 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:20.876495 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4363f408-99cf-4d1c-9282-d74cf3ab0841 service nova] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:20.889509 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 820/1634] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:01:20 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:01:20.891579 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4363f408-99cf-4d1c-9282-d74cf3ab0841 service nova] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:20.913638 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4363f408-99cf-4d1c-9282-d74cf3ab0841 service nova] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:20.918008 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c474e6c5-c2db-49d6-a9ed-b5ae87bc5edb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e2a05b782424ab2928b5864f1bfd556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:20.919347 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c474e6c5-c2db-49d6-a9ed-b5ae87bc5edb service cinder] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:20.919347 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c474e6c5-c2db-49d6-a9ed-b5ae87bc5edb service cinder] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:20.919997 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c474e6c5-c2db-49d6-a9ed-b5ae87bc5edb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:20.931309 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c474e6c5-c2db-49d6-a9ed-b5ae87bc5edb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:20.933123 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c474e6c5-c2db-49d6-a9ed-b5ae87bc5edb service cinder] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:20.957825 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 821/1635] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:01:20 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:01:20.959978 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:01:21.011859 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 815/1636] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Oct 4 12:01:20 2022] PUT /identity/v3/projects/7d54b0bcd5d5451ba84a644daac950d1/users/38fa39eba2094094bf3e7b53d4330c42/roles/d6e7421d1ff9451c808004b818354550 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:01:21.016387 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c474e6c5-c2db-49d6-a9ed-b5ae87bc5edb service cinder] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:21.032578 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c474e6c5-c2db-49d6-a9ed-b5ae87bc5edb service cinder] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:21.163437 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be1e66a-ee59-46a8-85d7-a6fa99646d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:21.684545 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be1e66a-ee59-46a8-85d7-a6fa99646d3b admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:21.684545 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be1e66a-ee59-46a8-85d7-a6fa99646d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:21.684545 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be1e66a-ee59-46a8-85d7-a6fa99646d3b admin admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:21.684545 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be1e66a-ee59-46a8-85d7-a6fa99646d3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:21.684545 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be1e66a-ee59-46a8-85d7-a6fa99646d3b admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:21.684545 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 822/1637] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:01:21 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:01:21.687279 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd91b72-7aa3-437b-873d-e0f28b845cc8 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:21.687279 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd91b72-7aa3-437b-873d-e0f28b845cc8 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:21.687279 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49574142-c135-4275-ab1b-e2b59dd61a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:21.687279 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49574142-c135-4275-ab1b-e2b59dd61a53 admin admin] REQUEST_METHOD: `PUT` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:21.688816 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49574142-c135-4275-ab1b-e2b59dd61a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:21.688816 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49574142-c135-4275-ab1b-e2b59dd61a53 admin admin] PATH_INFO: `/v3/projects/7d54b0bcd5d5451ba84a644daac950d1/users/38fa39eba2094094bf3e7b53d4330c42/roles/d6e7421d1ff9451c808004b818354550` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:21.688816 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49574142-c135-4275-ab1b-e2b59dd61a53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d54b0bcd5d5451ba84a644daac950d1, user_id=38fa39eba2094094bf3e7b53d4330c42, role_id=d6e7421d1ff9451c808004b818354550)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:21.688816 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49574142-c135-4275-ab1b-e2b59dd61a53 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:21.689419 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b310ee0-9d03-4626-9e3d-14e29e0422c4 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:21.689419 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b310ee0-9d03-4626-9e3d-14e29e0422c4 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:21.689419 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b310ee0-9d03-4626-9e3d-14e29e0422c4 None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:21.689419 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 823/1639] 10.222.0.59 () {54 vars in 912 bytes} [Tue Oct 4 12:01:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 12:01:21.690267 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 816/1639] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Oct 4 12:01:21 2022] PUT /identity/v3/projects/7d54b0bcd5d5451ba84a644daac950d1/users/38fa39eba2094094bf3e7b53d4330c42/roles/d6e7421d1ff9451c808004b818354550 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:01:21.692039 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b64576-3ee3-4c48-8633-a4d9e9f93b36 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:21.692039 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b64576-3ee3-4c48-8633-a4d9e9f93b36 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:21.692039 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b64576-3ee3-4c48-8633-a4d9e9f93b36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:21.694574 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b75df5-b3e8-4354-a8ee-fb99a6a07d77 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:21.694574 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b75df5-b3e8-4354-a8ee-fb99a6a07d77 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:21.694574 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b75df5-b3e8-4354-a8ee-fb99a6a07d77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:21.694574 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-21b75df5-b3e8-4354-a8ee-fb99a6a07d77 None None] MFA Rules not processed for user `a8e23d1d2fe24bdf9552e7c2f0ae3424`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:01:21.694574 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-21b75df5-b3e8-4354-a8ee-fb99a6a07d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:01:21.697200 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-85b64576-3ee3-4c48-8633-a4d9e9f93b36 None None] MFA Rules not processed for user `38fa39eba2094094bf3e7b53d4330c42`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:01:21.697200 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-85b64576-3ee3-4c48-8633-a4d9e9f93b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:01:21.697981 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 817/1640] 10.222.0.59 () {58 vars in 1009 bytes} [Tue Oct 4 12:01:21 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:01:21.697981 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b75df5-b3e8-4354-a8ee-fb99a6a07d77 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:21.698192 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 824/1641] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:01:21 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:01:21.698304 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b75df5-b3e8-4354-a8ee-fb99a6a07d77 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:21.698304 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e881ed3c-67c3-488e-a3b4-0c2d64aac25e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e2a05b782424ab2928b5864f1bfd556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:21.698304 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e881ed3c-67c3-488e-a3b4-0c2d64aac25e service cinder] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:21.698304 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e881ed3c-67c3-488e-a3b4-0c2d64aac25e service cinder] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:21.698770 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e881ed3c-67c3-488e-a3b4-0c2d64aac25e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:21.698770 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e881ed3c-67c3-488e-a3b4-0c2d64aac25e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:21.698770 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e881ed3c-67c3-488e-a3b4-0c2d64aac25e service cinder] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:21.698770 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 818/1642] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:01:21 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:01:22.323215 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b64576-3ee3-4c48-8633-a4d9e9f93b36 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:22.341401 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b64576-3ee3-4c48-8633-a4d9e9f93b36 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:22.346024 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc9ef8b-fb33-4558-a980-74a66c0c421f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e2a05b782424ab2928b5864f1bfd556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:22.347146 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc9ef8b-fb33-4558-a980-74a66c0c421f service cinder] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:22.347527 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc9ef8b-fb33-4558-a980-74a66c0c421f service cinder] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:22.347896 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc9ef8b-fb33-4558-a980-74a66c0c421f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:22.363647 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc9ef8b-fb33-4558-a980-74a66c0c421f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:22.365354 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc9ef8b-fb33-4558-a980-74a66c0c421f service cinder] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:22.378776 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 825/1643] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:01:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:01:22.421938 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:01:22.568505 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e881ed3c-67c3-488e-a3b4-0c2d64aac25e service cinder] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:22.577477 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e881ed3c-67c3-488e-a3b4-0c2d64aac25e service cinder] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:22.581622 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f24965-461d-40d0-b763-a58ad7ddd8a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e2a05b782424ab2928b5864f1bfd556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:22.582308 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f24965-461d-40d0-b763-a58ad7ddd8a4 service cinder] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:22.582593 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f24965-461d-40d0-b763-a58ad7ddd8a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:22.582866 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f24965-461d-40d0-b763-a58ad7ddd8a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:22.592973 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f24965-461d-40d0-b763-a58ad7ddd8a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:22.594445 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f24965-461d-40d0-b763-a58ad7ddd8a4 service cinder] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:22.607343 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 819/1644] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:01:22 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:01:22.933323 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:01:23.255738 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc9ef8b-fb33-4558-a980-74a66c0c421f service cinder] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:23.268513 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc9ef8b-fb33-4558-a980-74a66c0c421f service cinder] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:23.274396 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b4eddb-f825-4828-ad99-4b425e865e9f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e2a05b782424ab2928b5864f1bfd556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:23.286288 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b4eddb-f825-4828-ad99-4b425e865e9f service cinder] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:23.286288 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b4eddb-f825-4828-ad99-4b425e865e9f service cinder] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:23.286288 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b4eddb-f825-4828-ad99-4b425e865e9f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:23.376589 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b4eddb-f825-4828-ad99-4b425e865e9f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:23.378077 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b4eddb-f825-4828-ad99-4b425e865e9f service cinder] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:23.401409 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 826/1645] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:01:23 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:01:27.021026 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f24965-461d-40d0-b763-a58ad7ddd8a4 service cinder] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:27.161113 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:01:27.187467 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f24965-461d-40d0-b763-a58ad7ddd8a4 service cinder] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:27.199303 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3888673-4954-452c-a513-610c12d3c249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:27.201493 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3888673-4954-452c-a513-610c12d3c249 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:27.203697 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3888673-4954-452c-a513-610c12d3c249 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:27.204184 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3888673-4954-452c-a513-610c12d3c249 admin admin] PATH_INFO: `/v3/users/d132067762eb4b58ac5d52606f52b3b7` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:27.206237 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3888673-4954-452c-a513-610c12d3c249 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d132067762eb4b58ac5d52606f52b3b7)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:27.207529 dv-cinder-860212-2-smb devstack@keystone.service[98475]: WARNING py.warnings [None req-e3888673-4954-452c-a513-610c12d3c249 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 12:01:27.207529 dv-cinder-860212-2-smb devstack@keystone.service[98475]: warnings.warn(msg) Oct 04 12:01:27.207529 dv-cinder-860212-2-smb devstack@keystone.service[98475]: Oct 04 12:01:27.209607 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3888673-4954-452c-a513-610c12d3c249 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:27.559881 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-e3888673-4954-452c-a513-610c12d3c249 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd132067762eb4b58ac5d52606f52b3b7'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:01:27.595864 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-e3888673-4954-452c-a513-610c12d3c249 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd132067762eb4b58ac5d52606f52b3b7'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:01:27.596672 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-e3888673-4954-452c-a513-610c12d3c249 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd132067762eb4b58ac5d52606f52b3b7'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:01:27.601700 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-e3888673-4954-452c-a513-610c12d3c249 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd132067762eb4b58ac5d52606f52b3b7'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:01:27.701697 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-e3888673-4954-452c-a513-610c12d3c249 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd132067762eb4b58ac5d52606f52b3b7'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:01:27.791017 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 820/1646] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Oct 4 12:01:27 2022] DELETE /identity/v3/users/d132067762eb4b58ac5d52606f52b3b7 => generated 0 bytes in 768 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:01:27.792762 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62b51d0-5ddc-4b77-badc-818ee3a16dfa None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:27.793281 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62b51d0-5ddc-4b77-badc-818ee3a16dfa None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:27.793361 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62b51d0-5ddc-4b77-badc-818ee3a16dfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:27.848550 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-f62b51d0-5ddc-4b77-badc-818ee3a16dfa None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:01:27.850470 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-f62b51d0-5ddc-4b77-badc-818ee3a16dfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:01:27.952260 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:01:27.994284 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 827/1647] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:01:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:01:28.055471 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3888673-4954-452c-a513-610c12d3c249 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:28.064188 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-e3888673-4954-452c-a513-610c12d3c249 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:01:28.192126 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3888673-4954-452c-a513-610c12d3c249 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:28.202509 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc873691-8c8b-45b3-8563-4cd3829fa52a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7289515c5c44914a19daa439de98cb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:28.203156 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc873691-8c8b-45b3-8563-4cd3829fa52a service neutron] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:28.203441 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc873691-8c8b-45b3-8563-4cd3829fa52a service neutron] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:28.204145 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc873691-8c8b-45b3-8563-4cd3829fa52a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:28.232012 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc873691-8c8b-45b3-8563-4cd3829fa52a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:28.238262 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc873691-8c8b-45b3-8563-4cd3829fa52a service neutron] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:28.254293 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 821/1648] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:01:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:01:28.477070 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62b51d0-5ddc-4b77-badc-818ee3a16dfa None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:28.478636 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-f62b51d0-5ddc-4b77-badc-818ee3a16dfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:01:28.503112 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62b51d0-5ddc-4b77-badc-818ee3a16dfa None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:28.512713 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aca11c-46a3-4c87-9b5a-3285fe0ce046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:28.513375 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aca11c-46a3-4c87-9b5a-3285fe0ce046 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:28.513657 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aca11c-46a3-4c87-9b5a-3285fe0ce046 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:28.513929 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aca11c-46a3-4c87-9b5a-3285fe0ce046 admin admin] PATH_INFO: `/v3/users/1e4dc3d2afc34b8dad06d34d74c85648` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:28.515088 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aca11c-46a3-4c87-9b5a-3285fe0ce046 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e4dc3d2afc34b8dad06d34d74c85648)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:28.517046 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aca11c-46a3-4c87-9b5a-3285fe0ce046 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:28.903254 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-d6aca11c-46a3-4c87-9b5a-3285fe0ce046 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e4dc3d2afc34b8dad06d34d74c85648'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:01:28.925074 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-d6aca11c-46a3-4c87-9b5a-3285fe0ce046 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e4dc3d2afc34b8dad06d34d74c85648'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:01:28.926618 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-d6aca11c-46a3-4c87-9b5a-3285fe0ce046 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e4dc3d2afc34b8dad06d34d74c85648'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:01:28.929204 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-d6aca11c-46a3-4c87-9b5a-3285fe0ce046 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e4dc3d2afc34b8dad06d34d74c85648'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:01:29.007391 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-d6aca11c-46a3-4c87-9b5a-3285fe0ce046 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e4dc3d2afc34b8dad06d34d74c85648'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:01:29.062852 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 828/1649] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Oct 4 12:01:28 2022] DELETE /identity/v3/users/1e4dc3d2afc34b8dad06d34d74c85648 => generated 0 bytes in 584 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:01:29.065620 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f5ce2a-ec0f-41a8-ade2-eb5a7075f19f None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:29.066523 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f5ce2a-ec0f-41a8-ade2-eb5a7075f19f None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:29.067041 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f5ce2a-ec0f-41a8-ade2-eb5a7075f19f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:29.107582 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-42f5ce2a-ec0f-41a8-ade2-eb5a7075f19f None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:01:29.109878 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-42f5ce2a-ec0f-41a8-ade2-eb5a7075f19f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:01:29.280976 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 822/1650] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:01:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:01:29.345114 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aca11c-46a3-4c87-9b5a-3285fe0ce046 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:29.347576 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-d6aca11c-46a3-4c87-9b5a-3285fe0ce046 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:01:29.490420 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aca11c-46a3-4c87-9b5a-3285fe0ce046 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:29.503766 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa31cd23-b4b4-471b-817c-5d9a1f7bd33d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7289515c5c44914a19daa439de98cb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:29.504568 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa31cd23-b4b4-471b-817c-5d9a1f7bd33d service neutron] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:29.505013 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa31cd23-b4b4-471b-817c-5d9a1f7bd33d service neutron] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:29.505419 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa31cd23-b4b4-471b-817c-5d9a1f7bd33d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:29.534567 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa31cd23-b4b4-471b-817c-5d9a1f7bd33d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:29.536288 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa31cd23-b4b4-471b-817c-5d9a1f7bd33d service neutron] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:29.562166 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 829/1651] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:01:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 12:01:29.907873 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f5ce2a-ec0f-41a8-ade2-eb5a7075f19f None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:29.909437 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-42f5ce2a-ec0f-41a8-ade2-eb5a7075f19f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:01:29.929320 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f5ce2a-ec0f-41a8-ade2-eb5a7075f19f None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:29.944348 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8040533a-101c-4b47-8032-6df84ef77575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:29.948166 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8040533a-101c-4b47-8032-6df84ef77575 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:29.948166 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8040533a-101c-4b47-8032-6df84ef77575 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:29.948166 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8040533a-101c-4b47-8032-6df84ef77575 admin admin] PATH_INFO: `/v3/projects/5c2729152cf54940b21eb0234e797f8f` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:29.951680 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8040533a-101c-4b47-8032-6df84ef77575 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c2729152cf54940b21eb0234e797f8f)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:29.953841 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8040533a-101c-4b47-8032-6df84ef77575 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:29.987229 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:01:30.163500 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-8040533a-101c-4b47-8032-6df84ef77575 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c2729152cf54940b21eb0234e797f8f', 'request_id': 'req-8040533a-101c-4b47-8032-6df84ef77575'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:01:30.399089 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-8040533a-101c-4b47-8032-6df84ef77575 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c2729152cf54940b21eb0234e797f8f', 'request_id': 'req-8040533a-101c-4b47-8032-6df84ef77575'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:01:30.410568 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-8040533a-101c-4b47-8032-6df84ef77575 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c2729152cf54940b21eb0234e797f8f', 'request_id': 'req-8040533a-101c-4b47-8032-6df84ef77575'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:01:30.450107 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-8040533a-101c-4b47-8032-6df84ef77575 admin admin] The token cache is being invalidate because project 5c2729152cf54940b21eb0234e797f8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:01:30.454641 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-8040533a-101c-4b47-8032-6df84ef77575 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:01:30.455076 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-8040533a-101c-4b47-8032-6df84ef77575 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:01:30.462883 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 823/1652] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Oct 4 12:01:29 2022] DELETE /identity/v3/projects/5c2729152cf54940b21eb0234e797f8f => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:01:30.464056 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ebf9e4-e023-448a-8d08-6be97cbc06f1 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:30.464518 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ebf9e4-e023-448a-8d08-6be97cbc06f1 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:30.464764 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ebf9e4-e023-448a-8d08-6be97cbc06f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:30.527875 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-14ebf9e4-e023-448a-8d08-6be97cbc06f1 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:01:30.531694 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-14ebf9e4-e023-448a-8d08-6be97cbc06f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:01:30.752264 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:01:30.772497 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 830/1653] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:01:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 12:01:30.781586 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25264c5-3014-487b-86f3-624bbc74e7d8 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:30.781586 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25264c5-3014-487b-86f3-624bbc74e7d8 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:30.781586 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25264c5-3014-487b-86f3-624bbc74e7d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:30.796849 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ebf9e4-e023-448a-8d08-6be97cbc06f1 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:30.798327 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-14ebf9e4-e023-448a-8d08-6be97cbc06f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:01:30.817248 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ebf9e4-e023-448a-8d08-6be97cbc06f1 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:30.820487 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-b25264c5-3014-487b-86f3-624bbc74e7d8 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:01:30.823916 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-b25264c5-3014-487b-86f3-624bbc74e7d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:01:30.831331 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380b8204-f046-4f66-b00d-a005872bf80f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:30.832001 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380b8204-f046-4f66-b00d-a005872bf80f admin admin] REQUEST_METHOD: `DELETE` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:30.832284 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380b8204-f046-4f66-b00d-a005872bf80f admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:30.832563 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380b8204-f046-4f66-b00d-a005872bf80f admin admin] PATH_INFO: `/v3/users/78d48749277d4c689a521aabe12f0ebc` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:30.835357 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380b8204-f046-4f66-b00d-a005872bf80f admin admin] RBAC: Authorizing `identity:delete_user(user_id=78d48749277d4c689a521aabe12f0ebc)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:30.837358 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380b8204-f046-4f66-b00d-a005872bf80f admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:30.860362 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 824/1654] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:01:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:01:30.864796 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25264c5-3014-487b-86f3-624bbc74e7d8 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:30.897538 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25264c5-3014-487b-86f3-624bbc74e7d8 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:30.921467 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9ef986-e220-44ad-b301-c708b520e10b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:30.922101 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9ef986-e220-44ad-b301-c708b520e10b admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:30.922378 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9ef986-e220-44ad-b301-c708b520e10b admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:30.922647 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9ef986-e220-44ad-b301-c708b520e10b admin admin] PATH_INFO: `/v3/domains` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:30.923353 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9ef986-e220-44ad-b301-c708b520e10b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:01:30.923659 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9ef986-e220-44ad-b301-c708b520e10b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:30.925348 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9ef986-e220-44ad-b301-c708b520e10b admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:30.974026 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 825/1655] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Oct 4 12:01:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 12:01:30.979748 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9ef986-e220-44ad-b301-c708b520e10b admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:31.014720 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9ef986-e220-44ad-b301-c708b520e10b admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:31.024356 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa528a61-e47a-4cf5-80ca-81818cd25e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:31.027031 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa528a61-e47a-4cf5-80ca-81818cd25e23 admin admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:31.027384 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa528a61-e47a-4cf5-80ca-81818cd25e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:31.028488 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa528a61-e47a-4cf5-80ca-81818cd25e23 admin admin] PATH_INFO: `/v3/projects` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:31.029190 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa528a61-e47a-4cf5-80ca-81818cd25e23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:31.032633 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa528a61-e47a-4cf5-80ca-81818cd25e23 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:31.172331 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 826/1656] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Oct 4 12:01:30 2022] POST /identity/v3/projects => generated 363 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 12:01:31.174854 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa528a61-e47a-4cf5-80ca-81818cd25e23 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:31.183397 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-380b8204-f046-4f66-b00d-a005872bf80f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78d48749277d4c689a521aabe12f0ebc'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:01:31.195688 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-380b8204-f046-4f66-b00d-a005872bf80f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78d48749277d4c689a521aabe12f0ebc'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:01:31.210452 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-380b8204-f046-4f66-b00d-a005872bf80f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78d48749277d4c689a521aabe12f0ebc'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:01:31.210452 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-380b8204-f046-4f66-b00d-a005872bf80f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78d48749277d4c689a521aabe12f0ebc'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:01:31.321252 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa528a61-e47a-4cf5-80ca-81818cd25e23 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:31.328344 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e334c3-73ce-435f-bc69-490ad6feb97c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:31.330537 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e334c3-73ce-435f-bc69-490ad6feb97c admin admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:31.330830 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e334c3-73ce-435f-bc69-490ad6feb97c admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:31.331108 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e334c3-73ce-435f-bc69-490ad6feb97c admin admin] PATH_INFO: `/v3/users` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:31.331892 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e334c3-73ce-435f-bc69-490ad6feb97c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:31.335731 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e334c3-73ce-435f-bc69-490ad6feb97c admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:31.458928 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-380b8204-f046-4f66-b00d-a005872bf80f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78d48749277d4c689a521aabe12f0ebc'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:01:31.499433 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 831/1657] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Oct 4 12:01:30 2022] DELETE /identity/v3/users/78d48749277d4c689a521aabe12f0ebc => generated 0 bytes in 700 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:01:31.501747 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8ecadb-0674-4318-afe3-466e9461cbeb None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:31.502316 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8ecadb-0674-4318-afe3-466e9461cbeb None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:31.504952 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8ecadb-0674-4318-afe3-466e9461cbeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:31.577715 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-3c8ecadb-0674-4318-afe3-466e9461cbeb None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:01:31.582237 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-3c8ecadb-0674-4318-afe3-466e9461cbeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:01:31.635352 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 827/1658] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Oct 4 12:01:31 2022] POST /identity/v3/users => generated 282 bytes in 462 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:01:31.641705 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e334c3-73ce-435f-bc69-490ad6feb97c admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:31.647345 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-96e334c3-73ce-435f-bc69-490ad6feb97c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:01:31.715691 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e334c3-73ce-435f-bc69-490ad6feb97c admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:31.764408 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 832/1659] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:01:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:01:31.814256 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8ecadb-0674-4318-afe3-466e9461cbeb None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:31.814256 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-3c8ecadb-0674-4318-afe3-466e9461cbeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:01:31.867723 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9492402b-7680-430f-8d1c-aa250595d6ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:31.869789 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9492402b-7680-430f-8d1c-aa250595d6ab admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:31.870580 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9492402b-7680-430f-8d1c-aa250595d6ab admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:31.871061 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9492402b-7680-430f-8d1c-aa250595d6ab admin admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:31.872383 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9492402b-7680-430f-8d1c-aa250595d6ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:31.875115 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9492402b-7680-430f-8d1c-aa250595d6ab admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:31.892171 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 828/1660] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:01:31 2022] GET /identity/v3/roles => generated 1420 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:01:31.897743 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9492402b-7680-430f-8d1c-aa250595d6ab admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:31.922376 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9492402b-7680-430f-8d1c-aa250595d6ab admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:31.943639 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5467a0ca-5572-4a69-931a-6e4cc6f2b6d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:31.944569 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5467a0ca-5572-4a69-931a-6e4cc6f2b6d2 admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:31.945775 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5467a0ca-5572-4a69-931a-6e4cc6f2b6d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:31.946270 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5467a0ca-5572-4a69-931a-6e4cc6f2b6d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:31.947894 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5467a0ca-5572-4a69-931a-6e4cc6f2b6d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:31.953355 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5467a0ca-5572-4a69-931a-6e4cc6f2b6d2 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:31.962739 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8ecadb-0674-4318-afe3-466e9461cbeb None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:31.974622 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 829/1661] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:01:31 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:01:31.975952 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ae2276-b410-4636-9332-1f781495bda7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7289515c5c44914a19daa439de98cb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:31.976586 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ae2276-b410-4636-9332-1f781495bda7 service neutron] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:31.976887 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ae2276-b410-4636-9332-1f781495bda7 service neutron] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:31.977182 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ae2276-b410-4636-9332-1f781495bda7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:31.980644 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5467a0ca-5572-4a69-931a-6e4cc6f2b6d2 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:31.989626 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ae2276-b410-4636-9332-1f781495bda7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:31.991695 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ae2276-b410-4636-9332-1f781495bda7 service neutron] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:31.999197 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5467a0ca-5572-4a69-931a-6e4cc6f2b6d2 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:32.007903 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 833/1662] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:01:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:01:32.009173 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f20f06-ad96-4819-9d09-6cd484048d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:32.009962 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f20f06-ad96-4819-9d09-6cd484048d99 admin admin] REQUEST_METHOD: `PUT` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:32.010280 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ae2276-b410-4636-9332-1f781495bda7 service neutron] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:32.010389 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f20f06-ad96-4819-9d09-6cd484048d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:32.011280 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f20f06-ad96-4819-9d09-6cd484048d99 admin admin] PATH_INFO: `/v3/projects/3db30d5967dd4b0ca08cc8017f7592c0/users/648ecd685dee47f583b4f9ec13ecae5c/roles/ab4307f3b7994c1c80036fa7db93b6b9` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:32.013820 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-50ae2276-b410-4636-9332-1f781495bda7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:01:32.053615 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f20f06-ad96-4819-9d09-6cd484048d99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3db30d5967dd4b0ca08cc8017f7592c0, user_id=648ecd685dee47f583b4f9ec13ecae5c, role_id=ab4307f3b7994c1c80036fa7db93b6b9)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:32.054244 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ae2276-b410-4636-9332-1f781495bda7 service neutron] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:32.056316 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f20f06-ad96-4819-9d09-6cd484048d99 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:32.060041 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8422f17e-a8a8-4bde-80c2-e037e7f9a9b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:32.061532 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8422f17e-a8a8-4bde-80c2-e037e7f9a9b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:32.061982 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8422f17e-a8a8-4bde-80c2-e037e7f9a9b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:32.062416 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8422f17e-a8a8-4bde-80c2-e037e7f9a9b0 admin admin] PATH_INFO: `/v3/projects/0280ab10a201437080e40643c7a5d1c7` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:32.064673 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8422f17e-a8a8-4bde-80c2-e037e7f9a9b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0280ab10a201437080e40643c7a5d1c7)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:32.066441 dv-cinder-860212-2-smb devstack@keystone.service[98474]: WARNING py.warnings [None req-8422f17e-a8a8-4bde-80c2-e037e7f9a9b0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 12:01:32.066441 dv-cinder-860212-2-smb devstack@keystone.service[98474]: warnings.warn(msg) Oct 04 12:01:32.066441 dv-cinder-860212-2-smb devstack@keystone.service[98474]: Oct 04 12:01:32.068384 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8422f17e-a8a8-4bde-80c2-e037e7f9a9b0 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:32.246938 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 830/1663] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Oct 4 12:01:31 2022] PUT /identity/v3/projects/3db30d5967dd4b0ca08cc8017f7592c0/users/648ecd685dee47f583b4f9ec13ecae5c/roles/ab4307f3b7994c1c80036fa7db93b6b9 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:01:32.259526 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239ad2de-ab76-4157-8bf6-373a6b543f40 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:32.260376 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239ad2de-ab76-4157-8bf6-373a6b543f40 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:32.260909 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239ad2de-ab76-4157-8bf6-373a6b543f40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:32.307753 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-8422f17e-a8a8-4bde-80c2-e037e7f9a9b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0280ab10a201437080e40643c7a5d1c7', 'request_id': 'req-8422f17e-a8a8-4bde-80c2-e037e7f9a9b0'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:01:32.339875 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-8422f17e-a8a8-4bde-80c2-e037e7f9a9b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0280ab10a201437080e40643c7a5d1c7', 'request_id': 'req-8422f17e-a8a8-4bde-80c2-e037e7f9a9b0'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:01:32.346093 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-239ad2de-ab76-4157-8bf6-373a6b543f40 None None] MFA Rules not processed for user `648ecd685dee47f583b4f9ec13ecae5c`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:01:32.348668 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-239ad2de-ab76-4157-8bf6-373a6b543f40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:01:32.422418 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-8422f17e-a8a8-4bde-80c2-e037e7f9a9b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0280ab10a201437080e40643c7a5d1c7', 'request_id': 'req-8422f17e-a8a8-4bde-80c2-e037e7f9a9b0'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:01:32.465679 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-8422f17e-a8a8-4bde-80c2-e037e7f9a9b0 admin admin] The token cache is being invalidate because project 0280ab10a201437080e40643c7a5d1c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:01:32.465991 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-8422f17e-a8a8-4bde-80c2-e037e7f9a9b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:01:32.470405 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-8422f17e-a8a8-4bde-80c2-e037e7f9a9b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:01:32.478670 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 834/1664] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Oct 4 12:01:32 2022] DELETE /identity/v3/projects/0280ab10a201437080e40643c7a5d1c7 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:01:32.485100 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8422f17e-a8a8-4bde-80c2-e037e7f9a9b0 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:32.493891 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-8422f17e-a8a8-4bde-80c2-e037e7f9a9b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:01:32.531875 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 831/1665] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:01:32 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:01:32.537627 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239ad2de-ab76-4157-8bf6-373a6b543f40 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:32.542188 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-239ad2de-ab76-4157-8bf6-373a6b543f40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:01:32.703638 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8422f17e-a8a8-4bde-80c2-e037e7f9a9b0 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:32.714236 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239ad2de-ab76-4157-8bf6-373a6b543f40 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:32.737894 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b960c2df-799a-4a0f-bd28-5942e6e8ddbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:32.737894 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b960c2df-799a-4a0f-bd28-5942e6e8ddbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:32.738308 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f950218-4526-44bd-ab43-a5a2b795e667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:32.738308 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f950218-4526-44bd-ab43-a5a2b795e667 admin admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:32.738308 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f950218-4526-44bd-ab43-a5a2b795e667 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:32.738308 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f950218-4526-44bd-ab43-a5a2b795e667 admin admin] PATH_INFO: `/v3/projects` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:32.738706 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f950218-4526-44bd-ab43-a5a2b795e667 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:32.738921 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b960c2df-799a-4a0f-bd28-5942e6e8ddbe admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:32.738990 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f950218-4526-44bd-ab43-a5a2b795e667 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:32.739054 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b960c2df-799a-4a0f-bd28-5942e6e8ddbe admin admin] PATH_INFO: `/v3/users/cc47d7b172ad4088a957a3515a0e0aa2` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:32.739054 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b960c2df-799a-4a0f-bd28-5942e6e8ddbe admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc47d7b172ad4088a957a3515a0e0aa2)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:32.745625 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b960c2df-799a-4a0f-bd28-5942e6e8ddbe admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:32.962618 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 832/1666] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Oct 4 12:01:32 2022] POST /identity/v3/projects => generated 363 bytes in 424 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:01:32.963324 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981ee761-5be5-49e8-a909-d9b421f4dde5 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:32.963423 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981ee761-5be5-49e8-a909-d9b421f4dde5 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:32.963663 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981ee761-5be5-49e8-a909-d9b421f4dde5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:33.079058 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-981ee761-5be5-49e8-a909-d9b421f4dde5 None None] MFA Rules not processed for user `39a8f928f83449d08a766f9c5303b31b`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:01:33.092183 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-981ee761-5be5-49e8-a909-d9b421f4dde5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:01:33.360132 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-b960c2df-799a-4a0f-bd28-5942e6e8ddbe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc47d7b172ad4088a957a3515a0e0aa2'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:01:33.403180 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-b960c2df-799a-4a0f-bd28-5942e6e8ddbe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc47d7b172ad4088a957a3515a0e0aa2'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:01:33.409316 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-b960c2df-799a-4a0f-bd28-5942e6e8ddbe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc47d7b172ad4088a957a3515a0e0aa2'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:01:33.417249 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-b960c2df-799a-4a0f-bd28-5942e6e8ddbe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc47d7b172ad4088a957a3515a0e0aa2'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:01:33.515802 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 833/1667] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:01:32 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 553 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:01:33.517397 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981ee761-5be5-49e8-a909-d9b421f4dde5 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:33.650446 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-b960c2df-799a-4a0f-bd28-5942e6e8ddbe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc47d7b172ad4088a957a3515a0e0aa2'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:01:33.707053 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 835/1668] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Oct 4 12:01:32 2022] DELETE /identity/v3/users/cc47d7b172ad4088a957a3515a0e0aa2 => generated 0 bytes in 1223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:01:33.709677 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef806cd5-2890-40ab-9e30-3955d5b0593b None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:33.711236 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981ee761-5be5-49e8-a909-d9b421f4dde5 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:33.716073 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef806cd5-2890-40ab-9e30-3955d5b0593b None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:33.717186 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef806cd5-2890-40ab-9e30-3955d5b0593b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:33.770726 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-ef806cd5-2890-40ab-9e30-3955d5b0593b None None] MFA Rules not processed for user `39a8f928f83449d08a766f9c5303b31b`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:01:33.775579 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-ef806cd5-2890-40ab-9e30-3955d5b0593b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:01:33.795881 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:01:33.886740 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d894e141-bd36-47f3-b493-8a62223c77ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:33.887873 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d894e141-bd36-47f3-b493-8a62223c77ef admin admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:33.888308 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d894e141-bd36-47f3-b493-8a62223c77ef admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:33.888775 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d894e141-bd36-47f3-b493-8a62223c77ef admin admin] PATH_INFO: `/v3/users` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:33.889578 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d894e141-bd36-47f3-b493-8a62223c77ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:33.897385 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d894e141-bd36-47f3-b493-8a62223c77ef admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:33.923561 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 836/1669] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:01:33 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:01:33.936504 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef806cd5-2890-40ab-9e30-3955d5b0593b None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:33.938216 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-ef806cd5-2890-40ab-9e30-3955d5b0593b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:01:34.024621 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 834/1670] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Oct 4 12:01:33 2022] POST /identity/v3/users => generated 288 bytes in 507 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:01:34.026635 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d894e141-bd36-47f3-b493-8a62223c77ef admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:34.030116 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-d894e141-bd36-47f3-b493-8a62223c77ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:01:34.069391 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d894e141-bd36-47f3-b493-8a62223c77ef admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:34.087014 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675684f3-bcd0-4923-a914-70a0ab7211fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:34.087656 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675684f3-bcd0-4923-a914-70a0ab7211fa admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:34.087941 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675684f3-bcd0-4923-a914-70a0ab7211fa admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:34.088280 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675684f3-bcd0-4923-a914-70a0ab7211fa admin admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:34.088976 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675684f3-bcd0-4923-a914-70a0ab7211fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:34.091489 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef806cd5-2890-40ab-9e30-3955d5b0593b None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:34.092424 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675684f3-bcd0-4923-a914-70a0ab7211fa admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:34.105543 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6077724c-8bee-4da4-bb71-8fce6b12ee77 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8e23d1d2fe24bdf9552e7c2f0ae3424', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:34.106348 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6077724c-8bee-4da4-bb71-8fce6b12ee77 service nova] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:34.106719 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6077724c-8bee-4da4-bb71-8fce6b12ee77 service nova] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:34.107227 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6077724c-8bee-4da4-bb71-8fce6b12ee77 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:34.112917 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-6077724c-8bee-4da4-bb71-8fce6b12ee77 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:01:34.131811 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6077724c-8bee-4da4-bb71-8fce6b12ee77 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:34.133063 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 835/1671] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:01:34 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:01:34.134429 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6077724c-8bee-4da4-bb71-8fce6b12ee77 service nova] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:34.137339 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675684f3-bcd0-4923-a914-70a0ab7211fa admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:34.148111 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 837/1672] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:01:33 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:01:34.168873 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675684f3-bcd0-4923-a914-70a0ab7211fa admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:34.181955 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:01:34.185210 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7ace39-028e-4d22-a1c1-f88113a60fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:34.186469 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7ace39-028e-4d22-a1c1-f88113a60fbb admin admin] REQUEST_METHOD: `PUT` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:34.194047 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7ace39-028e-4d22-a1c1-f88113a60fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:34.194047 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7ace39-028e-4d22-a1c1-f88113a60fbb admin admin] PATH_INFO: `/v3/projects/c42475880ada4eb899be7b84f1294a58/users/f946e435290f414d80dcaa5d5bb24f19/roles/d6e7421d1ff9451c808004b818354550` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:34.215775 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7ace39-028e-4d22-a1c1-f88113a60fbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=c42475880ada4eb899be7b84f1294a58, user_id=f946e435290f414d80dcaa5d5bb24f19, role_id=d6e7421d1ff9451c808004b818354550)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:34.219537 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7ace39-028e-4d22-a1c1-f88113a60fbb admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:34.283343 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6077724c-8bee-4da4-bb71-8fce6b12ee77 service nova] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:34.284875 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-6077724c-8bee-4da4-bb71-8fce6b12ee77 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:01:34.311845 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 836/1673] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Oct 4 12:01:34 2022] PUT /identity/v3/projects/c42475880ada4eb899be7b84f1294a58/users/f946e435290f414d80dcaa5d5bb24f19/roles/d6e7421d1ff9451c808004b818354550 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:01:34.315927 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6077724c-8bee-4da4-bb71-8fce6b12ee77 service nova] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:34.316079 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7ace39-028e-4d22-a1c1-f88113a60fbb admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:34.541045 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7ace39-028e-4d22-a1c1-f88113a60fbb admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:34.548702 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3394173e-b6ef-4017-aa8e-680053537d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:34.549732 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3394173e-b6ef-4017-aa8e-680053537d66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:34.550439 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3394173e-b6ef-4017-aa8e-680053537d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:34.550750 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e55880-6572-4d00-92a6-bafd4f6450fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:34.551159 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3394173e-b6ef-4017-aa8e-680053537d66 admin admin] PATH_INFO: `/v3/projects/2029905a6474474cb6f706995d3e52fc` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:34.555064 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e55880-6572-4d00-92a6-bafd4f6450fa admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:34.556360 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3394173e-b6ef-4017-aa8e-680053537d66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2029905a6474474cb6f706995d3e52fc)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:34.556653 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e55880-6572-4d00-92a6-bafd4f6450fa admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:34.556977 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e55880-6572-4d00-92a6-bafd4f6450fa admin admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:34.558969 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e55880-6572-4d00-92a6-bafd4f6450fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:34.561911 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e55880-6572-4d00-92a6-bafd4f6450fa admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:34.565621 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3394173e-b6ef-4017-aa8e-680053537d66 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:34.590914 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 837/1674] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:01:34 2022] GET /identity/v3/roles => generated 1420 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:01:34.600971 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e55880-6572-4d00-92a6-bafd4f6450fa admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:34.620774 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e55880-6572-4d00-92a6-bafd4f6450fa admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:34.627794 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb84ac1-0300-44e9-a3cb-487236114065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:34.628488 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb84ac1-0300-44e9-a3cb-487236114065 admin admin] REQUEST_METHOD: `PUT` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:34.631905 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb84ac1-0300-44e9-a3cb-487236114065 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:34.632223 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb84ac1-0300-44e9-a3cb-487236114065 admin admin] PATH_INFO: `/v3/projects/c42475880ada4eb899be7b84f1294a58/users/f946e435290f414d80dcaa5d5bb24f19/roles/d6e7421d1ff9451c808004b818354550` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:34.641207 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb84ac1-0300-44e9-a3cb-487236114065 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c42475880ada4eb899be7b84f1294a58, user_id=f946e435290f414d80dcaa5d5bb24f19, role_id=d6e7421d1ff9451c808004b818354550)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:34.644823 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb84ac1-0300-44e9-a3cb-487236114065 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:34.690119 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 838/1675] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Oct 4 12:01:34 2022] PUT /identity/v3/projects/c42475880ada4eb899be7b84f1294a58/users/f946e435290f414d80dcaa5d5bb24f19/roles/d6e7421d1ff9451c808004b818354550 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:01:34.700974 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef461f6-d151-4cdb-bd8f-8de29f65059d None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:34.701324 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef461f6-d151-4cdb-bd8f-8de29f65059d None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:34.701551 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef461f6-d151-4cdb-bd8f-8de29f65059d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:34.782583 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-2ef461f6-d151-4cdb-bd8f-8de29f65059d None None] MFA Rules not processed for user `f946e435290f414d80dcaa5d5bb24f19`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:01:34.785311 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-2ef461f6-d151-4cdb-bd8f-8de29f65059d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:01:35.000271 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 839/1676] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:01:34 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 12:01:35.011177 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdffae0-1225-4fad-8fac-544b847708c9 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:35.012458 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdffae0-1225-4fad-8fac-544b847708c9 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:35.012759 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdffae0-1225-4fad-8fac-544b847708c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:35.013042 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-3394173e-b6ef-4017-aa8e-680053537d66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2029905a6474474cb6f706995d3e52fc', 'request_id': 'req-3394173e-b6ef-4017-aa8e-680053537d66'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:01:35.023888 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-3394173e-b6ef-4017-aa8e-680053537d66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2029905a6474474cb6f706995d3e52fc', 'request_id': 'req-3394173e-b6ef-4017-aa8e-680053537d66'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:01:35.071414 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-1bdffae0-1225-4fad-8fac-544b847708c9 None None] MFA Rules not processed for user `74861e3dd6e14d999aeae1f057b24582`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:01:35.078766 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-1bdffae0-1225-4fad-8fac-544b847708c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:01:35.201131 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-3394173e-b6ef-4017-aa8e-680053537d66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2029905a6474474cb6f706995d3e52fc', 'request_id': 'req-3394173e-b6ef-4017-aa8e-680053537d66'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:01:35.222845 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-3394173e-b6ef-4017-aa8e-680053537d66 admin admin] The token cache is being invalidate because project 2029905a6474474cb6f706995d3e52fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:01:35.225080 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-3394173e-b6ef-4017-aa8e-680053537d66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:01:35.226978 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-3394173e-b6ef-4017-aa8e-680053537d66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:01:35.230787 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 838/1677] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Oct 4 12:01:34 2022] DELETE /identity/v3/projects/2029905a6474474cb6f706995d3e52fc => generated 0 bytes in 948 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:01:35.234518 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3394173e-b6ef-4017-aa8e-680053537d66 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:35.243560 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-3394173e-b6ef-4017-aa8e-680053537d66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:01:35.342093 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 840/1678] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:01:35 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:01:35.342093 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb1da34-47a8-41ff-94b6-37713edf44fa None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:35.342093 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb1da34-47a8-41ff-94b6-37713edf44fa None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:35.342093 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb1da34-47a8-41ff-94b6-37713edf44fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:35.389286 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-ffb1da34-47a8-41ff-94b6-37713edf44fa None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:01:35.390515 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-ffb1da34-47a8-41ff-94b6-37713edf44fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:01:35.458500 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3394173e-b6ef-4017-aa8e-680053537d66 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:35.463770 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab27c5b-b5ea-4df2-9b61-755980dade29 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e2a05b782424ab2928b5864f1bfd556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:35.464534 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab27c5b-b5ea-4df2-9b61-755980dade29 service cinder] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:35.465303 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab27c5b-b5ea-4df2-9b61-755980dade29 service cinder] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:35.465595 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab27c5b-b5ea-4df2-9b61-755980dade29 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:35.486002 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-0ab27c5b-b5ea-4df2-9b61-755980dade29 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:01:35.565830 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 841/1679] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:01:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:01:35.565830 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb1da34-47a8-41ff-94b6-37713edf44fa None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:35.570617 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-ffb1da34-47a8-41ff-94b6-37713edf44fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:01:35.702123 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab27c5b-b5ea-4df2-9b61-755980dade29 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:35.705705 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab27c5b-b5ea-4df2-9b61-755980dade29 service cinder] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:35.764351 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb1da34-47a8-41ff-94b6-37713edf44fa None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:35.781460 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 839/1680] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:01:35 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 550 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:01:35.783373 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b4a987-cd71-451c-b879-63f50e01ac27 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8e23d1d2fe24bdf9552e7c2f0ae3424', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:35.784281 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab27c5b-b5ea-4df2-9b61-755980dade29 service cinder] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:35.784672 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b4a987-cd71-451c-b879-63f50e01ac27 service nova] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:35.784963 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b4a987-cd71-451c-b879-63f50e01ac27 service nova] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:35.785274 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b4a987-cd71-451c-b879-63f50e01ac27 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:35.787789 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-0ab27c5b-b5ea-4df2-9b61-755980dade29 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:01:35.812638 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b4a987-cd71-451c-b879-63f50e01ac27 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:35.816147 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b4a987-cd71-451c-b879-63f50e01ac27 service nova] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:35.840579 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab27c5b-b5ea-4df2-9b61-755980dade29 service cinder] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:35.853044 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 842/1681] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:01:35 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:01:35.854525 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277b2d5f-4541-4aa6-8fd0-6ceae82bf150 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:35.854814 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277b2d5f-4541-4aa6-8fd0-6ceae82bf150 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:35.855096 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277b2d5f-4541-4aa6-8fd0-6ceae82bf150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:35.861392 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79de2d54-fe3f-4c2b-b81a-d2e5c8f2335d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:35.868027 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79de2d54-fe3f-4c2b-b81a-d2e5c8f2335d admin admin] REQUEST_METHOD: `DELETE` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:35.873454 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79de2d54-fe3f-4c2b-b81a-d2e5c8f2335d admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:35.873454 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79de2d54-fe3f-4c2b-b81a-d2e5c8f2335d admin admin] PATH_INFO: `/v3/projects/1153e10b9d5041ae86d16789e8852b86` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:35.876473 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79de2d54-fe3f-4c2b-b81a-d2e5c8f2335d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1153e10b9d5041ae86d16789e8852b86)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:35.884322 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79de2d54-fe3f-4c2b-b81a-d2e5c8f2335d admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:35.890619 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-277b2d5f-4541-4aa6-8fd0-6ceae82bf150 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:01:35.893369 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-277b2d5f-4541-4aa6-8fd0-6ceae82bf150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:01:35.923204 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 843/1682] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:01:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:01:35.923204 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277b2d5f-4541-4aa6-8fd0-6ceae82bf150 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:35.947895 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277b2d5f-4541-4aa6-8fd0-6ceae82bf150 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:35.965494 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378ee7bf-b5ef-4241-a25b-02743fdb6cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:35.966135 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378ee7bf-b5ef-4241-a25b-02743fdb6cfb admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:35.966410 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378ee7bf-b5ef-4241-a25b-02743fdb6cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:35.966681 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378ee7bf-b5ef-4241-a25b-02743fdb6cfb admin admin] PATH_INFO: `/v3/domains` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:35.969583 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378ee7bf-b5ef-4241-a25b-02743fdb6cfb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:01:35.969903 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378ee7bf-b5ef-4241-a25b-02743fdb6cfb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:35.971553 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378ee7bf-b5ef-4241-a25b-02743fdb6cfb admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:36.034380 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 844/1683] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Oct 4 12:01:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:01:36.034690 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378ee7bf-b5ef-4241-a25b-02743fdb6cfb admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:36.071210 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378ee7bf-b5ef-4241-a25b-02743fdb6cfb admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:36.103882 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f4ce78-8803-4b92-bc7d-efa68b40bf9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:36.104843 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f4ce78-8803-4b92-bc7d-efa68b40bf9f admin admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:36.105232 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f4ce78-8803-4b92-bc7d-efa68b40bf9f admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:36.106508 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f4ce78-8803-4b92-bc7d-efa68b40bf9f admin admin] PATH_INFO: `/v3/projects` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:36.115792 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f4ce78-8803-4b92-bc7d-efa68b40bf9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:36.115792 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f4ce78-8803-4b92-bc7d-efa68b40bf9f admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:36.154038 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-79de2d54-fe3f-4c2b-b81a-d2e5c8f2335d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1153e10b9d5041ae86d16789e8852b86', 'request_id': 'req-79de2d54-fe3f-4c2b-b81a-d2e5c8f2335d'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:01:36.190266 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-79de2d54-fe3f-4c2b-b81a-d2e5c8f2335d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1153e10b9d5041ae86d16789e8852b86', 'request_id': 'req-79de2d54-fe3f-4c2b-b81a-d2e5c8f2335d'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:01:36.330254 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-79de2d54-fe3f-4c2b-b81a-d2e5c8f2335d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1153e10b9d5041ae86d16789e8852b86', 'request_id': 'req-79de2d54-fe3f-4c2b-b81a-d2e5c8f2335d'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:01:36.339976 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 845/1684] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Oct 4 12:01:36 2022] POST /identity/v3/projects => generated 371 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:01:36.344123 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f4ce78-8803-4b92-bc7d-efa68b40bf9f admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:36.351592 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-79de2d54-fe3f-4c2b-b81a-d2e5c8f2335d admin admin] The token cache is being invalidate because project 1153e10b9d5041ae86d16789e8852b86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:01:36.351880 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-79de2d54-fe3f-4c2b-b81a-d2e5c8f2335d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:01:36.355941 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-79de2d54-fe3f-4c2b-b81a-d2e5c8f2335d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:01:36.374164 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 840/1685] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Oct 4 12:01:35 2022] DELETE /identity/v3/projects/1153e10b9d5041ae86d16789e8852b86 => generated 0 bytes in 588 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:01:36.378268 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390a0d47-63da-446a-b8d2-892c87bb8571 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:36.378845 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390a0d47-63da-446a-b8d2-892c87bb8571 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:36.379327 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390a0d47-63da-446a-b8d2-892c87bb8571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:36.440160 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-390a0d47-63da-446a-b8d2-892c87bb8571 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:01:36.440160 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-390a0d47-63da-446a-b8d2-892c87bb8571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:01:36.535260 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f4ce78-8803-4b92-bc7d-efa68b40bf9f admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:36.557771 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31cf442-f060-4b41-b24f-ca4fb792aea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:36.565115 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31cf442-f060-4b41-b24f-ca4fb792aea1 admin admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:36.565115 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31cf442-f060-4b41-b24f-ca4fb792aea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:36.565115 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31cf442-f060-4b41-b24f-ca4fb792aea1 admin admin] PATH_INFO: `/v3/users` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:36.565115 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31cf442-f060-4b41-b24f-ca4fb792aea1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:36.565115 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31cf442-f060-4b41-b24f-ca4fb792aea1 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:36.636443 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 841/1686] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:01:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:01:36.638013 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac12319-0994-4206-a207-1c01f12717d3 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:36.639777 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac12319-0994-4206-a207-1c01f12717d3 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:36.640370 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac12319-0994-4206-a207-1c01f12717d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:36.704165 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 846/1687] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Oct 4 12:01:36 2022] POST /identity/v3/users => generated 286 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 12:01:36.707965 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327ab80b-c79a-431f-92d9-0c2cc105e761 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:36.708140 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-8ac12319-0994-4206-a207-1c01f12717d3 None None] MFA Rules not processed for user `4fabb75bbc354ac7a3f109edfaefb291`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:01:36.708237 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327ab80b-c79a-431f-92d9-0c2cc105e761 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:36.708658 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327ab80b-c79a-431f-92d9-0c2cc105e761 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:36.710010 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-8ac12319-0994-4206-a207-1c01f12717d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:01:36.730244 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 847/1688] 10.222.0.59 () {54 vars in 912 bytes} [Tue Oct 4 12:01:36 2022] GET /identity => generated 270 bytes in 27 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:01:36.750125 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5586287-adc8-405d-8e7a-e2a46e74f988 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:36.750125 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5586287-adc8-405d-8e7a-e2a46e74f988 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:36.750125 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5586287-adc8-405d-8e7a-e2a46e74f988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:36.801187 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-a5586287-adc8-405d-8e7a-e2a46e74f988 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:01:36.802762 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-a5586287-adc8-405d-8e7a-e2a46e74f988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:01:36.835294 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 848/1689] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:01:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:01:36.838185 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5586287-adc8-405d-8e7a-e2a46e74f988 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:36.841605 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-a5586287-adc8-405d-8e7a-e2a46e74f988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:01:36.872892 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5586287-adc8-405d-8e7a-e2a46e74f988 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:36.874049 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 842/1690] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:01:36 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:01:36.875608 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfcdc39-3d53-4753-b53c-94958b42adca None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:36.876049 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfcdc39-3d53-4753-b53c-94958b42adca None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:36.876513 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfcdc39-3d53-4753-b53c-94958b42adca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:36.889228 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a1b5de-50a2-45d0-b5f1-ea0dd567c64f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:36.889866 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a1b5de-50a2-45d0-b5f1-ea0dd567c64f admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:36.890133 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a1b5de-50a2-45d0-b5f1-ea0dd567c64f admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:36.890406 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a1b5de-50a2-45d0-b5f1-ea0dd567c64f admin admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:36.891045 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a1b5de-50a2-45d0-b5f1-ea0dd567c64f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:36.893275 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a1b5de-50a2-45d0-b5f1-ea0dd567c64f admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:36.909917 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 849/1691] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:01:36 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:01:36.909917 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a1b5de-50a2-45d0-b5f1-ea0dd567c64f admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:36.919732 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a1b5de-50a2-45d0-b5f1-ea0dd567c64f admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:36.924478 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee90cf9-6c51-46c9-aeca-3e061da385a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:36.925467 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee90cf9-6c51-46c9-aeca-3e061da385a3 admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:36.926515 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee90cf9-6c51-46c9-aeca-3e061da385a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:36.926801 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee90cf9-6c51-46c9-aeca-3e061da385a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:36.927595 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee90cf9-6c51-46c9-aeca-3e061da385a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:01:36.927902 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee90cf9-6c51-46c9-aeca-3e061da385a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:36.932556 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee90cf9-6c51-46c9-aeca-3e061da385a3 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:36.957581 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-5cfcdc39-3d53-4753-b53c-94958b42adca None None] MFA Rules not processed for user `e7289515c5c44914a19daa439de98cb1`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:01:36.959994 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-5cfcdc39-3d53-4753-b53c-94958b42adca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:01:36.966678 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 850/1692] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Oct 4 12:01:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:01:36.966678 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73330f5e-c416-41b2-8478-f553f07f3586 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:36.967127 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73330f5e-c416-41b2-8478-f553f07f3586 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:36.967407 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73330f5e-c416-41b2-8478-f553f07f3586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:37.023969 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-73330f5e-c416-41b2-8478-f553f07f3586 None None] MFA Rules not processed for user `4fabb75bbc354ac7a3f109edfaefb291`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:01:37.025932 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-73330f5e-c416-41b2-8478-f553f07f3586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:01:37.042597 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 851/1693] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:01:36 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:01:37.047514 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73330f5e-c416-41b2-8478-f553f07f3586 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:37.049489 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 843/1694] 10.222.0.59 () {58 vars in 1009 bytes} [Tue Oct 4 12:01:36 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:01:37.062523 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfcdc39-3d53-4753-b53c-94958b42adca None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:37.068687 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73330f5e-c416-41b2-8478-f553f07f3586 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:37.079112 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfcdc39-3d53-4753-b53c-94958b42adca None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:37.081143 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975f422e-51e2-4bc7-ae06-e45e792f163f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:37.081792 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975f422e-51e2-4bc7-ae06-e45e792f163f admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:37.082566 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975f422e-51e2-4bc7-ae06-e45e792f163f admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:37.082852 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975f422e-51e2-4bc7-ae06-e45e792f163f admin admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:37.084049 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975f422e-51e2-4bc7-ae06-e45e792f163f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:37.085731 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975f422e-51e2-4bc7-ae06-e45e792f163f admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:37.093142 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011d65fd-582c-4ec8-8539-29f875a9e800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:37.093785 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011d65fd-582c-4ec8-8539-29f875a9e800 admin admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:37.094067 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011d65fd-582c-4ec8-8539-29f875a9e800 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:37.094340 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011d65fd-582c-4ec8-8539-29f875a9e800 admin admin] PATH_INFO: `/v3/projects` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:37.095862 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011d65fd-582c-4ec8-8539-29f875a9e800 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:37.101724 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011d65fd-582c-4ec8-8539-29f875a9e800 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:37.111727 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 852/1695] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:01:37 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:01:37.117226 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bce001b-2e88-4aa5-8e81-beea2b4f370a None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:37.117692 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bce001b-2e88-4aa5-8e81-beea2b4f370a None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:37.118111 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bce001b-2e88-4aa5-8e81-beea2b4f370a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:37.311058 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-1bce001b-2e88-4aa5-8e81-beea2b4f370a None None] MFA Rules not processed for user `6c95a1206a4a4788b47882c7bb3e7a61`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:01:37.311058 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-1bce001b-2e88-4aa5-8e81-beea2b4f370a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:01:37.311058 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 853/1696] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:01:37 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:01:37.311058 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bce001b-2e88-4aa5-8e81-beea2b4f370a None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:37.311058 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-1bce001b-2e88-4aa5-8e81-beea2b4f370a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:01:37.385552 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bce001b-2e88-4aa5-8e81-beea2b4f370a None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:37.391308 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69521e7c-28e8-46b1-a22b-0fe453cc6115 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8e23d1d2fe24bdf9552e7c2f0ae3424', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:37.391930 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69521e7c-28e8-46b1-a22b-0fe453cc6115 service nova] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:37.392216 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69521e7c-28e8-46b1-a22b-0fe453cc6115 service nova] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:37.392493 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69521e7c-28e8-46b1-a22b-0fe453cc6115 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:37.401257 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69521e7c-28e8-46b1-a22b-0fe453cc6115 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:37.402856 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69521e7c-28e8-46b1-a22b-0fe453cc6115 service nova] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:37.412029 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 854/1697] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:01:37 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:01:37.412943 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69521e7c-28e8-46b1-a22b-0fe453cc6115 service nova] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:37.414284 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-69521e7c-28e8-46b1-a22b-0fe453cc6115 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:01:37.428403 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69521e7c-28e8-46b1-a22b-0fe453cc6115 service nova] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:37.431903 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6796fb-68db-4008-a287-6c8736e18b68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7289515c5c44914a19daa439de98cb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:37.432583 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6796fb-68db-4008-a287-6c8736e18b68 service neutron] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:37.432964 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6796fb-68db-4008-a287-6c8736e18b68 service neutron] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:37.433339 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6796fb-68db-4008-a287-6c8736e18b68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:37.441370 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6796fb-68db-4008-a287-6c8736e18b68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:37.443885 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6796fb-68db-4008-a287-6c8736e18b68 service neutron] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:37.452680 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 855/1698] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:01:37 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:01:37.461416 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6796fb-68db-4008-a287-6c8736e18b68 service neutron] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:37.492566 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6796fb-68db-4008-a287-6c8736e18b68 service neutron] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:37.499408 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61db6eb2-8daf-4e6b-81e0-0ac1e445c52d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:37.500272 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61db6eb2-8daf-4e6b-81e0-0ac1e445c52d admin admin] REQUEST_METHOD: `PUT` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:37.500706 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61db6eb2-8daf-4e6b-81e0-0ac1e445c52d admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:37.501083 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61db6eb2-8daf-4e6b-81e0-0ac1e445c52d admin admin] PATH_INFO: `/v3/projects/3726ecad03ec45d182535b00130fa5c5/users/b78fc856c86a465db4d3100b3db2578a/roles/ab4307f3b7994c1c80036fa7db93b6b9` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:37.534176 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61db6eb2-8daf-4e6b-81e0-0ac1e445c52d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3726ecad03ec45d182535b00130fa5c5, user_id=b78fc856c86a465db4d3100b3db2578a, role_id=ab4307f3b7994c1c80036fa7db93b6b9)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:37.538926 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61db6eb2-8daf-4e6b-81e0-0ac1e445c52d admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:37.685384 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 844/1699] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Oct 4 12:01:37 2022] POST /identity/v3/projects => generated 387 bytes in 636 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:01:37.690121 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011d65fd-582c-4ec8-8539-29f875a9e800 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:37.756807 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 856/1700] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Oct 4 12:01:37 2022] PUT /identity/v3/projects/3726ecad03ec45d182535b00130fa5c5/users/b78fc856c86a465db4d3100b3db2578a/roles/ab4307f3b7994c1c80036fa7db93b6b9 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:01:37.770556 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241d544c-a2ae-4eba-844b-15f5baedd1dd None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:37.770556 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241d544c-a2ae-4eba-844b-15f5baedd1dd None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:37.770822 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241d544c-a2ae-4eba-844b-15f5baedd1dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:37.797543 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:01:37.880473 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011d65fd-582c-4ec8-8539-29f875a9e800 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:37.900161 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-241d544c-a2ae-4eba-844b-15f5baedd1dd None None] MFA Rules not processed for user `b78fc856c86a465db4d3100b3db2578a`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:01:37.903061 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-241d544c-a2ae-4eba-844b-15f5baedd1dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:01:37.998766 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:01:38.076926 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29e3044-d9dc-42bb-90ab-3e45bda7fd95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:38.077536 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29e3044-d9dc-42bb-90ab-3e45bda7fd95 admin admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:38.077886 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29e3044-d9dc-42bb-90ab-3e45bda7fd95 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:38.078081 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29e3044-d9dc-42bb-90ab-3e45bda7fd95 admin admin] PATH_INFO: `/v3/users` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:38.078845 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29e3044-d9dc-42bb-90ab-3e45bda7fd95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:38.081155 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29e3044-d9dc-42bb-90ab-3e45bda7fd95 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:38.116388 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 857/1701] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:01:37 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:01:38.117499 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241d544c-a2ae-4eba-844b-15f5baedd1dd None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:38.173670 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241d544c-a2ae-4eba-844b-15f5baedd1dd None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:38.221832 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92a1c63-918d-4f56-a4f0-deb48f85f372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:38.222467 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92a1c63-918d-4f56-a4f0-deb48f85f372 admin admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:38.223401 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92a1c63-918d-4f56-a4f0-deb48f85f372 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:38.223595 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92a1c63-918d-4f56-a4f0-deb48f85f372 admin admin] PATH_INFO: `/v3/projects` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:38.234443 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 845/1702] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Oct 4 12:01:37 2022] POST /identity/v3/users => generated 294 bytes in 545 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:01:38.238519 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29e3044-d9dc-42bb-90ab-3e45bda7fd95 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:38.245785 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92a1c63-918d-4f56-a4f0-deb48f85f372 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:38.247952 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92a1c63-918d-4f56-a4f0-deb48f85f372 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:38.262110 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29e3044-d9dc-42bb-90ab-3e45bda7fd95 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:38.274319 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040b2320-c05e-48d0-9a0e-60b7155c43ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:38.275232 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040b2320-c05e-48d0-9a0e-60b7155c43ac admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:38.275712 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040b2320-c05e-48d0-9a0e-60b7155c43ac admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:38.276182 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040b2320-c05e-48d0-9a0e-60b7155c43ac admin admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:38.277059 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040b2320-c05e-48d0-9a0e-60b7155c43ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:38.278896 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040b2320-c05e-48d0-9a0e-60b7155c43ac admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:38.318819 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 846/1703] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:01:38 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 12:01:38.329749 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040b2320-c05e-48d0-9a0e-60b7155c43ac admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:38.356671 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040b2320-c05e-48d0-9a0e-60b7155c43ac admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:38.369945 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1873c245-5ab3-4ef1-8dc0-fd44722140dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:38.370649 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1873c245-5ab3-4ef1-8dc0-fd44722140dd admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:38.371003 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1873c245-5ab3-4ef1-8dc0-fd44722140dd admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:38.371309 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1873c245-5ab3-4ef1-8dc0-fd44722140dd admin admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:38.375627 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1873c245-5ab3-4ef1-8dc0-fd44722140dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:38.377628 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1873c245-5ab3-4ef1-8dc0-fd44722140dd admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:38.398842 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 847/1704] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:01:38 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:01:38.400550 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1873c245-5ab3-4ef1-8dc0-fd44722140dd admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:38.412248 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1873c245-5ab3-4ef1-8dc0-fd44722140dd admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:38.426299 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829d0acb-5b8a-4fb2-af00-68e908d6ba57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:38.426989 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829d0acb-5b8a-4fb2-af00-68e908d6ba57 admin admin] REQUEST_METHOD: `PUT` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:38.427403 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829d0acb-5b8a-4fb2-af00-68e908d6ba57 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:38.427685 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829d0acb-5b8a-4fb2-af00-68e908d6ba57 admin admin] PATH_INFO: `/v3/projects/3d4aad7ef41c4397b8480519400a731c/users/d482bd76dd99462c88602a47eff678f1/roles/ab4307f3b7994c1c80036fa7db93b6b9` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:38.458135 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829d0acb-5b8a-4fb2-af00-68e908d6ba57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d4aad7ef41c4397b8480519400a731c, user_id=d482bd76dd99462c88602a47eff678f1, role_id=ab4307f3b7994c1c80036fa7db93b6b9)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:38.460897 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829d0acb-5b8a-4fb2-af00-68e908d6ba57 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:38.498025 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 858/1705] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Oct 4 12:01:38 2022] POST /identity/v3/projects => generated 371 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:01:38.498978 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92a1c63-918d-4f56-a4f0-deb48f85f372 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:38.593990 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 848/1706] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Oct 4 12:01:38 2022] PUT /identity/v3/projects/3d4aad7ef41c4397b8480519400a731c/users/d482bd76dd99462c88602a47eff678f1/roles/ab4307f3b7994c1c80036fa7db93b6b9 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:01:38.595132 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829d0acb-5b8a-4fb2-af00-68e908d6ba57 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:38.601754 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-829d0acb-5b8a-4fb2-af00-68e908d6ba57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:01:38.767037 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829d0acb-5b8a-4fb2-af00-68e908d6ba57 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:38.773366 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca235bf6-5b85-4e4d-96ab-d546c5f35b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:38.774158 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca235bf6-5b85-4e4d-96ab-d546c5f35b1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:38.774552 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca235bf6-5b85-4e4d-96ab-d546c5f35b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:38.774922 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca235bf6-5b85-4e4d-96ab-d546c5f35b1a admin admin] PATH_INFO: `/v3/users/648ecd685dee47f583b4f9ec13ecae5c` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:38.776411 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca235bf6-5b85-4e4d-96ab-d546c5f35b1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=648ecd685dee47f583b4f9ec13ecae5c)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:38.778496 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca235bf6-5b85-4e4d-96ab-d546c5f35b1a admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:38.782324 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92a1c63-918d-4f56-a4f0-deb48f85f372 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:38.791233 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85be478-ea43-40bc-a065-b52eb788cb90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:38.791233 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85be478-ea43-40bc-a065-b52eb788cb90 admin admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:38.791510 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85be478-ea43-40bc-a065-b52eb788cb90 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:38.791785 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85be478-ea43-40bc-a065-b52eb788cb90 admin admin] PATH_INFO: `/v3/users` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:38.792445 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85be478-ea43-40bc-a065-b52eb788cb90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:38.794423 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85be478-ea43-40bc-a065-b52eb788cb90 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:38.958422 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 859/1707] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Oct 4 12:01:38 2022] POST /identity/v3/users => generated 292 bytes in 460 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:01:38.960011 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85be478-ea43-40bc-a065-b52eb788cb90 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:38.963392 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-b85be478-ea43-40bc-a065-b52eb788cb90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:01:39.079578 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85be478-ea43-40bc-a065-b52eb788cb90 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:39.094298 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7910cd-9e5a-4d16-8f3d-95bde296e386 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8e23d1d2fe24bdf9552e7c2f0ae3424', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:39.094976 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7910cd-9e5a-4d16-8f3d-95bde296e386 service nova] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:39.095783 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7910cd-9e5a-4d16-8f3d-95bde296e386 service nova] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:39.096064 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7910cd-9e5a-4d16-8f3d-95bde296e386 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:39.143319 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-ca235bf6-5b85-4e4d-96ab-d546c5f35b1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '648ecd685dee47f583b4f9ec13ecae5c'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:01:39.158489 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-ca235bf6-5b85-4e4d-96ab-d546c5f35b1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '648ecd685dee47f583b4f9ec13ecae5c'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:01:39.160266 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-ca235bf6-5b85-4e4d-96ab-d546c5f35b1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '648ecd685dee47f583b4f9ec13ecae5c'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:01:39.162121 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-ca235bf6-5b85-4e4d-96ab-d546c5f35b1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '648ecd685dee47f583b4f9ec13ecae5c'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:01:39.239419 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7910cd-9e5a-4d16-8f3d-95bde296e386 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:39.241349 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7910cd-9e5a-4d16-8f3d-95bde296e386 service nova] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:39.265340 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 860/1708] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:01:38 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:01:39.278231 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7c5a3a-7383-4f52-ae89-10f032ab135e None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:39.280029 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7c5a3a-7383-4f52-ae89-10f032ab135e None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:39.280029 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7c5a3a-7383-4f52-ae89-10f032ab135e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:39.336133 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-ca235bf6-5b85-4e4d-96ab-d546c5f35b1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '648ecd685dee47f583b4f9ec13ecae5c'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:01:39.342262 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-dd7c5a3a-7383-4f52-ae89-10f032ab135e None None] MFA Rules not processed for user `d482bd76dd99462c88602a47eff678f1`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:01:39.343750 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-dd7c5a3a-7383-4f52-ae89-10f032ab135e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:01:39.361042 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 849/1709] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Oct 4 12:01:38 2022] DELETE /identity/v3/users/648ecd685dee47f583b4f9ec13ecae5c => generated 0 bytes in 763 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:01:39.361042 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca235bf6-5b85-4e4d-96ab-d546c5f35b1a admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:39.361042 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-ca235bf6-5b85-4e4d-96ab-d546c5f35b1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:01:39.479278 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:01:39.491978 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 861/1710] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:01:39 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:01:39.494069 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddc455c-0c6d-4f65-8ecb-a71851ba1d12 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:39.498162 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddc455c-0c6d-4f65-8ecb-a71851ba1d12 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:39.498162 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddc455c-0c6d-4f65-8ecb-a71851ba1d12 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:39.503773 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 862/1711] 10.222.0.59 () {54 vars in 912 bytes} [Tue Oct 4 12:01:39 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:01:39.505747 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddc455c-0c6d-4f65-8ecb-a71851ba1d12 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:39.515337 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-7ddc455c-0c6d-4f65-8ecb-a71851ba1d12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:01:39.648928 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca235bf6-5b85-4e4d-96ab-d546c5f35b1a admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:39.655989 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cffeae-a6da-43e6-a3a7-11df8a356964 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be119968b02440adbbbc85c553077b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:39.655989 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cffeae-a6da-43e6-a3a7-11df8a356964 service placement] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:39.655989 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cffeae-a6da-43e6-a3a7-11df8a356964 service placement] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:39.656331 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cffeae-a6da-43e6-a3a7-11df8a356964 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:39.658766 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-74cffeae-a6da-43e6-a3a7-11df8a356964 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:01:39.675490 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cffeae-a6da-43e6-a3a7-11df8a356964 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:39.677427 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cffeae-a6da-43e6-a3a7-11df8a356964 service placement] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:39.694511 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 850/1712] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:01:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:01:39.696062 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f072e1b-9e5a-437f-b251-b418716e1ba6 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:39.696346 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f072e1b-9e5a-437f-b251-b418716e1ba6 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:39.696803 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f072e1b-9e5a-437f-b251-b418716e1ba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:39.709920 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddc455c-0c6d-4f65-8ecb-a71851ba1d12 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:39.715873 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e840299-784d-4e68-b87c-e104246624b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:39.716814 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e840299-784d-4e68-b87c-e104246624b8 admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:39.717267 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e840299-784d-4e68-b87c-e104246624b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:39.717723 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e840299-784d-4e68-b87c-e104246624b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:39.718763 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e840299-784d-4e68-b87c-e104246624b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:39.720696 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e840299-784d-4e68-b87c-e104246624b8 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:39.721102 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-3f072e1b-9e5a-437f-b251-b418716e1ba6 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:01:39.722503 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-3f072e1b-9e5a-437f-b251-b418716e1ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:01:39.732055 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 851/1713] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:01:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:01:39.733089 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f072e1b-9e5a-437f-b251-b418716e1ba6 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:39.734774 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-3f072e1b-9e5a-437f-b251-b418716e1ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:01:39.739322 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 863/1714] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:01:39 2022] GET /identity/v3/roles => generated 1420 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:01:39.741141 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8787ca87-3ffa-4448-adc6-8bbf1b672421 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:39.741643 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8787ca87-3ffa-4448-adc6-8bbf1b672421 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:39.742027 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8787ca87-3ffa-4448-adc6-8bbf1b672421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:39.753249 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f072e1b-9e5a-437f-b251-b418716e1ba6 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:39.761880 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf43fa8f-8123-4d74-aed9-06282b50fea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:39.762781 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf43fa8f-8123-4d74-aed9-06282b50fea7 admin admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:39.763353 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf43fa8f-8123-4d74-aed9-06282b50fea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:39.763772 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf43fa8f-8123-4d74-aed9-06282b50fea7 admin admin] PATH_INFO: `/v3/projects` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:39.765819 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf43fa8f-8123-4d74-aed9-06282b50fea7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:39.769201 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf43fa8f-8123-4d74-aed9-06282b50fea7 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:39.810182 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-8787ca87-3ffa-4448-adc6-8bbf1b672421 None None] MFA Rules not processed for user `e7289515c5c44914a19daa439de98cb1`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:01:39.812622 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-8787ca87-3ffa-4448-adc6-8bbf1b672421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:01:39.896861 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 852/1715] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Oct 4 12:01:39 2022] POST /identity/v3/projects => generated 385 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:01:39.900526 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf43fa8f-8123-4d74-aed9-06282b50fea7 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:40.018064 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 864/1716] 10.222.0.59 () {58 vars in 1009 bytes} [Tue Oct 4 12:01:39 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:01:40.024337 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8787ca87-3ffa-4448-adc6-8bbf1b672421 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:40.026118 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-8787ca87-3ffa-4448-adc6-8bbf1b672421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:01:40.054903 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8787ca87-3ffa-4448-adc6-8bbf1b672421 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:40.121916 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf43fa8f-8123-4d74-aed9-06282b50fea7 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:40.135918 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0acdae-fa2e-476c-a177-27aea2e50daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:40.137359 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0acdae-fa2e-476c-a177-27aea2e50daa admin admin] REQUEST_METHOD: `PUT` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:40.140459 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0acdae-fa2e-476c-a177-27aea2e50daa admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:40.140818 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0acdae-fa2e-476c-a177-27aea2e50daa admin admin] PATH_INFO: `/v3/projects/f930219ea1d34cce8435d351e7f87659/users/28114f9302b24e10b65b4adf6bf1c6d0/roles/d6e7421d1ff9451c808004b818354550` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:40.170808 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a612722-c99a-42ce-b4ed-4150d272b204 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7289515c5c44914a19daa439de98cb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:40.171438 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a612722-c99a-42ce-b4ed-4150d272b204 service neutron] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:40.171721 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a612722-c99a-42ce-b4ed-4150d272b204 service neutron] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:40.171997 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a612722-c99a-42ce-b4ed-4150d272b204 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:40.180402 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0acdae-fa2e-476c-a177-27aea2e50daa admin admin] RBAC: Authorizing `identity:create_grant(project_id=f930219ea1d34cce8435d351e7f87659, user_id=28114f9302b24e10b65b4adf6bf1c6d0, role_id=d6e7421d1ff9451c808004b818354550)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:40.188480 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0acdae-fa2e-476c-a177-27aea2e50daa admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:40.197697 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a612722-c99a-42ce-b4ed-4150d272b204 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:40.199122 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a612722-c99a-42ce-b4ed-4150d272b204 service neutron] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:40.222007 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 865/1717] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:01:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:01:40.223350 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4541379-9f2d-40fc-9ca5-52c5475db484 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:40.223643 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4541379-9f2d-40fc-9ca5-52c5475db484 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:40.227241 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4541379-9f2d-40fc-9ca5-52c5475db484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:40.264370 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-a4541379-9f2d-40fc-9ca5-52c5475db484 None None] MFA Rules not processed for user `39a8f928f83449d08a766f9c5303b31b`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:01:40.265868 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-a4541379-9f2d-40fc-9ca5-52c5475db484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:01:40.296207 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 853/1718] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Oct 4 12:01:39 2022] PUT /identity/v3/projects/f930219ea1d34cce8435d351e7f87659/users/28114f9302b24e10b65b4adf6bf1c6d0/roles/d6e7421d1ff9451c808004b818354550 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:01:40.298481 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0acdae-fa2e-476c-a177-27aea2e50daa admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:40.418532 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 866/1719] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:01:40 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:01:40.420696 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4541379-9f2d-40fc-9ca5-52c5475db484 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:40.464191 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4541379-9f2d-40fc-9ca5-52c5475db484 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:40.483505 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0acdae-fa2e-476c-a177-27aea2e50daa admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:40.502883 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86831d7f-d7ad-486d-b89b-9df8ea865468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:40.503541 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86831d7f-d7ad-486d-b89b-9df8ea865468 admin admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:40.503799 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86831d7f-d7ad-486d-b89b-9df8ea865468 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:40.504157 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86831d7f-d7ad-486d-b89b-9df8ea865468 admin admin] PATH_INFO: `/v3/users` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:40.511351 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86831d7f-d7ad-486d-b89b-9df8ea865468 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:40.524721 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86831d7f-d7ad-486d-b89b-9df8ea865468 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:40.574171 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca6dff8-2ff0-45a0-ad7a-1df30338eb3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7289515c5c44914a19daa439de98cb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:40.575070 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca6dff8-2ff0-45a0-ad7a-1df30338eb3e service neutron] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:40.575498 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca6dff8-2ff0-45a0-ad7a-1df30338eb3e service neutron] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:40.576067 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca6dff8-2ff0-45a0-ad7a-1df30338eb3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:40.615276 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca6dff8-2ff0-45a0-ad7a-1df30338eb3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:40.617837 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca6dff8-2ff0-45a0-ad7a-1df30338eb3e service neutron] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:40.632049 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 867/1720] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:01:40 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:01:40.633392 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca6dff8-2ff0-45a0-ad7a-1df30338eb3e service neutron] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:40.650748 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca6dff8-2ff0-45a0-ad7a-1df30338eb3e service neutron] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:40.657673 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83793ec-77a7-4558-b485-338a2f1481f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:40.658527 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83793ec-77a7-4558-b485-338a2f1481f7 admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:40.658954 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83793ec-77a7-4558-b485-338a2f1481f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:40.659375 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83793ec-77a7-4558-b485-338a2f1481f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:40.660732 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83793ec-77a7-4558-b485-338a2f1481f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:40.663266 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83793ec-77a7-4558-b485-338a2f1481f7 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:40.677697 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 868/1721] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:01:40 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:01:40.678377 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 854/1722] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Oct 4 12:01:40 2022] POST /identity/v3/users => generated 299 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:01:40.682241 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83793ec-77a7-4558-b485-338a2f1481f7 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:40.684131 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86831d7f-d7ad-486d-b89b-9df8ea865468 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:40.696076 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83793ec-77a7-4558-b485-338a2f1481f7 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:40.702314 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d72ab0f-848f-4502-a479-8cda57a1fa8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:40.703290 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d72ab0f-848f-4502-a479-8cda57a1fa8f admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:40.703647 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d72ab0f-848f-4502-a479-8cda57a1fa8f admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:40.703996 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d72ab0f-848f-4502-a479-8cda57a1fa8f admin admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:40.704745 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d72ab0f-848f-4502-a479-8cda57a1fa8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:40.705858 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86831d7f-d7ad-486d-b89b-9df8ea865468 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:40.718791 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d72ab0f-848f-4502-a479-8cda57a1fa8f admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:40.720376 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c3f803-5f90-432c-aa77-d21055e6c9c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:40.721140 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c3f803-5f90-432c-aa77-d21055e6c9c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:40.721430 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c3f803-5f90-432c-aa77-d21055e6c9c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:40.723072 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c3f803-5f90-432c-aa77-d21055e6c9c5 admin admin] PATH_INFO: `/v3/projects/f930219ea1d34cce8435d351e7f87659/users/28114f9302b24e10b65b4adf6bf1c6d0/roles/d6e7421d1ff9451c808004b818354550` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:40.733001 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c3f803-5f90-432c-aa77-d21055e6c9c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f930219ea1d34cce8435d351e7f87659, user_id=28114f9302b24e10b65b4adf6bf1c6d0, role_id=d6e7421d1ff9451c808004b818354550)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:40.739424 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c3f803-5f90-432c-aa77-d21055e6c9c5 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:40.746555 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 869/1723] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:01:40 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:01:40.748017 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d72ab0f-848f-4502-a479-8cda57a1fa8f admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:40.772750 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d72ab0f-848f-4502-a479-8cda57a1fa8f admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:40.786905 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 855/1724] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Oct 4 12:01:40 2022] PUT /identity/v3/projects/f930219ea1d34cce8435d351e7f87659/users/28114f9302b24e10b65b4adf6bf1c6d0/roles/d6e7421d1ff9451c808004b818354550 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:01:40.788437 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c297d5-6676-4f9f-9071-d737f35c701c None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:40.788913 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c297d5-6676-4f9f-9071-d737f35c701c None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:40.793300 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c297d5-6676-4f9f-9071-d737f35c701c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:40.853686 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-26c297d5-6676-4f9f-9071-d737f35c701c None None] MFA Rules not processed for user `28114f9302b24e10b65b4adf6bf1c6d0`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:01:40.855066 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-26c297d5-6676-4f9f-9071-d737f35c701c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:01:40.914621 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a211fb-8e92-4c22-b572-42c20024e9eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:40.916565 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a211fb-8e92-4c22-b572-42c20024e9eb admin admin] REQUEST_METHOD: `PUT` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:40.932203 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a211fb-8e92-4c22-b572-42c20024e9eb admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:40.932763 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a211fb-8e92-4c22-b572-42c20024e9eb admin admin] PATH_INFO: `/v3/projects/8342c37425684ff4b6fbf27598b21567/users/4022bd1e4d5c45afadfb139f9a343077/roles/d6e7421d1ff9451c808004b818354550` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:41.006010 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a211fb-8e92-4c22-b572-42c20024e9eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=8342c37425684ff4b6fbf27598b21567, user_id=4022bd1e4d5c45afadfb139f9a343077, role_id=d6e7421d1ff9451c808004b818354550)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:41.008961 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a211fb-8e92-4c22-b572-42c20024e9eb admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:41.018570 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 856/1725] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:01:40 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:01:41.037739 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c297d5-6676-4f9f-9071-d737f35c701c None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:41.040935 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-26c297d5-6676-4f9f-9071-d737f35c701c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:01:41.051072 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:01:41.117506 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 870/1726] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Oct 4 12:01:40 2022] PUT /identity/v3/projects/8342c37425684ff4b6fbf27598b21567/users/4022bd1e4d5c45afadfb139f9a343077/roles/d6e7421d1ff9451c808004b818354550 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:01:41.119457 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a211fb-8e92-4c22-b572-42c20024e9eb admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:41.228745 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c297d5-6676-4f9f-9071-d737f35c701c None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:41.340713 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a211fb-8e92-4c22-b572-42c20024e9eb admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:41.346887 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9eef05-a074-421a-b7f5-ab8ca9b1aa3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:41.352485 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9eef05-a074-421a-b7f5-ab8ca9b1aa3d admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:41.352485 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9eef05-a074-421a-b7f5-ab8ca9b1aa3d admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:41.352485 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9eef05-a074-421a-b7f5-ab8ca9b1aa3d admin admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:41.352485 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9eef05-a074-421a-b7f5-ab8ca9b1aa3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:41.352485 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9eef05-a074-421a-b7f5-ab8ca9b1aa3d admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:41.400767 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 871/1727] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:01:41 2022] GET /identity/v3/roles => generated 1420 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:01:41.402580 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9eef05-a074-421a-b7f5-ab8ca9b1aa3d admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:41.409797 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a353abea-37d5-41cd-8008-5bb8360b2bcd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e2a05b782424ab2928b5864f1bfd556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:41.410841 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a353abea-37d5-41cd-8008-5bb8360b2bcd service cinder] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:41.412665 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a353abea-37d5-41cd-8008-5bb8360b2bcd service cinder] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:41.413377 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a353abea-37d5-41cd-8008-5bb8360b2bcd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:41.450075 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9eef05-a074-421a-b7f5-ab8ca9b1aa3d admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:41.485090 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f003b2d3-932b-484b-808a-ac92fd745238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:41.486290 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f003b2d3-932b-484b-808a-ac92fd745238 admin admin] REQUEST_METHOD: `PUT` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:41.488888 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f003b2d3-932b-484b-808a-ac92fd745238 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:41.489285 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f003b2d3-932b-484b-808a-ac92fd745238 admin admin] PATH_INFO: `/v3/projects/8342c37425684ff4b6fbf27598b21567/users/4022bd1e4d5c45afadfb139f9a343077/roles/d6e7421d1ff9451c808004b818354550` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:41.497524 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f003b2d3-932b-484b-808a-ac92fd745238 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8342c37425684ff4b6fbf27598b21567, user_id=4022bd1e4d5c45afadfb139f9a343077, role_id=d6e7421d1ff9451c808004b818354550)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:41.509500 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f003b2d3-932b-484b-808a-ac92fd745238 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:41.544340 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 872/1728] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Oct 4 12:01:41 2022] PUT /identity/v3/projects/8342c37425684ff4b6fbf27598b21567/users/4022bd1e4d5c45afadfb139f9a343077/roles/d6e7421d1ff9451c808004b818354550 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:01:41.558172 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eccb5a-d57f-454c-b9e5-3b24000ad358 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:41.558560 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eccb5a-d57f-454c-b9e5-3b24000ad358 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:41.558909 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eccb5a-d57f-454c-b9e5-3b24000ad358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:41.611851 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a353abea-37d5-41cd-8008-5bb8360b2bcd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:41.613860 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a353abea-37d5-41cd-8008-5bb8360b2bcd service cinder] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:41.624108 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-93eccb5a-d57f-454c-b9e5-3b24000ad358 None None] MFA Rules not processed for user `4022bd1e4d5c45afadfb139f9a343077`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:01:41.627635 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-93eccb5a-d57f-454c-b9e5-3b24000ad358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:01:41.654814 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 857/1729] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:01:41 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 621 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:01:41.808122 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 873/1730] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:01:41 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:01:41.829001 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a353abea-37d5-41cd-8008-5bb8360b2bcd service cinder] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:41.832574 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-a353abea-37d5-41cd-8008-5bb8360b2bcd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:01:41.857612 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a353abea-37d5-41cd-8008-5bb8360b2bcd service cinder] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:42.026530 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e13dded-00a1-4cc6-9eb2-de3920c8bb2a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e2a05b782424ab2928b5864f1bfd556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:42.027627 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e13dded-00a1-4cc6-9eb2-de3920c8bb2a service cinder] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:42.028130 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e13dded-00a1-4cc6-9eb2-de3920c8bb2a service cinder] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:42.028697 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e13dded-00a1-4cc6-9eb2-de3920c8bb2a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:42.043364 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e13dded-00a1-4cc6-9eb2-de3920c8bb2a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:42.046433 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e13dded-00a1-4cc6-9eb2-de3920c8bb2a service cinder] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:42.065595 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 858/1731] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:01:41 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:01:42.117177 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eccb5a-d57f-454c-b9e5-3b24000ad358 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:42.148855 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e13dded-00a1-4cc6-9eb2-de3920c8bb2a service cinder] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:42.161976 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eccb5a-d57f-454c-b9e5-3b24000ad358 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:42.172047 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363f498b-0328-4936-ac58-418887117564 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e2a05b782424ab2928b5864f1bfd556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:42.174092 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363f498b-0328-4936-ac58-418887117564 service cinder] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:42.199440 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363f498b-0328-4936-ac58-418887117564 service cinder] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:42.200026 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363f498b-0328-4936-ac58-418887117564 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:42.205941 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-363f498b-0328-4936-ac58-418887117564 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:01:42.249297 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:01:42.377120 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e13dded-00a1-4cc6-9eb2-de3920c8bb2a service cinder] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:42.378027 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363f498b-0328-4936-ac58-418887117564 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:42.379861 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363f498b-0328-4936-ac58-418887117564 service cinder] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:42.410611 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12343408-ca24-4fb4-a86f-a89881ac76d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:42.410807 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 874/1732] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:01:42 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:01:42.410906 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12343408-ca24-4fb4-a86f-a89881ac76d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:42.410906 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12343408-ca24-4fb4-a86f-a89881ac76d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:42.410906 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12343408-ca24-4fb4-a86f-a89881ac76d9 admin admin] PATH_INFO: `/v3/users/d482bd76dd99462c88602a47eff678f1` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:42.418691 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12343408-ca24-4fb4-a86f-a89881ac76d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d482bd76dd99462c88602a47eff678f1)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:42.428627 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12343408-ca24-4fb4-a86f-a89881ac76d9 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:42.791572 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363f498b-0328-4936-ac58-418887117564 service cinder] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:42.795928 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-363f498b-0328-4936-ac58-418887117564 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:01:42.837170 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-12343408-ca24-4fb4-a86f-a89881ac76d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd482bd76dd99462c88602a47eff678f1'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:01:42.844875 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363f498b-0328-4936-ac58-418887117564 service cinder] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:42.850326 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-12343408-ca24-4fb4-a86f-a89881ac76d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd482bd76dd99462c88602a47eff678f1'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:01:42.851099 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-12343408-ca24-4fb4-a86f-a89881ac76d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd482bd76dd99462c88602a47eff678f1'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:01:42.851731 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-12343408-ca24-4fb4-a86f-a89881ac76d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd482bd76dd99462c88602a47eff678f1'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:01:42.857633 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d481a597-aeca-4d6d-882d-89722e30c435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:42.858295 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d481a597-aeca-4d6d-882d-89722e30c435 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:42.858578 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d481a597-aeca-4d6d-882d-89722e30c435 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:42.858855 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d481a597-aeca-4d6d-882d-89722e30c435 admin admin] PATH_INFO: `/v3/projects/3db30d5967dd4b0ca08cc8017f7592c0` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:42.871249 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d481a597-aeca-4d6d-882d-89722e30c435 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3db30d5967dd4b0ca08cc8017f7592c0)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:42.883514 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d481a597-aeca-4d6d-882d-89722e30c435 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:42.941530 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-12343408-ca24-4fb4-a86f-a89881ac76d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd482bd76dd99462c88602a47eff678f1'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:01:42.996450 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 859/1733] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Oct 4 12:01:42 2022] DELETE /identity/v3/users/d482bd76dd99462c88602a47eff678f1 => generated 0 bytes in 848 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:01:42.997891 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f899530-3c86-4ee7-bea9-9d6807128518 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:42.999730 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f899530-3c86-4ee7-bea9-9d6807128518 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:43.000132 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f899530-3c86-4ee7-bea9-9d6807128518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:43.074008 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-0f899530-3c86-4ee7-bea9-9d6807128518 None None] MFA Rules not processed for user `74861e3dd6e14d999aeae1f057b24582`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:01:43.075326 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-0f899530-3c86-4ee7-bea9-9d6807128518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:01:43.159787 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 860/1734] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:01:42 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:01:43.161659 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60863837-416e-407e-883a-a2e86ce77a14 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:43.162081 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60863837-416e-407e-883a-a2e86ce77a14 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:43.162797 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60863837-416e-407e-883a-a2e86ce77a14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:43.184804 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-60863837-416e-407e-883a-a2e86ce77a14 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:01:43.186326 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-60863837-416e-407e-883a-a2e86ce77a14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:01:43.241501 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-d481a597-aeca-4d6d-882d-89722e30c435 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3db30d5967dd4b0ca08cc8017f7592c0', 'request_id': 'req-d481a597-aeca-4d6d-882d-89722e30c435'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:01:43.277706 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 861/1735] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:01:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:01:43.292609 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60863837-416e-407e-883a-a2e86ce77a14 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:43.294079 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-60863837-416e-407e-883a-a2e86ce77a14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:01:43.335571 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-d481a597-aeca-4d6d-882d-89722e30c435 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3db30d5967dd4b0ca08cc8017f7592c0', 'request_id': 'req-d481a597-aeca-4d6d-882d-89722e30c435'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:01:43.353849 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-d481a597-aeca-4d6d-882d-89722e30c435 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3db30d5967dd4b0ca08cc8017f7592c0', 'request_id': 'req-d481a597-aeca-4d6d-882d-89722e30c435'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:01:43.381459 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-d481a597-aeca-4d6d-882d-89722e30c435 admin admin] The token cache is being invalidate because project 3db30d5967dd4b0ca08cc8017f7592c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:01:43.382259 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-d481a597-aeca-4d6d-882d-89722e30c435 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:01:43.385591 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-d481a597-aeca-4d6d-882d-89722e30c435 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:01:43.388696 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 875/1736] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Oct 4 12:01:42 2022] DELETE /identity/v3/projects/3db30d5967dd4b0ca08cc8017f7592c0 => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:01:43.392549 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d481a597-aeca-4d6d-882d-89722e30c435 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:43.398957 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-d481a597-aeca-4d6d-882d-89722e30c435 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:01:43.418106 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60863837-416e-407e-883a-a2e86ce77a14 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:43.534549 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d8fb4c-7e08-4a02-85ea-25b005d77e71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7289515c5c44914a19daa439de98cb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:43.539526 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d8fb4c-7e08-4a02-85ea-25b005d77e71 service neutron] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:43.539833 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d8fb4c-7e08-4a02-85ea-25b005d77e71 service neutron] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:43.540114 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d8fb4c-7e08-4a02-85ea-25b005d77e71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:43.544968 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-17d8fb4c-7e08-4a02-85ea-25b005d77e71 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:01:43.582778 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d481a597-aeca-4d6d-882d-89722e30c435 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:43.591967 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d8fb4c-7e08-4a02-85ea-25b005d77e71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:43.596109 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f336a9-94fb-44c5-a706-250493a4dddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:43.597033 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d8fb4c-7e08-4a02-85ea-25b005d77e71 service neutron] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:43.599758 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f336a9-94fb-44c5-a706-250493a4dddb admin admin] REQUEST_METHOD: `DELETE` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:43.600014 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f336a9-94fb-44c5-a706-250493a4dddb admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:43.600296 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f336a9-94fb-44c5-a706-250493a4dddb admin admin] PATH_INFO: `/v3/users/f946e435290f414d80dcaa5d5bb24f19` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:43.601665 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f336a9-94fb-44c5-a706-250493a4dddb admin admin] RBAC: Authorizing `identity:delete_user(user_id=f946e435290f414d80dcaa5d5bb24f19)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:43.603795 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f336a9-94fb-44c5-a706-250493a4dddb admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:43.647395 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 862/1737] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:01:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:01:43.920732 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-70f336a9-94fb-44c5-a706-250493a4dddb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f946e435290f414d80dcaa5d5bb24f19'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:01:43.940591 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-70f336a9-94fb-44c5-a706-250493a4dddb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f946e435290f414d80dcaa5d5bb24f19'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:01:43.941379 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-70f336a9-94fb-44c5-a706-250493a4dddb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f946e435290f414d80dcaa5d5bb24f19'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:01:43.946110 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-70f336a9-94fb-44c5-a706-250493a4dddb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f946e435290f414d80dcaa5d5bb24f19'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:01:44.126544 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-70f336a9-94fb-44c5-a706-250493a4dddb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f946e435290f414d80dcaa5d5bb24f19'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:01:44.181462 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 876/1738] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Oct 4 12:01:43 2022] DELETE /identity/v3/users/f946e435290f414d80dcaa5d5bb24f19 => generated 0 bytes in 789 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:01:44.661121 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c820de54-65df-4ba4-8084-38c1d5889834 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:44.661845 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c820de54-65df-4ba4-8084-38c1d5889834 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:44.662097 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c820de54-65df-4ba4-8084-38c1d5889834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:44.689438 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-c820de54-65df-4ba4-8084-38c1d5889834 None None] MFA Rules not processed for user `6c95a1206a4a4788b47882c7bb3e7a61`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:01:44.691027 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-c820de54-65df-4ba4-8084-38c1d5889834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:01:44.744257 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:01:44.775054 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 863/1739] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:01:44 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:01:44.809694 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f336a9-94fb-44c5-a706-250493a4dddb admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:44.812785 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-70f336a9-94fb-44c5-a706-250493a4dddb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:01:44.954941 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f336a9-94fb-44c5-a706-250493a4dddb admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:44.965799 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeb9a39-c87a-40eb-a024-a25bc9c5c3f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:44.966639 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeb9a39-c87a-40eb-a024-a25bc9c5c3f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:44.967122 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeb9a39-c87a-40eb-a024-a25bc9c5c3f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:44.967553 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeb9a39-c87a-40eb-a024-a25bc9c5c3f2 admin admin] PATH_INFO: `/v3/projects/3d4aad7ef41c4397b8480519400a731c` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:44.968944 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eeb9a39-c87a-40eb-a024-a25bc9c5c3f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d4aad7ef41c4397b8480519400a731c)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:44.977020 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eeb9a39-c87a-40eb-a024-a25bc9c5c3f2 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:45.297362 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-7eeb9a39-c87a-40eb-a024-a25bc9c5c3f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d4aad7ef41c4397b8480519400a731c', 'request_id': 'req-7eeb9a39-c87a-40eb-a024-a25bc9c5c3f2'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:01:45.374756 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c820de54-65df-4ba4-8084-38c1d5889834 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:45.375351 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-c820de54-65df-4ba4-8084-38c1d5889834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:01:45.406291 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c820de54-65df-4ba4-8084-38c1d5889834 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:45.443477 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-7eeb9a39-c87a-40eb-a024-a25bc9c5c3f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d4aad7ef41c4397b8480519400a731c', 'request_id': 'req-7eeb9a39-c87a-40eb-a024-a25bc9c5c3f2'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:01:45.469779 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-7eeb9a39-c87a-40eb-a024-a25bc9c5c3f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d4aad7ef41c4397b8480519400a731c', 'request_id': 'req-7eeb9a39-c87a-40eb-a024-a25bc9c5c3f2'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:01:45.525679 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-7eeb9a39-c87a-40eb-a024-a25bc9c5c3f2 admin admin] The token cache is being invalidate because project 3d4aad7ef41c4397b8480519400a731c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:01:45.527294 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-7eeb9a39-c87a-40eb-a024-a25bc9c5c3f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:01:45.542295 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-7eeb9a39-c87a-40eb-a024-a25bc9c5c3f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:01:45.542295 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 877/1740] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Oct 4 12:01:44 2022] DELETE /identity/v3/projects/3d4aad7ef41c4397b8480519400a731c => generated 0 bytes in 724 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:01:45.544410 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeb9a39-c87a-40eb-a024-a25bc9c5c3f2 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:45.547124 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-7eeb9a39-c87a-40eb-a024-a25bc9c5c3f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:01:45.697006 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55955352-2718-4dee-8838-6b16c00202aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:45.697006 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55955352-2718-4dee-8838-6b16c00202aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:45.699761 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55955352-2718-4dee-8838-6b16c00202aa admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:45.700263 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55955352-2718-4dee-8838-6b16c00202aa admin admin] PATH_INFO: `/v3/projects/c42475880ada4eb899be7b84f1294a58` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:45.709112 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55955352-2718-4dee-8838-6b16c00202aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=c42475880ada4eb899be7b84f1294a58)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:45.715232 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55955352-2718-4dee-8838-6b16c00202aa admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:45.751411 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeb9a39-c87a-40eb-a024-a25bc9c5c3f2 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:45.801718 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242e8730-14af-43dc-aafa-1e7f30af6c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:45.805866 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242e8730-14af-43dc-aafa-1e7f30af6c68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:45.806151 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242e8730-14af-43dc-aafa-1e7f30af6c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:45.806435 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242e8730-14af-43dc-aafa-1e7f30af6c68 admin admin] PATH_INFO: `/v3/users/4022bd1e4d5c45afadfb139f9a343077` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:45.815742 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242e8730-14af-43dc-aafa-1e7f30af6c68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4022bd1e4d5c45afadfb139f9a343077)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:45.818599 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242e8730-14af-43dc-aafa-1e7f30af6c68 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:46.009494 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-55955352-2718-4dee-8838-6b16c00202aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c42475880ada4eb899be7b84f1294a58', 'request_id': 'req-55955352-2718-4dee-8838-6b16c00202aa'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:01:46.031234 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-55955352-2718-4dee-8838-6b16c00202aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c42475880ada4eb899be7b84f1294a58', 'request_id': 'req-55955352-2718-4dee-8838-6b16c00202aa'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:01:46.319550 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-55955352-2718-4dee-8838-6b16c00202aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c42475880ada4eb899be7b84f1294a58', 'request_id': 'req-55955352-2718-4dee-8838-6b16c00202aa'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:01:46.350877 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-55955352-2718-4dee-8838-6b16c00202aa admin admin] The token cache is being invalidate because project c42475880ada4eb899be7b84f1294a58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:01:46.351479 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-55955352-2718-4dee-8838-6b16c00202aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:01:46.352764 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-55955352-2718-4dee-8838-6b16c00202aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:01:46.355119 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 864/1741] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Oct 4 12:01:45 2022] DELETE /identity/v3/projects/c42475880ada4eb899be7b84f1294a58 => generated 0 bytes in 982 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:01:46.358909 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-242e8730-14af-43dc-aafa-1e7f30af6c68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4022bd1e4d5c45afadfb139f9a343077'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:01:46.359966 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a01fc2-cbe7-410a-ab01-06ac86b37804 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:46.367639 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a01fc2-cbe7-410a-ab01-06ac86b37804 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:46.367639 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a01fc2-cbe7-410a-ab01-06ac86b37804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:46.377042 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-242e8730-14af-43dc-aafa-1e7f30af6c68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4022bd1e4d5c45afadfb139f9a343077'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:01:46.379337 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-242e8730-14af-43dc-aafa-1e7f30af6c68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4022bd1e4d5c45afadfb139f9a343077'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:01:46.380196 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-242e8730-14af-43dc-aafa-1e7f30af6c68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4022bd1e4d5c45afadfb139f9a343077'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:01:46.403907 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-74a01fc2-cbe7-410a-ab01-06ac86b37804 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:01:46.405470 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-74a01fc2-cbe7-410a-ab01-06ac86b37804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:01:46.428779 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:01:46.479611 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 865/1742] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:01:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 12:01:46.488545 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db2ac5b-0ed4-4984-a392-149cc559aa9b None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:46.488985 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db2ac5b-0ed4-4984-a392-149cc559aa9b None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:46.489264 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db2ac5b-0ed4-4984-a392-149cc559aa9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:46.526477 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-2db2ac5b-0ed4-4984-a392-149cc559aa9b None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:01:46.534959 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-2db2ac5b-0ed4-4984-a392-149cc559aa9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:01:46.551869 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 866/1743] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:01:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:01:46.555618 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db2ac5b-0ed4-4984-a392-149cc559aa9b None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:46.571961 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-242e8730-14af-43dc-aafa-1e7f30af6c68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4022bd1e4d5c45afadfb139f9a343077'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:01:46.586612 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db2ac5b-0ed4-4984-a392-149cc559aa9b None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:46.588847 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166d0b40-b233-4053-9418-782838f88a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:46.589635 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166d0b40-b233-4053-9418-782838f88a36 admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:46.591451 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166d0b40-b233-4053-9418-782838f88a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:46.591901 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166d0b40-b233-4053-9418-782838f88a36 admin admin] PATH_INFO: `/v3/domains` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:46.592717 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166d0b40-b233-4053-9418-782838f88a36 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:01:46.593246 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166d0b40-b233-4053-9418-782838f88a36 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:46.595270 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166d0b40-b233-4053-9418-782838f88a36 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:46.610676 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 867/1744] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Oct 4 12:01:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 12:01:46.627903 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166d0b40-b233-4053-9418-782838f88a36 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:46.645320 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 878/1745] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Oct 4 12:01:45 2022] DELETE /identity/v3/users/4022bd1e4d5c45afadfb139f9a343077 => generated 0 bytes in 1090 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:01:46.678232 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166d0b40-b233-4053-9418-782838f88a36 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:46.831158 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7fb029-a3b8-4e89-bd5a-87d894a2041c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:46.837562 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7fb029-a3b8-4e89-bd5a-87d894a2041c admin admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:46.839804 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7fb029-a3b8-4e89-bd5a-87d894a2041c admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:46.841234 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7fb029-a3b8-4e89-bd5a-87d894a2041c admin admin] PATH_INFO: `/v3/projects` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:46.844556 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7fb029-a3b8-4e89-bd5a-87d894a2041c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:46.851572 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7fb029-a3b8-4e89-bd5a-87d894a2041c admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:47.115179 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 868/1746] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Oct 4 12:01:46 2022] POST /identity/v3/projects => generated 387 bytes in 488 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:01:47.120087 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242e8730-14af-43dc-aafa-1e7f30af6c68 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:47.140423 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242e8730-14af-43dc-aafa-1e7f30af6c68 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:47.206344 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1267ef3e-d70c-4f59-aa0b-bc8bb29b8f06 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:47.206911 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1267ef3e-d70c-4f59-aa0b-bc8bb29b8f06 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:47.207346 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1267ef3e-d70c-4f59-aa0b-bc8bb29b8f06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:47.266543 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3110ed-7dca-4ddd-9ae5-52079df145e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:47.266543 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3110ed-7dca-4ddd-9ae5-52079df145e6 admin admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:47.267149 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3110ed-7dca-4ddd-9ae5-52079df145e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:47.267711 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3110ed-7dca-4ddd-9ae5-52079df145e6 admin admin] PATH_INFO: `/v3/users` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:47.268651 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3110ed-7dca-4ddd-9ae5-52079df145e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:47.272309 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3110ed-7dca-4ddd-9ae5-52079df145e6 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:47.337043 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-1267ef3e-d70c-4f59-aa0b-bc8bb29b8f06 None None] MFA Rules not processed for user `06d1850ea27c483780eed67ede9cc1e3`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:01:47.338659 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-1267ef3e-d70c-4f59-aa0b-bc8bb29b8f06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:01:47.431626 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 879/1747] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Oct 4 12:01:47 2022] POST /identity/v3/users => generated 294 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:01:47.434030 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3110ed-7dca-4ddd-9ae5-52079df145e6 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:47.458595 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3110ed-7dca-4ddd-9ae5-52079df145e6 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:47.472466 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3270966b-72d0-40be-8fbd-f62f29c8ef92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:47.475902 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3270966b-72d0-40be-8fbd-f62f29c8ef92 admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:47.476454 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3270966b-72d0-40be-8fbd-f62f29c8ef92 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:47.477258 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3270966b-72d0-40be-8fbd-f62f29c8ef92 admin admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:47.478774 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3270966b-72d0-40be-8fbd-f62f29c8ef92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:47.481821 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3270966b-72d0-40be-8fbd-f62f29c8ef92 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:47.512441 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 869/1748] 10.222.0.59 () {58 vars in 1009 bytes} [Tue Oct 4 12:01:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 12:01:47.517009 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 880/1749] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:01:47 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:01:47.518998 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1267ef3e-d70c-4f59-aa0b-bc8bb29b8f06 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:47.562832 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1267ef3e-d70c-4f59-aa0b-bc8bb29b8f06 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:47.568907 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6589d2bf-df52-4987-a814-6cca3d9da78f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:47.569944 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6589d2bf-df52-4987-a814-6cca3d9da78f admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:47.570470 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6589d2bf-df52-4987-a814-6cca3d9da78f admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:47.570808 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6589d2bf-df52-4987-a814-6cca3d9da78f admin admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:47.572086 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6589d2bf-df52-4987-a814-6cca3d9da78f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:47.585579 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6589d2bf-df52-4987-a814-6cca3d9da78f admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:47.614028 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 870/1750] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:01:47 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:01:47.619316 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3270966b-72d0-40be-8fbd-f62f29c8ef92 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:47.637621 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3270966b-72d0-40be-8fbd-f62f29c8ef92 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:47.652398 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6fe86e-99ac-413d-a76b-edaf14ae1296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:47.653406 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6fe86e-99ac-413d-a76b-edaf14ae1296 admin admin] REQUEST_METHOD: `PUT` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:47.654003 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6fe86e-99ac-413d-a76b-edaf14ae1296 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:47.654443 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6fe86e-99ac-413d-a76b-edaf14ae1296 admin admin] PATH_INFO: `/v3/projects/a26815aaa1754293bcfb062be21c18f4/users/bfb2d2d26d59468aad7e91c48e05d86d/roles/ab4307f3b7994c1c80036fa7db93b6b9` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:47.675322 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6fe86e-99ac-413d-a76b-edaf14ae1296 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a26815aaa1754293bcfb062be21c18f4, user_id=bfb2d2d26d59468aad7e91c48e05d86d, role_id=ab4307f3b7994c1c80036fa7db93b6b9)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:47.678592 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6fe86e-99ac-413d-a76b-edaf14ae1296 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:47.868107 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6589d2bf-df52-4987-a814-6cca3d9da78f admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:47.871968 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-6589d2bf-df52-4987-a814-6cca3d9da78f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:01:47.879963 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 881/1751] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Oct 4 12:01:47 2022] PUT /identity/v3/projects/a26815aaa1754293bcfb062be21c18f4/users/bfb2d2d26d59468aad7e91c48e05d86d/roles/ab4307f3b7994c1c80036fa7db93b6b9 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:01:47.891642 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d382d5d7-f558-4e7e-880e-64df7e431480 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:47.892165 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d382d5d7-f558-4e7e-880e-64df7e431480 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:47.892629 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d382d5d7-f558-4e7e-880e-64df7e431480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:47.900317 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6589d2bf-df52-4987-a814-6cca3d9da78f admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:47.926120 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-d382d5d7-f558-4e7e-880e-64df7e431480 None None] MFA Rules not processed for user `bfb2d2d26d59468aad7e91c48e05d86d`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:01:47.927539 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-d382d5d7-f558-4e7e-880e-64df7e431480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:01:48.013078 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b1dbd5-9268-4e70-8134-eddf6dd0aa21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:48.014557 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b1dbd5-9268-4e70-8134-eddf6dd0aa21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:48.014991 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b1dbd5-9268-4e70-8134-eddf6dd0aa21 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:48.015424 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b1dbd5-9268-4e70-8134-eddf6dd0aa21 admin admin] PATH_INFO: `/v3/projects/8342c37425684ff4b6fbf27598b21567` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:48.016983 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b1dbd5-9268-4e70-8134-eddf6dd0aa21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8342c37425684ff4b6fbf27598b21567)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:48.019845 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b1dbd5-9268-4e70-8134-eddf6dd0aa21 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:48.075423 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 882/1752] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:01:47 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 12:01:48.081326 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d382d5d7-f558-4e7e-880e-64df7e431480 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:48.118922 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d382d5d7-f558-4e7e-880e-64df7e431480 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:48.139460 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69eafae-be83-4674-b833-b7205545aca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:48.139460 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69eafae-be83-4674-b833-b7205545aca0 admin admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:48.139460 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69eafae-be83-4674-b833-b7205545aca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:48.139460 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69eafae-be83-4674-b833-b7205545aca0 admin admin] PATH_INFO: `/v3/projects` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:48.141461 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69eafae-be83-4674-b833-b7205545aca0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:48.144374 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69eafae-be83-4674-b833-b7205545aca0 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:48.354523 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 883/1753] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Oct 4 12:01:48 2022] POST /identity/v3/projects => generated 385 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:01:48.369561 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-90b1dbd5-9268-4e70-8134-eddf6dd0aa21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8342c37425684ff4b6fbf27598b21567', 'request_id': 'req-90b1dbd5-9268-4e70-8134-eddf6dd0aa21'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:01:48.378535 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69eafae-be83-4674-b833-b7205545aca0 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:48.388083 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-90b1dbd5-9268-4e70-8134-eddf6dd0aa21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8342c37425684ff4b6fbf27598b21567', 'request_id': 'req-90b1dbd5-9268-4e70-8134-eddf6dd0aa21'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:01:48.388489 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-d69eafae-be83-4674-b833-b7205545aca0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:01:48.530939 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-90b1dbd5-9268-4e70-8134-eddf6dd0aa21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8342c37425684ff4b6fbf27598b21567', 'request_id': 'req-90b1dbd5-9268-4e70-8134-eddf6dd0aa21'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:01:48.543984 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-90b1dbd5-9268-4e70-8134-eddf6dd0aa21 admin admin] The token cache is being invalidate because project 8342c37425684ff4b6fbf27598b21567 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:01:48.550942 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-90b1dbd5-9268-4e70-8134-eddf6dd0aa21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:01:48.550942 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-90b1dbd5-9268-4e70-8134-eddf6dd0aa21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:01:48.550942 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 871/1754] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Oct 4 12:01:47 2022] DELETE /identity/v3/projects/8342c37425684ff4b6fbf27598b21567 => generated 0 bytes in 679 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:01:48.550942 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aafe58-b33b-4616-a9fd-43d58761c7e8 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:48.550942 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aafe58-b33b-4616-a9fd-43d58761c7e8 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:48.550942 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aafe58-b33b-4616-a9fd-43d58761c7e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:48.559756 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69eafae-be83-4674-b833-b7205545aca0 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:48.566544 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716c5caf-df2c-400a-9ae6-99f6ef0ed0e8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1605c3e03b7a4bcba4e19f0d92c671bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:48.567353 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716c5caf-df2c-400a-9ae6-99f6ef0ed0e8 service swift] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:48.568204 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716c5caf-df2c-400a-9ae6-99f6ef0ed0e8 service swift] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:48.568537 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716c5caf-df2c-400a-9ae6-99f6ef0ed0e8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:48.570555 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-716c5caf-df2c-400a-9ae6-99f6ef0ed0e8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:01:48.573376 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-87aafe58-b33b-4616-a9fd-43d58761c7e8 None None] MFA Rules not processed for user `e7289515c5c44914a19daa439de98cb1`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:01:48.575038 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-87aafe58-b33b-4616-a9fd-43d58761c7e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:01:48.661076 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716c5caf-df2c-400a-9ae6-99f6ef0ed0e8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:48.668057 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716c5caf-df2c-400a-9ae6-99f6ef0ed0e8 service swift] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:48.681773 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 872/1755] 10.222.0.13 () {58 vars in 1015 bytes} [Tue Oct 4 12:01:48 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:01:48.684189 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 884/1756] 10.222.0.59 () {60 vars in 1384 bytes} [Tue Oct 4 12:01:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 12:01:48.685548 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e09aad-51ce-4523-943b-428a13b11d9c None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:48.690368 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aafe58-b33b-4616-a9fd-43d58761c7e8 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:48.693889 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-87aafe58-b33b-4616-a9fd-43d58761c7e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:01:48.695859 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e09aad-51ce-4523-943b-428a13b11d9c None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:48.696196 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e09aad-51ce-4523-943b-428a13b11d9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:48.750778 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-e2e09aad-51ce-4523-943b-428a13b11d9c None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:01:48.757394 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-e2e09aad-51ce-4523-943b-428a13b11d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:01:48.882406 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aafe58-b33b-4616-a9fd-43d58761c7e8 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:48.891543 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b090b7-06b8-44fa-8062-56e6b864a07f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:48.891543 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b090b7-06b8-44fa-8062-56e6b864a07f admin admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:48.891543 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b090b7-06b8-44fa-8062-56e6b864a07f admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:48.891543 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b090b7-06b8-44fa-8062-56e6b864a07f admin admin] PATH_INFO: `/v3/users` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:48.892071 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b090b7-06b8-44fa-8062-56e6b864a07f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:48.892576 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 885/1757] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:01:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:01:48.894376 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b090b7-06b8-44fa-8062-56e6b864a07f admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:48.898392 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e09aad-51ce-4523-943b-428a13b11d9c None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:48.912317 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-e2e09aad-51ce-4523-943b-428a13b11d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:01:48.953998 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e09aad-51ce-4523-943b-428a13b11d9c None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:48.975316 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc24995-dba4-4624-8aa6-0ff0863dd79c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7289515c5c44914a19daa439de98cb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:48.975316 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc24995-dba4-4624-8aa6-0ff0863dd79c service neutron] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:48.975316 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc24995-dba4-4624-8aa6-0ff0863dd79c service neutron] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:48.975316 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc24995-dba4-4624-8aa6-0ff0863dd79c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:49.008873 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc24995-dba4-4624-8aa6-0ff0863dd79c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:49.017513 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc24995-dba4-4624-8aa6-0ff0863dd79c service neutron] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:49.068481 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 886/1758] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:01:48 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:01:49.068481 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfb1b55-3af2-4440-9444-b7821108ebba None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:49.068481 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfb1b55-3af2-4440-9444-b7821108ebba None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:49.068481 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfb1b55-3af2-4440-9444-b7821108ebba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:49.076493 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-4bfb1b55-3af2-4440-9444-b7821108ebba None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:01:49.078045 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-4bfb1b55-3af2-4440-9444-b7821108ebba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:01:49.089903 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 887/1759] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:01:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:01:49.094414 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfb1b55-3af2-4440-9444-b7821108ebba None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:49.109023 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfb1b55-3af2-4440-9444-b7821108ebba None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:49.115373 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6e0260-9c35-4ae8-abb8-18bc80674c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:49.116749 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6e0260-9c35-4ae8-abb8-18bc80674c56 admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:49.117481 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6e0260-9c35-4ae8-abb8-18bc80674c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:49.118068 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6e0260-9c35-4ae8-abb8-18bc80674c56 admin admin] PATH_INFO: `/v3/domains` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:49.118854 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6e0260-9c35-4ae8-abb8-18bc80674c56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:01:49.119259 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6e0260-9c35-4ae8-abb8-18bc80674c56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:49.121834 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6e0260-9c35-4ae8-abb8-18bc80674c56 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:49.152628 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 888/1760] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Oct 4 12:01:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:01:49.174029 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6e0260-9c35-4ae8-abb8-18bc80674c56 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:49.206990 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 873/1761] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Oct 4 12:01:48 2022] POST /identity/v3/users => generated 299 bytes in 524 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:01:49.209802 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6e0260-9c35-4ae8-abb8-18bc80674c56 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:49.226282 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b090b7-06b8-44fa-8062-56e6b864a07f admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:49.251094 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563c2691-ad46-454e-9756-f9292919cd17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:49.272941 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563c2691-ad46-454e-9756-f9292919cd17 admin admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:49.272941 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563c2691-ad46-454e-9756-f9292919cd17 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:49.272941 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563c2691-ad46-454e-9756-f9292919cd17 admin admin] PATH_INFO: `/v3/projects` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:49.272941 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563c2691-ad46-454e-9756-f9292919cd17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:49.272941 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563c2691-ad46-454e-9756-f9292919cd17 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:49.273407 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b090b7-06b8-44fa-8062-56e6b864a07f admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:49.279509 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e74bb6d-5a3f-45de-9dec-c5faa3e97e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:49.279509 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e74bb6d-5a3f-45de-9dec-c5faa3e97e26 admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:49.279509 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e74bb6d-5a3f-45de-9dec-c5faa3e97e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:49.279509 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e74bb6d-5a3f-45de-9dec-c5faa3e97e26 admin admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:49.280035 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e74bb6d-5a3f-45de-9dec-c5faa3e97e26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:49.280809 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e74bb6d-5a3f-45de-9dec-c5faa3e97e26 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:49.304298 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 874/1762] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:01:49 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:01:49.317715 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e74bb6d-5a3f-45de-9dec-c5faa3e97e26 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:49.330874 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e74bb6d-5a3f-45de-9dec-c5faa3e97e26 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:49.348239 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f350ea1-0ab8-4bd9-b94b-6082baa2d838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:49.349198 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f350ea1-0ab8-4bd9-b94b-6082baa2d838 admin admin] REQUEST_METHOD: `PUT` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:49.349806 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f350ea1-0ab8-4bd9-b94b-6082baa2d838 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:49.350285 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f350ea1-0ab8-4bd9-b94b-6082baa2d838 admin admin] PATH_INFO: `/v3/projects/7e698e5c030f40f4b73a1a136fa499bb/users/668b4216b4cc497cbe0f5156d4923d95/roles/d6e7421d1ff9451c808004b818354550` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:49.394699 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f350ea1-0ab8-4bd9-b94b-6082baa2d838 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e698e5c030f40f4b73a1a136fa499bb, user_id=668b4216b4cc497cbe0f5156d4923d95, role_id=d6e7421d1ff9451c808004b818354550)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:49.407547 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f350ea1-0ab8-4bd9-b94b-6082baa2d838 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:49.745498 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 889/1763] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Oct 4 12:01:49 2022] POST /identity/v3/projects => generated 381 bytes in 581 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:01:49.749763 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563c2691-ad46-454e-9756-f9292919cd17 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:49.846054 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 875/1764] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Oct 4 12:01:49 2022] PUT /identity/v3/projects/7e698e5c030f40f4b73a1a136fa499bb/users/668b4216b4cc497cbe0f5156d4923d95/roles/d6e7421d1ff9451c808004b818354550 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:01:49.849255 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f350ea1-0ab8-4bd9-b94b-6082baa2d838 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:50.000008 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563c2691-ad46-454e-9756-f9292919cd17 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:50.142312 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f350ea1-0ab8-4bd9-b94b-6082baa2d838 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:50.160464 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec83c75-6229-40d0-a812-239e75b94737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:50.166394 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec83c75-6229-40d0-a812-239e75b94737 admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:50.168423 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec83c75-6229-40d0-a812-239e75b94737 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:50.170559 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec83c75-6229-40d0-a812-239e75b94737 admin admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:50.171472 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec83c75-6229-40d0-a812-239e75b94737 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:50.175662 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec83c75-6229-40d0-a812-239e75b94737 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:50.184672 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26948bf-b437-4992-bdfe-645a54725322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:50.189361 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26948bf-b437-4992-bdfe-645a54725322 admin admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:50.189361 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26948bf-b437-4992-bdfe-645a54725322 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:50.189361 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26948bf-b437-4992-bdfe-645a54725322 admin admin] PATH_INFO: `/v3/users` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:50.189361 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26948bf-b437-4992-bdfe-645a54725322 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:50.195373 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26948bf-b437-4992-bdfe-645a54725322 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:50.244531 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 876/1765] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:01:49 2022] GET /identity/v3/roles => generated 1420 bytes in 397 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:01:50.337006 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec83c75-6229-40d0-a812-239e75b94737 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:50.357958 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec83c75-6229-40d0-a812-239e75b94737 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:50.373819 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47be300a-5526-47ee-a10b-f2a65e491dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:50.377975 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47be300a-5526-47ee-a10b-f2a65e491dfa admin admin] REQUEST_METHOD: `PUT` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:50.378921 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47be300a-5526-47ee-a10b-f2a65e491dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:50.383687 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47be300a-5526-47ee-a10b-f2a65e491dfa admin admin] PATH_INFO: `/v3/projects/7e698e5c030f40f4b73a1a136fa499bb/users/668b4216b4cc497cbe0f5156d4923d95/roles/d6e7421d1ff9451c808004b818354550` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:50.392753 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47be300a-5526-47ee-a10b-f2a65e491dfa admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e698e5c030f40f4b73a1a136fa499bb, user_id=668b4216b4cc497cbe0f5156d4923d95, role_id=d6e7421d1ff9451c808004b818354550)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:50.406744 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47be300a-5526-47ee-a10b-f2a65e491dfa admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:50.460684 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 877/1766] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Oct 4 12:01:50 2022] PUT /identity/v3/projects/7e698e5c030f40f4b73a1a136fa499bb/users/668b4216b4cc497cbe0f5156d4923d95/roles/d6e7421d1ff9451c808004b818354550 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:01:50.468020 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab621625-5757-421c-9ad4-61647ca6db79 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:50.468311 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab621625-5757-421c-9ad4-61647ca6db79 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:50.468664 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab621625-5757-421c-9ad4-61647ca6db79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:50.569826 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-ab621625-5757-421c-9ad4-61647ca6db79 None None] MFA Rules not processed for user `668b4216b4cc497cbe0f5156d4923d95`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:01:50.571126 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-ab621625-5757-421c-9ad4-61647ca6db79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:01:50.719801 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 890/1767] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Oct 4 12:01:49 2022] POST /identity/v3/users => generated 291 bytes in 970 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 12:01:50.726980 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26948bf-b437-4992-bdfe-645a54725322 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:50.768442 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 878/1768] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:01:50 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 12:01:50.771544 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26948bf-b437-4992-bdfe-645a54725322 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:50.784749 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab621625-5757-421c-9ad4-61647ca6db79 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:50.788964 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-ab621625-5757-421c-9ad4-61647ca6db79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:01:50.971750 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0f035d-3421-453c-98d3-d68cf24ba3ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:50.972566 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0f035d-3421-453c-98d3-d68cf24ba3ad admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:50.972947 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0f035d-3421-453c-98d3-d68cf24ba3ad admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:50.973224 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0f035d-3421-453c-98d3-d68cf24ba3ad admin admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:50.975678 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0f035d-3421-453c-98d3-d68cf24ba3ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:50.979941 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0f035d-3421-453c-98d3-d68cf24ba3ad admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:50.985195 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab621625-5757-421c-9ad4-61647ca6db79 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:50.990052 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cff7d2-ba4f-4eb9-bf72-259c32e79c7f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e2a05b782424ab2928b5864f1bfd556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:50.991158 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cff7d2-ba4f-4eb9-bf72-259c32e79c7f service cinder] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:50.991449 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cff7d2-ba4f-4eb9-bf72-259c32e79c7f service cinder] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:50.991911 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cff7d2-ba4f-4eb9-bf72-259c32e79c7f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:51.008846 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cff7d2-ba4f-4eb9-bf72-259c32e79c7f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:51.010921 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cff7d2-ba4f-4eb9-bf72-259c32e79c7f service cinder] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:51.017750 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 891/1769] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:01:50 2022] GET /identity/v3/roles => generated 1420 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:01:51.019094 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0f035d-3421-453c-98d3-d68cf24ba3ad admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:51.043198 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0f035d-3421-453c-98d3-d68cf24ba3ad admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:51.046536 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 879/1770] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:01:50 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:01:51.071397 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356b9cb5-c8e1-4652-ac7e-4f5daa33a007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:51.075598 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356b9cb5-c8e1-4652-ac7e-4f5daa33a007 admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:51.079318 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356b9cb5-c8e1-4652-ac7e-4f5daa33a007 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:51.079805 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356b9cb5-c8e1-4652-ac7e-4f5daa33a007 admin admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:51.083743 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356b9cb5-c8e1-4652-ac7e-4f5daa33a007 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:51.085963 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356b9cb5-c8e1-4652-ac7e-4f5daa33a007 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:51.122847 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 892/1771] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:01:51 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:01:51.124500 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cff7d2-ba4f-4eb9-bf72-259c32e79c7f service cinder] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:51.161025 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cff7d2-ba4f-4eb9-bf72-259c32e79c7f service cinder] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:51.186200 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1e2e77-eafb-409d-8fdc-63fb7400b688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:51.187179 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356b9cb5-c8e1-4652-ac7e-4f5daa33a007 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:51.188106 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1e2e77-eafb-409d-8fdc-63fb7400b688 admin admin] REQUEST_METHOD: `PUT` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:51.188783 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1e2e77-eafb-409d-8fdc-63fb7400b688 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:51.189243 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1e2e77-eafb-409d-8fdc-63fb7400b688 admin admin] PATH_INFO: `/v3/projects/cbb7b44b6e0342a6a4f12ecd35b47e99/users/81526330023c4ce587f056e96c88992b/roles/ab4307f3b7994c1c80036fa7db93b6b9` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:51.209575 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356b9cb5-c8e1-4652-ac7e-4f5daa33a007 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:51.223359 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e31f217-0afe-4185-9f74-ffe5bbafe0ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:51.225614 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e31f217-0afe-4185-9f74-ffe5bbafe0ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:51.226567 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1e2e77-eafb-409d-8fdc-63fb7400b688 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbb7b44b6e0342a6a4f12ecd35b47e99, user_id=81526330023c4ce587f056e96c88992b, role_id=ab4307f3b7994c1c80036fa7db93b6b9)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:51.226925 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e31f217-0afe-4185-9f74-ffe5bbafe0ab admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:51.227326 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e31f217-0afe-4185-9f74-ffe5bbafe0ab admin admin] PATH_INFO: `/v3/users/bfb2d2d26d59468aad7e91c48e05d86d` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:51.228716 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e31f217-0afe-4185-9f74-ffe5bbafe0ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfb2d2d26d59468aad7e91c48e05d86d)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:51.230324 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1e2e77-eafb-409d-8fdc-63fb7400b688 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:51.231499 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e31f217-0afe-4185-9f74-ffe5bbafe0ab admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:51.621945 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 880/1772] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Oct 4 12:01:51 2022] PUT /identity/v3/projects/cbb7b44b6e0342a6a4f12ecd35b47e99/users/81526330023c4ce587f056e96c88992b/roles/ab4307f3b7994c1c80036fa7db93b6b9 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:01:51.624812 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1e2e77-eafb-409d-8fdc-63fb7400b688 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:51.635938 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-ba1e2e77-eafb-409d-8fdc-63fb7400b688 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:01:51.650556 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:01:51.790040 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-4e31f217-0afe-4185-9f74-ffe5bbafe0ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfb2d2d26d59468aad7e91c48e05d86d'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:01:51.814903 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-4e31f217-0afe-4185-9f74-ffe5bbafe0ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfb2d2d26d59468aad7e91c48e05d86d'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:01:51.815921 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-4e31f217-0afe-4185-9f74-ffe5bbafe0ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfb2d2d26d59468aad7e91c48e05d86d'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:01:51.816759 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-4e31f217-0afe-4185-9f74-ffe5bbafe0ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfb2d2d26d59468aad7e91c48e05d86d'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:01:51.853456 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1e2e77-eafb-409d-8fdc-63fb7400b688 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:51.891095 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ad2ce7-4798-4cd2-ab39-a40e8496e2f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:51.891846 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ad2ce7-4798-4cd2-ab39-a40e8496e2f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:51.892108 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ad2ce7-4798-4cd2-ab39-a40e8496e2f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:51.892592 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ad2ce7-4798-4cd2-ab39-a40e8496e2f8 admin admin] PATH_INFO: `/v3/users/2b9002360ca64c4eb198798944f9bd0e` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:51.897647 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ad2ce7-4798-4cd2-ab39-a40e8496e2f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b9002360ca64c4eb198798944f9bd0e)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:51.903869 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ad2ce7-4798-4cd2-ab39-a40e8496e2f8 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:52.301405 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-4e31f217-0afe-4185-9f74-ffe5bbafe0ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfb2d2d26d59468aad7e91c48e05d86d'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:01:52.351991 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 893/1773] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Oct 4 12:01:51 2022] DELETE /identity/v3/users/bfb2d2d26d59468aad7e91c48e05d86d => generated 0 bytes in 1165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:01:52.353561 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a1f28-3e33-4cd5-90f5-1bf93c7a663c None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:52.354007 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a1f28-3e33-4cd5-90f5-1bf93c7a663c None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:52.354436 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a1f28-3e33-4cd5-90f5-1bf93c7a663c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:52.412506 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-cf3a1f28-3e33-4cd5-90f5-1bf93c7a663c None None] MFA Rules not processed for user `81526330023c4ce587f056e96c88992b`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:01:52.414921 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-cf3a1f28-3e33-4cd5-90f5-1bf93c7a663c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:01:52.547909 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 894/1774] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:01:52 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:01:52.549984 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfc3d8a-8090-4a84-9afb-4d441c7f6ca5 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:52.549984 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfc3d8a-8090-4a84-9afb-4d441c7f6ca5 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:52.550337 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfc3d8a-8090-4a84-9afb-4d441c7f6ca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:52.573983 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-8cfc3d8a-8090-4a84-9afb-4d441c7f6ca5 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:01:52.575891 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-8cfc3d8a-8090-4a84-9afb-4d441c7f6ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:01:52.702953 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 895/1775] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:01:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:01:52.702953 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38f4e5a-4a7f-411b-9233-cdb594f9272a None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:52.702953 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38f4e5a-4a7f-411b-9233-cdb594f9272a None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:52.702953 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38f4e5a-4a7f-411b-9233-cdb594f9272a None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:52.702953 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 896/1776] 10.222.0.59 () {54 vars in 921 bytes} [Tue Oct 4 12:01:52 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:01:52.702953 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abd3b62-db6a-43e4-9688-c6f704b6c18e None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:52.702953 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abd3b62-db6a-43e4-9688-c6f704b6c18e None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:52.704849 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abd3b62-db6a-43e4-9688-c6f704b6c18e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:52.734699 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:01:52.760209 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-9abd3b62-db6a-43e4-9688-c6f704b6c18e None None] MFA Rules not processed for user `a8e23d1d2fe24bdf9552e7c2f0ae3424`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:01:52.762044 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-9abd3b62-db6a-43e4-9688-c6f704b6c18e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:01:52.773744 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-93ad2ce7-4798-4cd2-ab39-a40e8496e2f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b9002360ca64c4eb198798944f9bd0e'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:01:52.791310 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-93ad2ce7-4798-4cd2-ab39-a40e8496e2f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b9002360ca64c4eb198798944f9bd0e'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:01:52.794323 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-93ad2ce7-4798-4cd2-ab39-a40e8496e2f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b9002360ca64c4eb198798944f9bd0e'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:01:52.795532 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-93ad2ce7-4798-4cd2-ab39-a40e8496e2f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b9002360ca64c4eb198798944f9bd0e'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:01:52.874285 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 897/1777] 10.222.0.59 () {58 vars in 1018 bytes} [Tue Oct 4 12:01:52 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 12:01:52.875653 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abd3b62-db6a-43e4-9688-c6f704b6c18e None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:52.877429 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-9abd3b62-db6a-43e4-9688-c6f704b6c18e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:01:52.897226 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abd3b62-db6a-43e4-9688-c6f704b6c18e None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:52.944530 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edd59cb-0c2e-4ffc-91d1-a174b6af8a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:52.945601 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edd59cb-0c2e-4ffc-91d1-a174b6af8a04 admin admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:52.945601 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edd59cb-0c2e-4ffc-91d1-a174b6af8a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:52.951421 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edd59cb-0c2e-4ffc-91d1-a174b6af8a04 admin admin] PATH_INFO: `/v3/projects` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:52.952040 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edd59cb-0c2e-4ffc-91d1-a174b6af8a04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:52.955727 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edd59cb-0c2e-4ffc-91d1-a174b6af8a04 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:53.396228 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-93ad2ce7-4798-4cd2-ab39-a40e8496e2f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b9002360ca64c4eb198798944f9bd0e'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:01:53.428848 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 881/1778] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Oct 4 12:01:51 2022] DELETE /identity/v3/users/2b9002360ca64c4eb198798944f9bd0e => generated 0 bytes in 1806 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:01:53.430089 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ad2ce7-4798-4cd2-ab39-a40e8496e2f8 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:53.438576 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-93ad2ce7-4798-4cd2-ab39-a40e8496e2f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:01:53.466781 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 898/1779] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Oct 4 12:01:52 2022] POST /identity/v3/projects => generated 379 bytes in 591 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:01:53.466781 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edd59cb-0c2e-4ffc-91d1-a174b6af8a04 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:53.625774 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-1edd59cb-0c2e-4ffc-91d1-a174b6af8a04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:01:53.626712 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ad2ce7-4798-4cd2-ab39-a40e8496e2f8 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:53.627155 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edd59cb-0c2e-4ffc-91d1-a174b6af8a04 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:53.627155 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdfe327-3a9d-4657-8236-a7e45726cd21 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8e23d1d2fe24bdf9552e7c2f0ae3424', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:53.627155 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdfe327-3a9d-4657-8236-a7e45726cd21 service nova] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:53.627155 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdfe327-3a9d-4657-8236-a7e45726cd21 service nova] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:53.627678 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdfe327-3a9d-4657-8236-a7e45726cd21 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:53.627678 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdfe327-3a9d-4657-8236-a7e45726cd21 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:53.627678 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdfe327-3a9d-4657-8236-a7e45726cd21 service nova] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:53.627678 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 899/1780] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:01:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:01:53.627678 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaace63d-1165-42a6-a8ae-26a600ad6886 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:53.627678 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaace63d-1165-42a6-a8ae-26a600ad6886 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:53.628686 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaace63d-1165-42a6-a8ae-26a600ad6886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:53.628881 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836a53a9-5e50-4b07-bf24-467d7e794a06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7289515c5c44914a19daa439de98cb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:53.628991 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-eaace63d-1165-42a6-a8ae-26a600ad6886 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:01:53.629163 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836a53a9-5e50-4b07-bf24-467d7e794a06 service neutron] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:53.629163 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836a53a9-5e50-4b07-bf24-467d7e794a06 service neutron] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:53.629163 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836a53a9-5e50-4b07-bf24-467d7e794a06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:53.629402 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-eaace63d-1165-42a6-a8ae-26a600ad6886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:01:53.629496 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-836a53a9-5e50-4b07-bf24-467d7e794a06 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:01:53.790415 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 900/1781] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:01:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:01:53.792071 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaace63d-1165-42a6-a8ae-26a600ad6886 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:53.799242 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836a53a9-5e50-4b07-bf24-467d7e794a06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:53.802693 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836a53a9-5e50-4b07-bf24-467d7e794a06 service neutron] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:53.818743 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaace63d-1165-42a6-a8ae-26a600ad6886 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:53.827817 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 882/1782] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:01:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:01:53.829991 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836a53a9-5e50-4b07-bf24-467d7e794a06 service neutron] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:53.830862 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90014251-5786-41d9-94c5-db48214fcc22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:53.840652 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90014251-5786-41d9-94c5-db48214fcc22 admin admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:53.840652 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90014251-5786-41d9-94c5-db48214fcc22 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:53.840652 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90014251-5786-41d9-94c5-db48214fcc22 admin admin] PATH_INFO: `/v3/users` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:53.840652 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90014251-5786-41d9-94c5-db48214fcc22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:53.840652 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90014251-5786-41d9-94c5-db48214fcc22 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:53.846371 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836a53a9-5e50-4b07-bf24-467d7e794a06 service neutron] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:53.853278 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526b563e-ad57-4861-8997-8419d60c5452 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7289515c5c44914a19daa439de98cb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:53.854174 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526b563e-ad57-4861-8997-8419d60c5452 service neutron] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:53.854523 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526b563e-ad57-4861-8997-8419d60c5452 service neutron] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:53.854862 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526b563e-ad57-4861-8997-8419d60c5452 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:53.867946 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526b563e-ad57-4861-8997-8419d60c5452 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:53.869537 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526b563e-ad57-4861-8997-8419d60c5452 service neutron] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:53.886897 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 883/1783] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:01:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:01:54.029915 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526b563e-ad57-4861-8997-8419d60c5452 service neutron] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:54.040008 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 901/1784] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Oct 4 12:01:53 2022] POST /identity/v3/users => generated 296 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:01:54.042939 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526b563e-ad57-4861-8997-8419d60c5452 service neutron] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:54.048393 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6a1cc1-5b1d-44a0-ae7e-9d1fde9349da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:54.049071 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6a1cc1-5b1d-44a0-ae7e-9d1fde9349da admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:54.049650 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6a1cc1-5b1d-44a0-ae7e-9d1fde9349da admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:54.049923 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6a1cc1-5b1d-44a0-ae7e-9d1fde9349da admin admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:54.050556 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6a1cc1-5b1d-44a0-ae7e-9d1fde9349da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:54.054450 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6a1cc1-5b1d-44a0-ae7e-9d1fde9349da admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:54.067553 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 884/1785] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:01:54 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:01:54.071400 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90014251-5786-41d9-94c5-db48214fcc22 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:54.084682 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90014251-5786-41d9-94c5-db48214fcc22 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:54.091970 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d0581a-624f-46ab-b975-00a45d302d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:54.092866 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d0581a-624f-46ab-b975-00a45d302d70 admin admin] REQUEST_METHOD: `PUT` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:54.093152 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d0581a-624f-46ab-b975-00a45d302d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:54.093428 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d0581a-624f-46ab-b975-00a45d302d70 admin admin] PATH_INFO: `/v3/projects/b53a8ba20fac42f2ba35ed515011f9ff/users/162826ded01c435aa8ae4a86d49428f2/roles/d6e7421d1ff9451c808004b818354550` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:54.097990 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b52d09c-a1de-4f53-afc8-6d59f8fa25bd None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:54.098340 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b52d09c-a1de-4f53-afc8-6d59f8fa25bd None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:54.099207 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b52d09c-a1de-4f53-afc8-6d59f8fa25bd None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:54.101031 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 885/1786] 10.222.0.59 () {54 vars in 921 bytes} [Tue Oct 4 12:01:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:01:54.165631 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d0581a-624f-46ab-b975-00a45d302d70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b53a8ba20fac42f2ba35ed515011f9ff, user_id=162826ded01c435aa8ae4a86d49428f2, role_id=d6e7421d1ff9451c808004b818354550)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:54.171385 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d0581a-624f-46ab-b975-00a45d302d70 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:54.186062 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3ce68a-2830-4f88-8a46-17dc70c503d4 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:54.186451 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3ce68a-2830-4f88-8a46-17dc70c503d4 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:54.186802 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3ce68a-2830-4f88-8a46-17dc70c503d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:54.263799 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-9b3ce68a-2830-4f88-8a46-17dc70c503d4 None None] MFA Rules not processed for user `a8e23d1d2fe24bdf9552e7c2f0ae3424`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:01:54.266081 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-9b3ce68a-2830-4f88-8a46-17dc70c503d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:01:54.324381 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 886/1787] 10.222.0.59 () {58 vars in 1018 bytes} [Tue Oct 4 12:01:54 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:01:54.632470 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3ce68a-2830-4f88-8a46-17dc70c503d4 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:54.657071 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3ce68a-2830-4f88-8a46-17dc70c503d4 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:54.669321 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 902/1788] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Oct 4 12:01:54 2022] PUT /identity/v3/projects/b53a8ba20fac42f2ba35ed515011f9ff/users/162826ded01c435aa8ae4a86d49428f2/roles/d6e7421d1ff9451c808004b818354550 => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:01:54.675338 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097aaf0a-ab63-425e-ad2d-69879f654e93 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8e23d1d2fe24bdf9552e7c2f0ae3424', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:54.675338 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097aaf0a-ab63-425e-ad2d-69879f654e93 service nova] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:54.675651 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d0581a-624f-46ab-b975-00a45d302d70 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:54.675763 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097aaf0a-ab63-425e-ad2d-69879f654e93 service nova] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:54.675763 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097aaf0a-ab63-425e-ad2d-69879f654e93 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:54.719925 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097aaf0a-ab63-425e-ad2d-69879f654e93 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:54.728468 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097aaf0a-ab63-425e-ad2d-69879f654e93 service nova] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:54.761765 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 887/1789] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:01:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:01:54.806599 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d0581a-624f-46ab-b975-00a45d302d70 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:54.813983 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7573d492-daf7-45ab-8087-71118b649ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:54.861439 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7573d492-daf7-45ab-8087-71118b649ba9 admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:54.861439 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7573d492-daf7-45ab-8087-71118b649ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:54.861439 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7573d492-daf7-45ab-8087-71118b649ba9 admin admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:54.861439 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7573d492-daf7-45ab-8087-71118b649ba9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:54.861439 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7573d492-daf7-45ab-8087-71118b649ba9 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:54.861439 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 903/1790] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:01:54 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:01:54.862307 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097aaf0a-ab63-425e-ad2d-69879f654e93 service nova] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:54.862307 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097aaf0a-ab63-425e-ad2d-69879f654e93 service nova] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:54.875901 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c3cd92-0500-4d68-986d-7a10d0eb0e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:54.876852 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c3cd92-0500-4d68-986d-7a10d0eb0e3e admin admin] REQUEST_METHOD: `PUT` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:54.879635 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c3cd92-0500-4d68-986d-7a10d0eb0e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:54.880131 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c3cd92-0500-4d68-986d-7a10d0eb0e3e admin admin] PATH_INFO: `/v3/projects/b53a8ba20fac42f2ba35ed515011f9ff/users/162826ded01c435aa8ae4a86d49428f2/roles/d6e7421d1ff9451c808004b818354550` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:54.884939 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c3cd92-0500-4d68-986d-7a10d0eb0e3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b53a8ba20fac42f2ba35ed515011f9ff, user_id=162826ded01c435aa8ae4a86d49428f2, role_id=d6e7421d1ff9451c808004b818354550)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:54.892283 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c3cd92-0500-4d68-986d-7a10d0eb0e3e admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:54.918621 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 888/1791] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Oct 4 12:01:54 2022] PUT /identity/v3/projects/b53a8ba20fac42f2ba35ed515011f9ff/users/162826ded01c435aa8ae4a86d49428f2/roles/d6e7421d1ff9451c808004b818354550 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:01:54.930174 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481647dc-9044-49ca-8d6f-a8b739944c69 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:54.931321 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481647dc-9044-49ca-8d6f-a8b739944c69 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:54.931725 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481647dc-9044-49ca-8d6f-a8b739944c69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:54.999276 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-481647dc-9044-49ca-8d6f-a8b739944c69 None None] MFA Rules not processed for user `162826ded01c435aa8ae4a86d49428f2`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:01:55.013675 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-481647dc-9044-49ca-8d6f-a8b739944c69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:01:55.204460 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 904/1792] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:01:54 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:01:55.222805 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c3cd92-0500-4d68-986d-7a10d0eb0e3e admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:55.225776 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-b4c3cd92-0500-4d68-986d-7a10d0eb0e3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:01:55.349279 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c3cd92-0500-4d68-986d-7a10d0eb0e3e admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:55.349279 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94294c54-ee32-492e-a5cf-8465080904dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e2a05b782424ab2928b5864f1bfd556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:55.349279 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94294c54-ee32-492e-a5cf-8465080904dc service cinder] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:55.349279 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94294c54-ee32-492e-a5cf-8465080904dc service cinder] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:55.349929 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94294c54-ee32-492e-a5cf-8465080904dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:55.389353 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94294c54-ee32-492e-a5cf-8465080904dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:55.390804 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94294c54-ee32-492e-a5cf-8465080904dc service cinder] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:55.415247 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 889/1793] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:01:55 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 12:01:56.008448 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481647dc-9044-49ca-8d6f-a8b739944c69 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:56.010128 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-481647dc-9044-49ca-8d6f-a8b739944c69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:01:56.157385 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481647dc-9044-49ca-8d6f-a8b739944c69 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:56.167102 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f619fe-751f-4f4f-b07a-9adf4083a7cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:56.168794 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f619fe-751f-4f4f-b07a-9adf4083a7cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:56.169522 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f619fe-751f-4f4f-b07a-9adf4083a7cd admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:56.170206 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f619fe-751f-4f4f-b07a-9adf4083a7cd admin admin] PATH_INFO: `/v3/projects/a26815aaa1754293bcfb062be21c18f4` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:56.174904 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f619fe-751f-4f4f-b07a-9adf4083a7cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=a26815aaa1754293bcfb062be21c18f4)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:56.178024 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f619fe-751f-4f4f-b07a-9adf4083a7cd admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:56.405735 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-04f619fe-751f-4f4f-b07a-9adf4083a7cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a26815aaa1754293bcfb062be21c18f4', 'request_id': 'req-04f619fe-751f-4f4f-b07a-9adf4083a7cd'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:01:56.842104 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-04f619fe-751f-4f4f-b07a-9adf4083a7cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a26815aaa1754293bcfb062be21c18f4', 'request_id': 'req-04f619fe-751f-4f4f-b07a-9adf4083a7cd'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:01:56.842104 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-04f619fe-751f-4f4f-b07a-9adf4083a7cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a26815aaa1754293bcfb062be21c18f4', 'request_id': 'req-04f619fe-751f-4f4f-b07a-9adf4083a7cd'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:01:56.880799 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-04f619fe-751f-4f4f-b07a-9adf4083a7cd admin admin] The token cache is being invalidate because project a26815aaa1754293bcfb062be21c18f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:01:56.883515 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-04f619fe-751f-4f4f-b07a-9adf4083a7cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:01:56.892360 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-04f619fe-751f-4f4f-b07a-9adf4083a7cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:01:56.908908 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 905/1794] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Oct 4 12:01:56 2022] DELETE /identity/v3/projects/a26815aaa1754293bcfb062be21c18f4 => generated 0 bytes in 900 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:01:56.912342 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94294c54-ee32-492e-a5cf-8465080904dc service cinder] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:56.939498 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94294c54-ee32-492e-a5cf-8465080904dc service cinder] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:57.010071 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f619fe-751f-4f4f-b07a-9adf4083a7cd admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:57.013717 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-04f619fe-751f-4f4f-b07a-9adf4083a7cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:01:57.149958 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102cdaa6-efb2-47a9-b356-87b93f424be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:57.150997 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102cdaa6-efb2-47a9-b356-87b93f424be4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:57.151474 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102cdaa6-efb2-47a9-b356-87b93f424be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:57.152088 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102cdaa6-efb2-47a9-b356-87b93f424be4 admin admin] PATH_INFO: `/v3/users/668b4216b4cc497cbe0f5156d4923d95` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:57.153740 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102cdaa6-efb2-47a9-b356-87b93f424be4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=668b4216b4cc497cbe0f5156d4923d95)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:57.158349 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102cdaa6-efb2-47a9-b356-87b93f424be4 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:57.196013 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f619fe-751f-4f4f-b07a-9adf4083a7cd admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:57.208434 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8a580f-ffd7-41e8-a88e-6b61b4d2a236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:57.208959 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8a580f-ffd7-41e8-a88e-6b61b4d2a236 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:57.209444 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8a580f-ffd7-41e8-a88e-6b61b4d2a236 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:57.209754 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8a580f-ffd7-41e8-a88e-6b61b4d2a236 admin admin] PATH_INFO: `/v3/projects/74c11c400c664d3b9ec81296155eb5d4` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:57.211934 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8a580f-ffd7-41e8-a88e-6b61b4d2a236 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74c11c400c664d3b9ec81296155eb5d4)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:57.215272 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8a580f-ffd7-41e8-a88e-6b61b4d2a236 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:57.538252 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-102cdaa6-efb2-47a9-b356-87b93f424be4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '668b4216b4cc497cbe0f5156d4923d95'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:01:57.551435 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-102cdaa6-efb2-47a9-b356-87b93f424be4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '668b4216b4cc497cbe0f5156d4923d95'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:01:57.554075 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-102cdaa6-efb2-47a9-b356-87b93f424be4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '668b4216b4cc497cbe0f5156d4923d95'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:01:57.555572 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-102cdaa6-efb2-47a9-b356-87b93f424be4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '668b4216b4cc497cbe0f5156d4923d95'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:01:57.555777 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-db8a580f-ffd7-41e8-a88e-6b61b4d2a236 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74c11c400c664d3b9ec81296155eb5d4', 'request_id': 'req-db8a580f-ffd7-41e8-a88e-6b61b4d2a236'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:01:57.645997 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-102cdaa6-efb2-47a9-b356-87b93f424be4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '668b4216b4cc497cbe0f5156d4923d95'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:01:57.763402 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 890/1795] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Oct 4 12:01:56 2022] DELETE /identity/v3/users/668b4216b4cc497cbe0f5156d4923d95 => generated 0 bytes in 845 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:01:58.120868 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-db8a580f-ffd7-41e8-a88e-6b61b4d2a236 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74c11c400c664d3b9ec81296155eb5d4', 'request_id': 'req-db8a580f-ffd7-41e8-a88e-6b61b4d2a236'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:01:58.133164 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-db8a580f-ffd7-41e8-a88e-6b61b4d2a236 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74c11c400c664d3b9ec81296155eb5d4', 'request_id': 'req-db8a580f-ffd7-41e8-a88e-6b61b4d2a236'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:01:58.161322 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-db8a580f-ffd7-41e8-a88e-6b61b4d2a236 admin admin] The token cache is being invalidate because project 74c11c400c664d3b9ec81296155eb5d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:01:58.161665 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-db8a580f-ffd7-41e8-a88e-6b61b4d2a236 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:01:58.164830 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-db8a580f-ffd7-41e8-a88e-6b61b4d2a236 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:01:58.173076 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 906/1796] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Oct 4 12:01:57 2022] DELETE /identity/v3/projects/74c11c400c664d3b9ec81296155eb5d4 => generated 0 bytes in 1164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:01:58.175359 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102cdaa6-efb2-47a9-b356-87b93f424be4 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:58.177533 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-102cdaa6-efb2-47a9-b356-87b93f424be4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:01:58.389241 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102cdaa6-efb2-47a9-b356-87b93f424be4 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:58.389241 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3871cff-47a0-489a-be12-5e1b65b470d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:58.389241 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3871cff-47a0-489a-be12-5e1b65b470d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:58.389241 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3871cff-47a0-489a-be12-5e1b65b470d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:58.391315 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3871cff-47a0-489a-be12-5e1b65b470d7 admin admin] PATH_INFO: `/v3/users/38fa39eba2094094bf3e7b53d4330c42` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:58.391315 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3871cff-47a0-489a-be12-5e1b65b470d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38fa39eba2094094bf3e7b53d4330c42)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:58.391315 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3871cff-47a0-489a-be12-5e1b65b470d7 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:58.643494 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8a580f-ffd7-41e8-a88e-6b61b4d2a236 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:58.646728 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-db8a580f-ffd7-41e8-a88e-6b61b4d2a236 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:01:58.722242 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-e3871cff-47a0-489a-be12-5e1b65b470d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38fa39eba2094094bf3e7b53d4330c42'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:01:58.759628 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-e3871cff-47a0-489a-be12-5e1b65b470d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38fa39eba2094094bf3e7b53d4330c42'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:01:58.762870 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-e3871cff-47a0-489a-be12-5e1b65b470d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38fa39eba2094094bf3e7b53d4330c42'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:01:58.766374 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-e3871cff-47a0-489a-be12-5e1b65b470d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38fa39eba2094094bf3e7b53d4330c42'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:01:58.868109 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8a580f-ffd7-41e8-a88e-6b61b4d2a236 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:59.026337 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24d6c45-f474-41fb-a39a-5542479c561e tempest-VolumeQuotaClassesTest-945112324 tempest-VolumeQuotaClassesTest-945112324-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '162826ded01c435aa8ae4a86d49428f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b53a8ba20fac42f2ba35ed515011f9ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:59.027040 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24d6c45-f474-41fb-a39a-5542479c561e tempest-VolumeQuotaClassesTest-945112324 tempest-VolumeQuotaClassesTest-945112324-project-admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:59.029043 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24d6c45-f474-41fb-a39a-5542479c561e tempest-VolumeQuotaClassesTest-945112324 tempest-VolumeQuotaClassesTest-945112324-project-admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:59.029407 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24d6c45-f474-41fb-a39a-5542479c561e tempest-VolumeQuotaClassesTest-945112324 tempest-VolumeQuotaClassesTest-945112324-project-admin] PATH_INFO: `/v3/domains` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:59.030155 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24d6c45-f474-41fb-a39a-5542479c561e tempest-VolumeQuotaClassesTest-945112324 tempest-VolumeQuotaClassesTest-945112324-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:01:59.031374 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24d6c45-f474-41fb-a39a-5542479c561e tempest-VolumeQuotaClassesTest-945112324 tempest-VolumeQuotaClassesTest-945112324-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:59.033170 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24d6c45-f474-41fb-a39a-5542479c561e tempest-VolumeQuotaClassesTest-945112324 tempest-VolumeQuotaClassesTest-945112324-project-admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:59.050056 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-e3871cff-47a0-489a-be12-5e1b65b470d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38fa39eba2094094bf3e7b53d4330c42'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:01:59.083699 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 907/1797] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Oct 4 12:01:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 437 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:01:59.085137 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24d6c45-f474-41fb-a39a-5542479c561e tempest-VolumeQuotaClassesTest-945112324 tempest-VolumeQuotaClassesTest-945112324-project-admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:59.098240 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 891/1798] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Oct 4 12:01:58 2022] DELETE /identity/v3/users/38fa39eba2094094bf3e7b53d4330c42 => generated 0 bytes in 921 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:01:59.098601 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-e24d6c45-f474-41fb-a39a-5542479c561e tempest-VolumeQuotaClassesTest-945112324 tempest-VolumeQuotaClassesTest-945112324-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:01:59.126600 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24d6c45-f474-41fb-a39a-5542479c561e tempest-VolumeQuotaClassesTest-945112324 tempest-VolumeQuotaClassesTest-945112324-project-admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:59.163748 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:01:59.311545 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61352b87-8a7d-40da-9125-f23d60f0f400 tempest-VolumeQuotaClassesTest-945112324 tempest-VolumeQuotaClassesTest-945112324-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '162826ded01c435aa8ae4a86d49428f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b53a8ba20fac42f2ba35ed515011f9ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:59.313435 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61352b87-8a7d-40da-9125-f23d60f0f400 tempest-VolumeQuotaClassesTest-945112324 tempest-VolumeQuotaClassesTest-945112324-project-admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:59.313435 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61352b87-8a7d-40da-9125-f23d60f0f400 tempest-VolumeQuotaClassesTest-945112324 tempest-VolumeQuotaClassesTest-945112324-project-admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:59.313435 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61352b87-8a7d-40da-9125-f23d60f0f400 tempest-VolumeQuotaClassesTest-945112324 tempest-VolumeQuotaClassesTest-945112324-project-admin] PATH_INFO: `/v3/projects` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:59.313688 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61352b87-8a7d-40da-9125-f23d60f0f400 tempest-VolumeQuotaClassesTest-945112324 tempest-VolumeQuotaClassesTest-945112324-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:59.315560 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61352b87-8a7d-40da-9125-f23d60f0f400 tempest-VolumeQuotaClassesTest-945112324 tempest-VolumeQuotaClassesTest-945112324-project-admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:01:59.780519 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 908/1799] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Oct 4 12:01:59 2022] POST /identity/v3/projects => generated 354 bytes in 696 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:01:59.788503 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3871cff-47a0-489a-be12-5e1b65b470d7 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:59.818501 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61352b87-8a7d-40da-9125-f23d60f0f400 tempest-VolumeQuotaClassesTest-945112324 tempest-VolumeQuotaClassesTest-945112324-project-admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:01:59.825097 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3871cff-47a0-489a-be12-5e1b65b470d7 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:01:59.834194 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-61352b87-8a7d-40da-9125-f23d60f0f400 tempest-VolumeQuotaClassesTest-945112324 tempest-VolumeQuotaClassesTest-945112324-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:01:59.953839 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eff3c2-8faf-4314-9e9f-000624b9f6b9 tempest-VolumeQuotaClassesTest-945112324 tempest-VolumeQuotaClassesTest-945112324-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '162826ded01c435aa8ae4a86d49428f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b53a8ba20fac42f2ba35ed515011f9ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:01:59.955564 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eff3c2-8faf-4314-9e9f-000624b9f6b9 tempest-VolumeQuotaClassesTest-945112324 tempest-VolumeQuotaClassesTest-945112324-project-admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:01:59.955880 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eff3c2-8faf-4314-9e9f-000624b9f6b9 tempest-VolumeQuotaClassesTest-945112324 tempest-VolumeQuotaClassesTest-945112324-project-admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:01:59.956196 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eff3c2-8faf-4314-9e9f-000624b9f6b9 tempest-VolumeQuotaClassesTest-945112324 tempest-VolumeQuotaClassesTest-945112324-project-admin] PATH_INFO: `/v3/domains` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:01:59.957049 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19eff3c2-8faf-4314-9e9f-000624b9f6b9 tempest-VolumeQuotaClassesTest-945112324 tempest-VolumeQuotaClassesTest-945112324-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:01:59.957397 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19eff3c2-8faf-4314-9e9f-000624b9f6b9 tempest-VolumeQuotaClassesTest-945112324 tempest-VolumeQuotaClassesTest-945112324-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:01:59.992098 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19eff3c2-8faf-4314-9e9f-000624b9f6b9 tempest-VolumeQuotaClassesTest-945112324 tempest-VolumeQuotaClassesTest-945112324-project-admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:00.054708 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 892/1800] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Oct 4 12:01:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:02:00.083620 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61352b87-8a7d-40da-9125-f23d60f0f400 tempest-VolumeQuotaClassesTest-945112324 tempest-VolumeQuotaClassesTest-945112324-project-admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:00.109504 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48264d5-4b14-41af-a0f7-56392f1adc9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:00.122282 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48264d5-4b14-41af-a0f7-56392f1adc9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:00.122282 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48264d5-4b14-41af-a0f7-56392f1adc9d admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:00.122282 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48264d5-4b14-41af-a0f7-56392f1adc9d admin admin] PATH_INFO: `/v3/projects/7e698e5c030f40f4b73a1a136fa499bb` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:00.122282 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48264d5-4b14-41af-a0f7-56392f1adc9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e698e5c030f40f4b73a1a136fa499bb)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:00.122282 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48264d5-4b14-41af-a0f7-56392f1adc9d admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:00.147927 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eff3c2-8faf-4314-9e9f-000624b9f6b9 tempest-VolumeQuotaClassesTest-945112324 tempest-VolumeQuotaClassesTest-945112324-project-admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:00.170981 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eff3c2-8faf-4314-9e9f-000624b9f6b9 tempest-VolumeQuotaClassesTest-945112324 tempest-VolumeQuotaClassesTest-945112324-project-admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:00.179494 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7e5131-8840-4433-b383-14b6be9bcf48 tempest-VolumeQuotaClassesTest-945112324 tempest-VolumeQuotaClassesTest-945112324-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '162826ded01c435aa8ae4a86d49428f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b53a8ba20fac42f2ba35ed515011f9ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:00.180204 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7e5131-8840-4433-b383-14b6be9bcf48 tempest-VolumeQuotaClassesTest-945112324 tempest-VolumeQuotaClassesTest-945112324-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:00.180489 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7e5131-8840-4433-b383-14b6be9bcf48 tempest-VolumeQuotaClassesTest-945112324 tempest-VolumeQuotaClassesTest-945112324-project-admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:00.180802 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7e5131-8840-4433-b383-14b6be9bcf48 tempest-VolumeQuotaClassesTest-945112324 tempest-VolumeQuotaClassesTest-945112324-project-admin] PATH_INFO: `/v3/projects/ce3ff340382e4840b6bfff63a920684b` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:00.190113 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7e5131-8840-4433-b383-14b6be9bcf48 tempest-VolumeQuotaClassesTest-945112324 tempest-VolumeQuotaClassesTest-945112324-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ce3ff340382e4840b6bfff63a920684b)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:00.192586 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7e5131-8840-4433-b383-14b6be9bcf48 tempest-VolumeQuotaClassesTest-945112324 tempest-VolumeQuotaClassesTest-945112324-project-admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:00.309355 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-e48264d5-4b14-41af-a0f7-56392f1adc9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e698e5c030f40f4b73a1a136fa499bb', 'request_id': 'req-e48264d5-4b14-41af-a0f7-56392f1adc9d'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:00.771096 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-7f7e5131-8840-4433-b383-14b6be9bcf48 tempest-VolumeQuotaClassesTest-945112324 tempest-VolumeQuotaClassesTest-945112324-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce3ff340382e4840b6bfff63a920684b', 'request_id': 'req-7f7e5131-8840-4433-b383-14b6be9bcf48'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:00.826429 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-7f7e5131-8840-4433-b383-14b6be9bcf48 tempest-VolumeQuotaClassesTest-945112324 tempest-VolumeQuotaClassesTest-945112324-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce3ff340382e4840b6bfff63a920684b', 'request_id': 'req-7f7e5131-8840-4433-b383-14b6be9bcf48'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:01.027882 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-e48264d5-4b14-41af-a0f7-56392f1adc9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e698e5c030f40f4b73a1a136fa499bb', 'request_id': 'req-e48264d5-4b14-41af-a0f7-56392f1adc9d'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:01.036586 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-e48264d5-4b14-41af-a0f7-56392f1adc9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e698e5c030f40f4b73a1a136fa499bb', 'request_id': 'req-e48264d5-4b14-41af-a0f7-56392f1adc9d'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:01.047053 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-e48264d5-4b14-41af-a0f7-56392f1adc9d admin admin] The token cache is being invalidate because project 7e698e5c030f40f4b73a1a136fa499bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:02:01.047342 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-e48264d5-4b14-41af-a0f7-56392f1adc9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:01.048037 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-e48264d5-4b14-41af-a0f7-56392f1adc9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:01.049777 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 909/1801] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Oct 4 12:01:59 2022] DELETE /identity/v3/projects/7e698e5c030f40f4b73a1a136fa499bb => generated 0 bytes in 1236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:02:01.055541 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d613df9a-d1af-4a52-8b42-ddc5fe61c72f None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:01.059704 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d613df9a-d1af-4a52-8b42-ddc5fe61c72f None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:01.059704 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d613df9a-d1af-4a52-8b42-ddc5fe61c72f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:01.078843 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-d613df9a-d1af-4a52-8b42-ddc5fe61c72f None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:02:01.079955 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-d613df9a-d1af-4a52-8b42-ddc5fe61c72f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:01.155009 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 910/1802] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:02:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 12:02:01.162423 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba317042-0d5c-497c-ae00-de88be1ca3b3 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:01.162719 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba317042-0d5c-497c-ae00-de88be1ca3b3 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:01.162999 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba317042-0d5c-497c-ae00-de88be1ca3b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:01.184664 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-ba317042-0d5c-497c-ae00-de88be1ca3b3 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:02:01.185965 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-ba317042-0d5c-497c-ae00-de88be1ca3b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:01.195126 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 911/1803] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:02:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 12:02:01.211458 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba317042-0d5c-497c-ae00-de88be1ca3b3 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:01.211458 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba317042-0d5c-497c-ae00-de88be1ca3b3 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:01.216635 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0380d95-9577-4c7c-bf56-4863a48bc637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:01.217227 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0380d95-9577-4c7c-bf56-4863a48bc637 admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:01.217509 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0380d95-9577-4c7c-bf56-4863a48bc637 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:01.217960 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0380d95-9577-4c7c-bf56-4863a48bc637 admin admin] PATH_INFO: `/v3/domains` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:01.218420 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0380d95-9577-4c7c-bf56-4863a48bc637 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:02:01.218718 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0380d95-9577-4c7c-bf56-4863a48bc637 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:01.220492 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0380d95-9577-4c7c-bf56-4863a48bc637 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:01.233401 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-7f7e5131-8840-4433-b383-14b6be9bcf48 tempest-VolumeQuotaClassesTest-945112324 tempest-VolumeQuotaClassesTest-945112324-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce3ff340382e4840b6bfff63a920684b', 'request_id': 'req-7f7e5131-8840-4433-b383-14b6be9bcf48'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:01.240749 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 912/1804] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Oct 4 12:02:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:02:01.240749 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0380d95-9577-4c7c-bf56-4863a48bc637 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:01.242204 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-d0380d95-9577-4c7c-bf56-4863a48bc637 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:01.250873 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-7f7e5131-8840-4433-b383-14b6be9bcf48 tempest-VolumeQuotaClassesTest-945112324 tempest-VolumeQuotaClassesTest-945112324-project-admin] The token cache is being invalidate because project ce3ff340382e4840b6bfff63a920684b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:02:01.255088 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-7f7e5131-8840-4433-b383-14b6be9bcf48 tempest-VolumeQuotaClassesTest-945112324 tempest-VolumeQuotaClassesTest-945112324-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:01.255088 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-7f7e5131-8840-4433-b383-14b6be9bcf48 tempest-VolumeQuotaClassesTest-945112324 tempest-VolumeQuotaClassesTest-945112324-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:01.255088 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 893/1805] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Oct 4 12:02:00 2022] DELETE /identity/v3/projects/ce3ff340382e4840b6bfff63a920684b => generated 0 bytes in 1107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:02:01.255088 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7e5131-8840-4433-b383-14b6be9bcf48 tempest-VolumeQuotaClassesTest-945112324 tempest-VolumeQuotaClassesTest-945112324-project-admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:01.260755 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0380d95-9577-4c7c-bf56-4863a48bc637 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:01.261487 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-7f7e5131-8840-4433-b383-14b6be9bcf48 tempest-VolumeQuotaClassesTest-945112324 tempest-VolumeQuotaClassesTest-945112324-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:01.268067 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a4ec2c-751e-41d3-810f-066a8711a087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:01.268938 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a4ec2c-751e-41d3-810f-066a8711a087 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:01.269288 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a4ec2c-751e-41d3-810f-066a8711a087 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:01.269631 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a4ec2c-751e-41d3-810f-066a8711a087 admin admin] PATH_INFO: `/v3/projects/7d54b0bcd5d5451ba84a644daac950d1` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:01.272761 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a4ec2c-751e-41d3-810f-066a8711a087 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d54b0bcd5d5451ba84a644daac950d1)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:01.276781 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a4ec2c-751e-41d3-810f-066a8711a087 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:01.280083 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7e5131-8840-4433-b383-14b6be9bcf48 tempest-VolumeQuotaClassesTest-945112324 tempest-VolumeQuotaClassesTest-945112324-project-admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:01.285283 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e67490-14db-4dba-ba0b-5041ff027927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:01.286183 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e67490-14db-4dba-ba0b-5041ff027927 admin admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:01.286650 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e67490-14db-4dba-ba0b-5041ff027927 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:01.286948 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e67490-14db-4dba-ba0b-5041ff027927 admin admin] PATH_INFO: `/v3/projects` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:01.287624 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e67490-14db-4dba-ba0b-5041ff027927 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:01.289995 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e67490-14db-4dba-ba0b-5041ff027927 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:01.435131 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 894/1806] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Oct 4 12:02:01 2022] POST /identity/v3/projects => generated 387 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:02:01.439238 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e67490-14db-4dba-ba0b-5041ff027927 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:01.446247 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-70a4ec2c-751e-41d3-810f-066a8711a087 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d54b0bcd5d5451ba84a644daac950d1', 'request_id': 'req-70a4ec2c-751e-41d3-810f-066a8711a087'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:01.550784 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-70a4ec2c-751e-41d3-810f-066a8711a087 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d54b0bcd5d5451ba84a644daac950d1', 'request_id': 'req-70a4ec2c-751e-41d3-810f-066a8711a087'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:01.560652 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-70a4ec2c-751e-41d3-810f-066a8711a087 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d54b0bcd5d5451ba84a644daac950d1', 'request_id': 'req-70a4ec2c-751e-41d3-810f-066a8711a087'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:01.564235 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e67490-14db-4dba-ba0b-5041ff027927 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:01.570614 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbb72b4-ef75-443f-96f9-d6966136b747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:01.571240 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbb72b4-ef75-443f-96f9-d6966136b747 admin admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:01.571515 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbb72b4-ef75-443f-96f9-d6966136b747 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:01.571789 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbb72b4-ef75-443f-96f9-d6966136b747 admin admin] PATH_INFO: `/v3/users` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:01.572428 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbb72b4-ef75-443f-96f9-d6966136b747 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:01.575963 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-70a4ec2c-751e-41d3-810f-066a8711a087 admin admin] The token cache is being invalidate because project 7d54b0bcd5d5451ba84a644daac950d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:02:01.576384 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-70a4ec2c-751e-41d3-810f-066a8711a087 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:01.576592 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbb72b4-ef75-443f-96f9-d6966136b747 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:01.577853 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-70a4ec2c-751e-41d3-810f-066a8711a087 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:01.583592 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 913/1807] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Oct 4 12:02:01 2022] DELETE /identity/v3/projects/7d54b0bcd5d5451ba84a644daac950d1 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:02:01.587156 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d227467b-1de1-4959-8c5b-fe582f02a604 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:01.587156 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d227467b-1de1-4959-8c5b-fe582f02a604 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:01.587156 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d227467b-1de1-4959-8c5b-fe582f02a604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:01.611237 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-d227467b-1de1-4959-8c5b-fe582f02a604 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:02:01.612728 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-d227467b-1de1-4959-8c5b-fe582f02a604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:01.634010 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 914/1808] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:02:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:02:01.655906 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106448aa-25eb-4110-ab63-8622fc36c694 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:01.655906 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106448aa-25eb-4110-ab63-8622fc36c694 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:01.655906 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106448aa-25eb-4110-ab63-8622fc36c694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:01.656284 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:02:01.669806 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-106448aa-25eb-4110-ab63-8622fc36c694 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:02:01.671277 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-106448aa-25eb-4110-ab63-8622fc36c694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:01.686532 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 915/1809] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:02:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 12:02:01.691096 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106448aa-25eb-4110-ab63-8622fc36c694 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:01.703778 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106448aa-25eb-4110-ab63-8622fc36c694 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:01.721967 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d198fa3-bbfe-4828-a3b4-b49d5ab3d8d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:01.721967 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d198fa3-bbfe-4828-a3b4-b49d5ab3d8d2 admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:01.721967 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d198fa3-bbfe-4828-a3b4-b49d5ab3d8d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:01.721967 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d198fa3-bbfe-4828-a3b4-b49d5ab3d8d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:01.723060 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d198fa3-bbfe-4828-a3b4-b49d5ab3d8d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:02:01.723060 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d198fa3-bbfe-4828-a3b4-b49d5ab3d8d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:01.723060 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d198fa3-bbfe-4828-a3b4-b49d5ab3d8d2 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:01.743878 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 895/1810] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Oct 4 12:02:01 2022] POST /identity/v3/users => generated 294 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 12:02:01.744097 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 916/1811] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Oct 4 12:02:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:02:01.745101 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbb72b4-ef75-443f-96f9-d6966136b747 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:01.746963 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-4dbb72b4-ef75-443f-96f9-d6966136b747 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:01.748082 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d198fa3-bbfe-4828-a3b4-b49d5ab3d8d2 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:01.759217 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d198fa3-bbfe-4828-a3b4-b49d5ab3d8d2 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:01.760746 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbb72b4-ef75-443f-96f9-d6966136b747 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:01.764714 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1114038-2f68-4342-8286-f557cda158eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:01.765485 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1114038-2f68-4342-8286-f557cda158eb admin admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:01.765776 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1114038-2f68-4342-8286-f557cda158eb admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:01.765904 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f1cb9a-53de-4ecf-b693-3b1db4f9b48e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:01.766171 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1114038-2f68-4342-8286-f557cda158eb admin admin] PATH_INFO: `/v3/projects` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:01.766432 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f1cb9a-53de-4ecf-b693-3b1db4f9b48e admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:01.766711 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f1cb9a-53de-4ecf-b693-3b1db4f9b48e admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:01.767031 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f1cb9a-53de-4ecf-b693-3b1db4f9b48e admin admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:01.767129 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1114038-2f68-4342-8286-f557cda158eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:01.767672 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f1cb9a-53de-4ecf-b693-3b1db4f9b48e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:01.768973 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1114038-2f68-4342-8286-f557cda158eb admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:01.769277 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f1cb9a-53de-4ecf-b693-3b1db4f9b48e admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:01.784504 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 896/1812] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:02:01 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:02:01.795734 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f1cb9a-53de-4ecf-b693-3b1db4f9b48e admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:01.807293 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f1cb9a-53de-4ecf-b693-3b1db4f9b48e admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:01.812006 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf2ba8b-7fd8-4944-a0c7-f9e9ddf1d602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:01.812626 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf2ba8b-7fd8-4944-a0c7-f9e9ddf1d602 admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:01.813255 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf2ba8b-7fd8-4944-a0c7-f9e9ddf1d602 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:01.813255 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf2ba8b-7fd8-4944-a0c7-f9e9ddf1d602 admin admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:01.813842 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf2ba8b-7fd8-4944-a0c7-f9e9ddf1d602 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:01.815422 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf2ba8b-7fd8-4944-a0c7-f9e9ddf1d602 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:01.826368 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 897/1813] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:02:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 12:02:01.830505 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf2ba8b-7fd8-4944-a0c7-f9e9ddf1d602 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:01.840996 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf2ba8b-7fd8-4944-a0c7-f9e9ddf1d602 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:01.845736 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f388cfb6-6a5c-4f33-bf45-af78def31fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:01.846393 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f388cfb6-6a5c-4f33-bf45-af78def31fd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:01.846675 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f388cfb6-6a5c-4f33-bf45-af78def31fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:01.846948 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f388cfb6-6a5c-4f33-bf45-af78def31fd7 admin admin] PATH_INFO: `/v3/projects/6bf68661b62644b8b4e4784f488dd1a6/users/bf568ed9d8ff4b1087f33830a8b2e004/roles/ab4307f3b7994c1c80036fa7db93b6b9` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:01.862526 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f388cfb6-6a5c-4f33-bf45-af78def31fd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bf68661b62644b8b4e4784f488dd1a6, user_id=bf568ed9d8ff4b1087f33830a8b2e004, role_id=ab4307f3b7994c1c80036fa7db93b6b9)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:01.867609 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f388cfb6-6a5c-4f33-bf45-af78def31fd7 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:01.908147 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 917/1814] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Oct 4 12:02:01 2022] POST /identity/v3/projects => generated 375 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 12:02:01.912769 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1114038-2f68-4342-8286-f557cda158eb admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:02.000999 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1114038-2f68-4342-8286-f557cda158eb admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:02.009638 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ede2b7-6dfa-483f-88b1-b82f6a4456e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:02.010268 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ede2b7-6dfa-483f-88b1-b82f6a4456e0 admin admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:02.013703 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ede2b7-6dfa-483f-88b1-b82f6a4456e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:02.013703 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ede2b7-6dfa-483f-88b1-b82f6a4456e0 admin admin] PATH_INFO: `/v3/users` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:02.013703 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ede2b7-6dfa-483f-88b1-b82f6a4456e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:02.013984 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 898/1815] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Oct 4 12:02:01 2022] PUT /identity/v3/projects/6bf68661b62644b8b4e4784f488dd1a6/users/bf568ed9d8ff4b1087f33830a8b2e004/roles/ab4307f3b7994c1c80036fa7db93b6b9 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:02:02.014063 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ede2b7-6dfa-483f-88b1-b82f6a4456e0 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:02.026107 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064c89ef-6077-4807-a4ab-08febadfcf39 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:02.026395 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064c89ef-6077-4807-a4ab-08febadfcf39 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:02.026787 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064c89ef-6077-4807-a4ab-08febadfcf39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:02.069136 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-064c89ef-6077-4807-a4ab-08febadfcf39 None None] MFA Rules not processed for user `bf568ed9d8ff4b1087f33830a8b2e004`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:02:02.070361 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-064c89ef-6077-4807-a4ab-08febadfcf39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:02.159398 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 899/1816] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:02:02 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:02:02.165949 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064c89ef-6077-4807-a4ab-08febadfcf39 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:02.175899 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 918/1817] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Oct 4 12:02:01 2022] POST /identity/v3/users => generated 288 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 12:02:02.176964 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ede2b7-6dfa-483f-88b1-b82f6a4456e0 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:02.178547 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-60ede2b7-6dfa-483f-88b1-b82f6a4456e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:02.190324 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ede2b7-6dfa-483f-88b1-b82f6a4456e0 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:02.229652 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064c89ef-6077-4807-a4ab-08febadfcf39 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:02.234223 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ad7072-1eac-4db4-a2d9-ce1ad352df81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:02.235096 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ad7072-1eac-4db4-a2d9-ce1ad352df81 admin admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:02.235372 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ad7072-1eac-4db4-a2d9-ce1ad352df81 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:02.235643 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ad7072-1eac-4db4-a2d9-ce1ad352df81 admin admin] PATH_INFO: `/v3/projects` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:02.236268 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ad7072-1eac-4db4-a2d9-ce1ad352df81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:02.238202 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ad7072-1eac-4db4-a2d9-ce1ad352df81 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:02.247828 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df8bc8b-46bc-4419-ab74-1a5bcc07c9ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:02.248462 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df8bc8b-46bc-4419-ab74-1a5bcc07c9ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:02.248778 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df8bc8b-46bc-4419-ab74-1a5bcc07c9ea admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:02.249055 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df8bc8b-46bc-4419-ab74-1a5bcc07c9ea admin admin] PATH_INFO: `/v3/users/81526330023c4ce587f056e96c88992b` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:02.250199 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df8bc8b-46bc-4419-ab74-1a5bcc07c9ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=81526330023c4ce587f056e96c88992b)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:02.252159 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df8bc8b-46bc-4419-ab74-1a5bcc07c9ea admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:02.376587 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 900/1818] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Oct 4 12:02:02 2022] POST /identity/v3/projects => generated 385 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:02:02.377449 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ad7072-1eac-4db4-a2d9-ce1ad352df81 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:02.442996 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ad7072-1eac-4db4-a2d9-ce1ad352df81 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:02.447676 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d93826-3957-4051-b348-5ca61269b365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:02.448305 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d93826-3957-4051-b348-5ca61269b365 admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:02.448583 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d93826-3957-4051-b348-5ca61269b365 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:02.448957 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d93826-3957-4051-b348-5ca61269b365 admin admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:02.449595 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d93826-3957-4051-b348-5ca61269b365 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:02.451175 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d93826-3957-4051-b348-5ca61269b365 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:02.461134 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 901/1819] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:02:02 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:02:02.461895 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d93826-3957-4051-b348-5ca61269b365 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:02.470947 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d93826-3957-4051-b348-5ca61269b365 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:02.476238 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f65d56e-9a68-4279-a3f8-7f36527ae7dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:02.476876 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f65d56e-9a68-4279-a3f8-7f36527ae7dd admin admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:02.477172 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f65d56e-9a68-4279-a3f8-7f36527ae7dd admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:02.477424 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f65d56e-9a68-4279-a3f8-7f36527ae7dd admin admin] PATH_INFO: `/v3/users` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:02.478056 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f65d56e-9a68-4279-a3f8-7f36527ae7dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:02.479897 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f65d56e-9a68-4279-a3f8-7f36527ae7dd admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:02.532659 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-1df8bc8b-46bc-4419-ab74-1a5bcc07c9ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81526330023c4ce587f056e96c88992b'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:02.539781 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-1df8bc8b-46bc-4419-ab74-1a5bcc07c9ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81526330023c4ce587f056e96c88992b'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:02.540446 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-1df8bc8b-46bc-4419-ab74-1a5bcc07c9ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81526330023c4ce587f056e96c88992b'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:02.541292 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-1df8bc8b-46bc-4419-ab74-1a5bcc07c9ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81526330023c4ce587f056e96c88992b'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:02.609983 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 902/1820] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Oct 4 12:02:02 2022] POST /identity/v3/users => generated 299 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:02:02.610936 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f65d56e-9a68-4279-a3f8-7f36527ae7dd admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:02.612505 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-1f65d56e-9a68-4279-a3f8-7f36527ae7dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:02.625050 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f65d56e-9a68-4279-a3f8-7f36527ae7dd admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:02.630247 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54de0a8c-461c-411a-9415-774e2f108788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:02.631155 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54de0a8c-461c-411a-9415-774e2f108788 admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:02.631426 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54de0a8c-461c-411a-9415-774e2f108788 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:02.631695 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54de0a8c-461c-411a-9415-774e2f108788 admin admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:02.632326 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54de0a8c-461c-411a-9415-774e2f108788 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:02.632548 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-1df8bc8b-46bc-4419-ab74-1a5bcc07c9ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81526330023c4ce587f056e96c88992b'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:02.633948 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54de0a8c-461c-411a-9415-774e2f108788 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:02.645773 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 903/1821] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:02:02 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:02:02.646281 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54de0a8c-461c-411a-9415-774e2f108788 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:02.648049 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-54de0a8c-461c-411a-9415-774e2f108788 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:02.650859 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 919/1822] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Oct 4 12:02:02 2022] DELETE /identity/v3/users/81526330023c4ce587f056e96c88992b => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:02:02.651653 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df8bc8b-46bc-4419-ab74-1a5bcc07c9ea admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:02.660333 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54de0a8c-461c-411a-9415-774e2f108788 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:02.714107 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df8bc8b-46bc-4419-ab74-1a5bcc07c9ea admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:02.715716 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb8c88b-5185-4ff9-a9ac-8d4c390a2d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:02.716387 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb8c88b-5185-4ff9-a9ac-8d4c390a2d4e admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:02.716629 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb8c88b-5185-4ff9-a9ac-8d4c390a2d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:02.716902 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb8c88b-5185-4ff9-a9ac-8d4c390a2d4e admin admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:02.717527 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb8c88b-5185-4ff9-a9ac-8d4c390a2d4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:02.718916 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24816c1d-b56a-4450-88a3-b4d4f69a8c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:02.719107 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb8c88b-5185-4ff9-a9ac-8d4c390a2d4e admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:02.719624 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24816c1d-b56a-4450-88a3-b4d4f69a8c48 admin admin] REQUEST_METHOD: `PUT` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:02.719931 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24816c1d-b56a-4450-88a3-b4d4f69a8c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:02.720204 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24816c1d-b56a-4450-88a3-b4d4f69a8c48 admin admin] PATH_INFO: `/v3/projects/abede9f1a0314f26b44d46f9681962d7/users/7e7f38d9013b4d379d7a1a6bf6147f24/roles/ab4307f3b7994c1c80036fa7db93b6b9` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:02.729471 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 904/1823] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:02:02 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:02:02.730716 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbf4f75-21c6-4cb2-8eed-bf3ea566330a None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:02.731004 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbf4f75-21c6-4cb2-8eed-bf3ea566330a None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:02.731279 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbf4f75-21c6-4cb2-8eed-bf3ea566330a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:02.741038 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24816c1d-b56a-4450-88a3-b4d4f69a8c48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abede9f1a0314f26b44d46f9681962d7, user_id=7e7f38d9013b4d379d7a1a6bf6147f24, role_id=ab4307f3b7994c1c80036fa7db93b6b9)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:02.743196 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24816c1d-b56a-4450-88a3-b4d4f69a8c48 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:02.751475 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-fbbf4f75-21c6-4cb2-8eed-bf3ea566330a None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:02:02.752692 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-fbbf4f75-21c6-4cb2-8eed-bf3ea566330a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:02.762045 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 905/1824] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:02:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:02:02.762045 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbf4f75-21c6-4cb2-8eed-bf3ea566330a None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:02.775519 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbf4f75-21c6-4cb2-8eed-bf3ea566330a None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:02.780240 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9b545c-44b4-4f60-a828-efcca07c3081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:02.780915 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9b545c-44b4-4f60-a828-efcca07c3081 admin admin] REQUEST_METHOD: `PUT` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:02.781411 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9b545c-44b4-4f60-a828-efcca07c3081 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:02.781622 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9b545c-44b4-4f60-a828-efcca07c3081 admin admin] PATH_INFO: `/v3/projects/9db42037bb0f4290ac2d4247025ed3f6/users/2d8ea17a10bb416bb627fa7daae0ee14/roles/d6e7421d1ff9451c808004b818354550` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:02.798323 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9b545c-44b4-4f60-a828-efcca07c3081 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9db42037bb0f4290ac2d4247025ed3f6, user_id=2d8ea17a10bb416bb627fa7daae0ee14, role_id=d6e7421d1ff9451c808004b818354550)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:02.803466 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9b545c-44b4-4f60-a828-efcca07c3081 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:02.845202 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 920/1825] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Oct 4 12:02:02 2022] PUT /identity/v3/projects/abede9f1a0314f26b44d46f9681962d7/users/7e7f38d9013b4d379d7a1a6bf6147f24/roles/ab4307f3b7994c1c80036fa7db93b6b9 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:02:02.855496 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24816c1d-b56a-4450-88a3-b4d4f69a8c48 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:02.857268 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-24816c1d-b56a-4450-88a3-b4d4f69a8c48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:02.891751 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 906/1826] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Oct 4 12:02:02 2022] PUT /identity/v3/projects/9db42037bb0f4290ac2d4247025ed3f6/users/2d8ea17a10bb416bb627fa7daae0ee14/roles/d6e7421d1ff9451c808004b818354550 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:02:02.892234 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab21b2c-4f7c-479e-8e06-4597fbaa6985 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:02.892234 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab21b2c-4f7c-479e-8e06-4597fbaa6985 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:02.892778 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab21b2c-4f7c-479e-8e06-4597fbaa6985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:02.953717 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-fab21b2c-4f7c-479e-8e06-4597fbaa6985 None None] MFA Rules not processed for user `7e7f38d9013b4d379d7a1a6bf6147f24`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:02:02.954352 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24816c1d-b56a-4450-88a3-b4d4f69a8c48 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:02.959877 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-fab21b2c-4f7c-479e-8e06-4597fbaa6985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:03.014950 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b628ab2b-ac63-4677-928c-4fc7bbd63c17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7289515c5c44914a19daa439de98cb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:03.015898 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b628ab2b-ac63-4677-928c-4fc7bbd63c17 service neutron] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:03.016184 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b628ab2b-ac63-4677-928c-4fc7bbd63c17 service neutron] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:03.016458 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b628ab2b-ac63-4677-928c-4fc7bbd63c17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:03.043872 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 907/1827] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:02:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:02:03.044827 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab21b2c-4f7c-479e-8e06-4597fbaa6985 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:03.092770 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b628ab2b-ac63-4677-928c-4fc7bbd63c17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:03.094230 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b628ab2b-ac63-4677-928c-4fc7bbd63c17 service neutron] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:03.104574 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 921/1828] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:02:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:02:03.105515 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b628ab2b-ac63-4677-928c-4fc7bbd63c17 service neutron] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:03.109647 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab21b2c-4f7c-479e-8e06-4597fbaa6985 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:03.115079 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f0efc9-b18e-4b48-ad14-c6a88d9601e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:03.115701 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f0efc9-b18e-4b48-ad14-c6a88d9601e4 admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:03.115981 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f0efc9-b18e-4b48-ad14-c6a88d9601e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:03.116253 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f0efc9-b18e-4b48-ad14-c6a88d9601e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:03.116926 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f0efc9-b18e-4b48-ad14-c6a88d9601e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:03.117053 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b628ab2b-ac63-4677-928c-4fc7bbd63c17 service neutron] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:03.118619 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f0efc9-b18e-4b48-ad14-c6a88d9601e4 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:03.123074 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fa94fa-e85e-448e-92e6-63d9678775f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:03.125230 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fa94fa-e85e-448e-92e6-63d9678775f9 admin admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:03.125230 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fa94fa-e85e-448e-92e6-63d9678775f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:03.125230 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fa94fa-e85e-448e-92e6-63d9678775f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:03.126081 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fa94fa-e85e-448e-92e6-63d9678775f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:03.128819 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 908/1829] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:02:03 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:02:03.133561 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fa94fa-e85e-448e-92e6-63d9678775f9 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:03.141049 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f0efc9-b18e-4b48-ad14-c6a88d9601e4 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:03.154805 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f0efc9-b18e-4b48-ad14-c6a88d9601e4 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:03.163990 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a720bbf-e581-4b09-b288-77dd9a3275a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:03.165881 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a720bbf-e581-4b09-b288-77dd9a3275a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:03.166555 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a720bbf-e581-4b09-b288-77dd9a3275a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:03.166555 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a720bbf-e581-4b09-b288-77dd9a3275a1 admin admin] PATH_INFO: `/v3/projects/9db42037bb0f4290ac2d4247025ed3f6/users/2d8ea17a10bb416bb627fa7daae0ee14/roles/d6e7421d1ff9451c808004b818354550` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:03.169916 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a720bbf-e581-4b09-b288-77dd9a3275a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9db42037bb0f4290ac2d4247025ed3f6, user_id=2d8ea17a10bb416bb627fa7daae0ee14, role_id=d6e7421d1ff9451c808004b818354550)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:03.172610 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a720bbf-e581-4b09-b288-77dd9a3275a1 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:03.192466 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 909/1830] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Oct 4 12:02:03 2022] PUT /identity/v3/projects/9db42037bb0f4290ac2d4247025ed3f6/users/2d8ea17a10bb416bb627fa7daae0ee14/roles/d6e7421d1ff9451c808004b818354550 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:02:03.196633 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a98f41-e7bd-49bd-90ac-b13bfc6ecb50 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:03.197094 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a98f41-e7bd-49bd-90ac-b13bfc6ecb50 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:03.197380 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a98f41-e7bd-49bd-90ac-b13bfc6ecb50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:03.231729 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-f1a98f41-e7bd-49bd-90ac-b13bfc6ecb50 None None] MFA Rules not processed for user `2d8ea17a10bb416bb627fa7daae0ee14`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:02:03.233134 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-f1a98f41-e7bd-49bd-90ac-b13bfc6ecb50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:03.318209 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 922/1831] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Oct 4 12:02:03 2022] POST /identity/v3/projects => generated 375 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:02:03.323125 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fa94fa-e85e-448e-92e6-63d9678775f9 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:03.344443 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 910/1832] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:02:03 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 12:02:03.352283 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a98f41-e7bd-49bd-90ac-b13bfc6ecb50 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:03.355720 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-f1a98f41-e7bd-49bd-90ac-b13bfc6ecb50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:03.430281 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fa94fa-e85e-448e-92e6-63d9678775f9 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:03.435225 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3034fab0-f9a7-433b-b13b-6783c8cbf312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:03.435833 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3034fab0-f9a7-433b-b13b-6783c8cbf312 admin admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:03.436118 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3034fab0-f9a7-433b-b13b-6783c8cbf312 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:03.436397 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3034fab0-f9a7-433b-b13b-6783c8cbf312 admin admin] PATH_INFO: `/v3/users` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:03.437336 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3034fab0-f9a7-433b-b13b-6783c8cbf312 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:03.439237 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a98f41-e7bd-49bd-90ac-b13bfc6ecb50 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:03.439387 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3034fab0-f9a7-433b-b13b-6783c8cbf312 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:03.496260 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc06435d-3eef-46aa-a152-562f7652c739 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e2a05b782424ab2928b5864f1bfd556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:03.496913 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc06435d-3eef-46aa-a152-562f7652c739 service cinder] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:03.497247 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc06435d-3eef-46aa-a152-562f7652c739 service cinder] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:03.497484 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc06435d-3eef-46aa-a152-562f7652c739 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:03.554124 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 923/1833] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Oct 4 12:02:03 2022] POST /identity/v3/users => generated 294 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:02:03.558144 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3034fab0-f9a7-433b-b13b-6783c8cbf312 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:03.566038 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc06435d-3eef-46aa-a152-562f7652c739 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:03.568221 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc06435d-3eef-46aa-a152-562f7652c739 service cinder] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:03.568526 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3034fab0-f9a7-433b-b13b-6783c8cbf312 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:03.573525 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982a2013-c97d-440f-b6ce-832e246014bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:03.574116 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982a2013-c97d-440f-b6ce-832e246014bb admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:03.574403 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982a2013-c97d-440f-b6ce-832e246014bb admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:03.574674 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982a2013-c97d-440f-b6ce-832e246014bb admin admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:03.575336 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982a2013-c97d-440f-b6ce-832e246014bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:03.576960 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982a2013-c97d-440f-b6ce-832e246014bb admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:03.577981 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 911/1834] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:02:03 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:02:03.587872 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 924/1835] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:02:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 12:02:03.592433 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc06435d-3eef-46aa-a152-562f7652c739 service cinder] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:03.605046 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc06435d-3eef-46aa-a152-562f7652c739 service cinder] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:03.610022 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da53000-06e7-4209-aeba-c108b9fc45b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:03.610696 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da53000-06e7-4209-aeba-c108b9fc45b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:03.610983 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da53000-06e7-4209-aeba-c108b9fc45b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:03.611293 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da53000-06e7-4209-aeba-c108b9fc45b7 admin admin] PATH_INFO: `/v3/projects/0e4ac3f998b44ccdac7ac4bca53553f8/users/d5a0c471a64b490db505ae0a6b45cf97/roles/d6e7421d1ff9451c808004b818354550` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:03.625592 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da53000-06e7-4209-aeba-c108b9fc45b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e4ac3f998b44ccdac7ac4bca53553f8, user_id=d5a0c471a64b490db505ae0a6b45cf97, role_id=d6e7421d1ff9451c808004b818354550)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:03.628237 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da53000-06e7-4209-aeba-c108b9fc45b7 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:03.663341 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982a2013-c97d-440f-b6ce-832e246014bb admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:03.670754 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-982a2013-c97d-440f-b6ce-832e246014bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:03.677797 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982a2013-c97d-440f-b6ce-832e246014bb admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:03.682551 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80819a7b-6887-4f7a-acc0-7a042eac1a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:03.683178 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80819a7b-6887-4f7a-acc0-7a042eac1a3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:03.683458 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80819a7b-6887-4f7a-acc0-7a042eac1a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:03.683737 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80819a7b-6887-4f7a-acc0-7a042eac1a3d admin admin] PATH_INFO: `/v3/projects/cbb7b44b6e0342a6a4f12ecd35b47e99` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:03.684881 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80819a7b-6887-4f7a-acc0-7a042eac1a3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbb7b44b6e0342a6a4f12ecd35b47e99)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:03.686796 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80819a7b-6887-4f7a-acc0-7a042eac1a3d admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:03.777046 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 912/1836] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Oct 4 12:02:03 2022] PUT /identity/v3/projects/0e4ac3f998b44ccdac7ac4bca53553f8/users/d5a0c471a64b490db505ae0a6b45cf97/roles/d6e7421d1ff9451c808004b818354550 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:02:03.781107 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da53000-06e7-4209-aeba-c108b9fc45b7 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:03.816776 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-80819a7b-6887-4f7a-acc0-7a042eac1a3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbb7b44b6e0342a6a4f12ecd35b47e99', 'request_id': 'req-80819a7b-6887-4f7a-acc0-7a042eac1a3d'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:03.845288 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da53000-06e7-4209-aeba-c108b9fc45b7 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:03.905194 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3da2cf-b4a2-47f7-a8fb-2fed99a1f093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:03.905991 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3da2cf-b4a2-47f7-a8fb-2fed99a1f093 admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:03.906278 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3da2cf-b4a2-47f7-a8fb-2fed99a1f093 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:03.912916 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3da2cf-b4a2-47f7-a8fb-2fed99a1f093 admin admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:03.917836 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3da2cf-b4a2-47f7-a8fb-2fed99a1f093 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:03.917836 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3da2cf-b4a2-47f7-a8fb-2fed99a1f093 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:03.932169 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 913/1837] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:02:03 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 12:02:03.933210 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3da2cf-b4a2-47f7-a8fb-2fed99a1f093 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:03.944191 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3da2cf-b4a2-47f7-a8fb-2fed99a1f093 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:03.947403 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-80819a7b-6887-4f7a-acc0-7a042eac1a3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbb7b44b6e0342a6a4f12ecd35b47e99', 'request_id': 'req-80819a7b-6887-4f7a-acc0-7a042eac1a3d'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:03.949669 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c430eab3-67bc-40aa-b91b-f3b0047a0c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:03.950741 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c430eab3-67bc-40aa-b91b-f3b0047a0c3d admin admin] REQUEST_METHOD: `PUT` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:03.950741 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c430eab3-67bc-40aa-b91b-f3b0047a0c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:03.951074 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c430eab3-67bc-40aa-b91b-f3b0047a0c3d admin admin] PATH_INFO: `/v3/projects/0e4ac3f998b44ccdac7ac4bca53553f8/users/d5a0c471a64b490db505ae0a6b45cf97/roles/d6e7421d1ff9451c808004b818354550` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:03.953506 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c430eab3-67bc-40aa-b91b-f3b0047a0c3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e4ac3f998b44ccdac7ac4bca53553f8, user_id=d5a0c471a64b490db505ae0a6b45cf97, role_id=d6e7421d1ff9451c808004b818354550)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:03.956270 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c430eab3-67bc-40aa-b91b-f3b0047a0c3d admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:03.961397 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-80819a7b-6887-4f7a-acc0-7a042eac1a3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbb7b44b6e0342a6a4f12ecd35b47e99', 'request_id': 'req-80819a7b-6887-4f7a-acc0-7a042eac1a3d'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:03.972660 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-80819a7b-6887-4f7a-acc0-7a042eac1a3d admin admin] The token cache is being invalidate because project cbb7b44b6e0342a6a4f12ecd35b47e99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:02:03.973008 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-80819a7b-6887-4f7a-acc0-7a042eac1a3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:03.974216 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-80819a7b-6887-4f7a-acc0-7a042eac1a3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:03.978860 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 925/1838] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Oct 4 12:02:03 2022] DELETE /identity/v3/projects/cbb7b44b6e0342a6a4f12ecd35b47e99 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:02:03.979740 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80819a7b-6887-4f7a-acc0-7a042eac1a3d admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:03.981384 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-80819a7b-6887-4f7a-acc0-7a042eac1a3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:03.988646 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 914/1839] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Oct 4 12:02:03 2022] PUT /identity/v3/projects/0e4ac3f998b44ccdac7ac4bca53553f8/users/d5a0c471a64b490db505ae0a6b45cf97/roles/d6e7421d1ff9451c808004b818354550 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:02:03.999889 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0722c85-5df6-470b-a100-2b72cf288714 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:04.000180 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0722c85-5df6-470b-a100-2b72cf288714 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:04.000452 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0722c85-5df6-470b-a100-2b72cf288714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:04.007592 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80819a7b-6887-4f7a-acc0-7a042eac1a3d admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:04.040999 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-d0722c85-5df6-470b-a100-2b72cf288714 None None] MFA Rules not processed for user `d5a0c471a64b490db505ae0a6b45cf97`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:02:04.043869 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-d0722c85-5df6-470b-a100-2b72cf288714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:04.111647 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190ce5a3-63f1-4b6b-8833-9df72e85c26b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:04.112443 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190ce5a3-63f1-4b6b-8833-9df72e85c26b admin admin] REQUEST_METHOD: `DELETE` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:04.115161 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190ce5a3-63f1-4b6b-8833-9df72e85c26b admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:04.115161 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190ce5a3-63f1-4b6b-8833-9df72e85c26b admin admin] PATH_INFO: `/v3/users/162826ded01c435aa8ae4a86d49428f2` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:04.115161 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190ce5a3-63f1-4b6b-8833-9df72e85c26b admin admin] RBAC: Authorizing `identity:delete_user(user_id=162826ded01c435aa8ae4a86d49428f2)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:04.117133 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190ce5a3-63f1-4b6b-8833-9df72e85c26b admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:04.177802 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 915/1840] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:02:03 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 12:02:04.192452 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0722c85-5df6-470b-a100-2b72cf288714 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:04.194881 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-d0722c85-5df6-470b-a100-2b72cf288714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:04.272964 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0722c85-5df6-470b-a100-2b72cf288714 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:04.277538 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eb684f-b248-479d-902f-ef99d1d8afa9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e2a05b782424ab2928b5864f1bfd556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:04.278166 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eb684f-b248-479d-902f-ef99d1d8afa9 service cinder] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:04.279560 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eb684f-b248-479d-902f-ef99d1d8afa9 service cinder] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:04.279976 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eb684f-b248-479d-902f-ef99d1d8afa9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:04.282240 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-27eb684f-b248-479d-902f-ef99d1d8afa9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:04.411148 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27eb684f-b248-479d-902f-ef99d1d8afa9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:04.412801 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27eb684f-b248-479d-902f-ef99d1d8afa9 service cinder] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:04.438505 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 916/1841] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:02:04 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:02:04.603473 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-190ce5a3-63f1-4b6b-8833-9df72e85c26b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '162826ded01c435aa8ae4a86d49428f2'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:04.618219 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-190ce5a3-63f1-4b6b-8833-9df72e85c26b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '162826ded01c435aa8ae4a86d49428f2'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:04.618219 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-190ce5a3-63f1-4b6b-8833-9df72e85c26b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '162826ded01c435aa8ae4a86d49428f2'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:04.619155 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-190ce5a3-63f1-4b6b-8833-9df72e85c26b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '162826ded01c435aa8ae4a86d49428f2'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:04.713703 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-190ce5a3-63f1-4b6b-8833-9df72e85c26b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '162826ded01c435aa8ae4a86d49428f2'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:04.734990 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 926/1842] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Oct 4 12:02:03 2022] DELETE /identity/v3/users/162826ded01c435aa8ae4a86d49428f2 => generated 0 bytes in 756 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:02:05.309422 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eb684f-b248-479d-902f-ef99d1d8afa9 service cinder] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:05.322969 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eb684f-b248-479d-902f-ef99d1d8afa9 service cinder] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:05.421302 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d28e02c-8a81-48f0-a520-630528c84362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:05.422297 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d28e02c-8a81-48f0-a520-630528c84362 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:05.422793 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d28e02c-8a81-48f0-a520-630528c84362 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:05.423261 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d28e02c-8a81-48f0-a520-630528c84362 admin admin] PATH_INFO: `/v3/projects/b53a8ba20fac42f2ba35ed515011f9ff` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:05.424799 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d28e02c-8a81-48f0-a520-630528c84362 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b53a8ba20fac42f2ba35ed515011f9ff)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:05.427271 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d28e02c-8a81-48f0-a520-630528c84362 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:05.630350 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-0d28e02c-8a81-48f0-a520-630528c84362 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b53a8ba20fac42f2ba35ed515011f9ff', 'request_id': 'req-0d28e02c-8a81-48f0-a520-630528c84362'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:05.638078 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190ce5a3-63f1-4b6b-8833-9df72e85c26b admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:05.641559 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-190ce5a3-63f1-4b6b-8833-9df72e85c26b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:05.643377 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-0d28e02c-8a81-48f0-a520-630528c84362 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b53a8ba20fac42f2ba35ed515011f9ff', 'request_id': 'req-0d28e02c-8a81-48f0-a520-630528c84362'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:05.663861 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190ce5a3-63f1-4b6b-8833-9df72e85c26b admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:05.741206 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5ff59a-9150-45d3-8014-a00251a3e02d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:05.747430 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5ff59a-9150-45d3-8014-a00251a3e02d admin admin] REQUEST_METHOD: `DELETE` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:05.747430 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5ff59a-9150-45d3-8014-a00251a3e02d admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:05.747430 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5ff59a-9150-45d3-8014-a00251a3e02d admin admin] PATH_INFO: `/v3/users/bf568ed9d8ff4b1087f33830a8b2e004` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:05.747430 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5ff59a-9150-45d3-8014-a00251a3e02d admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf568ed9d8ff4b1087f33830a8b2e004)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:05.747747 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5ff59a-9150-45d3-8014-a00251a3e02d admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:05.809861 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-0d28e02c-8a81-48f0-a520-630528c84362 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b53a8ba20fac42f2ba35ed515011f9ff', 'request_id': 'req-0d28e02c-8a81-48f0-a520-630528c84362'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:05.811694 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:02:05.833399 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-0d28e02c-8a81-48f0-a520-630528c84362 admin admin] The token cache is being invalidate because project b53a8ba20fac42f2ba35ed515011f9ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:02:05.834011 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-0d28e02c-8a81-48f0-a520-630528c84362 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:05.837094 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-0d28e02c-8a81-48f0-a520-630528c84362 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:05.840068 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 917/1843] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Oct 4 12:02:05 2022] DELETE /identity/v3/projects/b53a8ba20fac42f2ba35ed515011f9ff => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:02:05.846545 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47666f6a-5aba-4c9d-8f58-5c33e51a3e50 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:05.846933 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47666f6a-5aba-4c9d-8f58-5c33e51a3e50 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:05.847286 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47666f6a-5aba-4c9d-8f58-5c33e51a3e50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:05.888007 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-47666f6a-5aba-4c9d-8f58-5c33e51a3e50 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:02:05.889385 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-47666f6a-5aba-4c9d-8f58-5c33e51a3e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:05.906805 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 918/1844] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:02:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 12:02:05.911373 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59122647-0604-400a-8084-c7b7d7562169 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:05.911373 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59122647-0604-400a-8084-c7b7d7562169 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:05.911373 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59122647-0604-400a-8084-c7b7d7562169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:05.935442 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-59122647-0604-400a-8084-c7b7d7562169 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:02:05.936894 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-59122647-0604-400a-8084-c7b7d7562169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:05.947650 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 919/1845] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:02:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:02:05.958263 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59122647-0604-400a-8084-c7b7d7562169 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:05.970116 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59122647-0604-400a-8084-c7b7d7562169 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:05.978537 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8ace9f-fa28-4fe2-a583-1b33467e4e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:05.979182 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8ace9f-fa28-4fe2-a583-1b33467e4e52 admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:05.979463 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8ace9f-fa28-4fe2-a583-1b33467e4e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:05.979740 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8ace9f-fa28-4fe2-a583-1b33467e4e52 admin admin] PATH_INFO: `/v3/domains` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:05.980426 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8ace9f-fa28-4fe2-a583-1b33467e4e52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:02:05.980818 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8ace9f-fa28-4fe2-a583-1b33467e4e52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:05.982574 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8ace9f-fa28-4fe2-a583-1b33467e4e52 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:06.002083 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 920/1846] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Oct 4 12:02:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:02:06.003126 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8ace9f-fa28-4fe2-a583-1b33467e4e52 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:06.011237 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-be5ff59a-9150-45d3-8014-a00251a3e02d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf568ed9d8ff4b1087f33830a8b2e004'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:06.014263 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8ace9f-fa28-4fe2-a583-1b33467e4e52 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:06.019374 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6e3036-5784-42b5-aae4-cb2f850eeef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:06.020062 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6e3036-5784-42b5-aae4-cb2f850eeef7 admin admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:06.020875 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6e3036-5784-42b5-aae4-cb2f850eeef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:06.021508 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6e3036-5784-42b5-aae4-cb2f850eeef7 admin admin] PATH_INFO: `/v3/projects` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:06.021789 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6e3036-5784-42b5-aae4-cb2f850eeef7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:06.023720 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6e3036-5784-42b5-aae4-cb2f850eeef7 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:06.024394 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-be5ff59a-9150-45d3-8014-a00251a3e02d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf568ed9d8ff4b1087f33830a8b2e004'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:06.025544 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-be5ff59a-9150-45d3-8014-a00251a3e02d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf568ed9d8ff4b1087f33830a8b2e004'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:06.026438 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-be5ff59a-9150-45d3-8014-a00251a3e02d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf568ed9d8ff4b1087f33830a8b2e004'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:06.183625 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-be5ff59a-9150-45d3-8014-a00251a3e02d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf568ed9d8ff4b1087f33830a8b2e004'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:06.193288 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 921/1847] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Oct 4 12:02:06 2022] POST /identity/v3/projects => generated 387 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 12:02:06.197360 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6e3036-5784-42b5-aae4-cb2f850eeef7 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:06.199620 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-5b6e3036-5784-42b5-aae4-cb2f850eeef7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:06.205830 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 927/1848] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Oct 4 12:02:05 2022] DELETE /identity/v3/users/bf568ed9d8ff4b1087f33830a8b2e004 => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:02:06.210888 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6179476f-0ef8-4ff1-86cd-9b2a8cf2080c None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:06.211238 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6179476f-0ef8-4ff1-86cd-9b2a8cf2080c None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:06.211586 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6179476f-0ef8-4ff1-86cd-9b2a8cf2080c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:06.234156 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-6179476f-0ef8-4ff1-86cd-9b2a8cf2080c None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:02:06.235652 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-6179476f-0ef8-4ff1-86cd-9b2a8cf2080c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:06.268090 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6e3036-5784-42b5-aae4-cb2f850eeef7 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:06.318188 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 928/1849] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:02:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:02:06.328441 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6179476f-0ef8-4ff1-86cd-9b2a8cf2080c None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:06.330002 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-6179476f-0ef8-4ff1-86cd-9b2a8cf2080c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:06.336710 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1f2102-541f-400e-8cf4-53d8c2343958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:06.337344 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1f2102-541f-400e-8cf4-53d8c2343958 admin admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:06.337633 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1f2102-541f-400e-8cf4-53d8c2343958 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:06.337910 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1f2102-541f-400e-8cf4-53d8c2343958 admin admin] PATH_INFO: `/v3/users` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:06.338701 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1f2102-541f-400e-8cf4-53d8c2343958 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:06.340693 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1f2102-541f-400e-8cf4-53d8c2343958 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:06.389699 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6179476f-0ef8-4ff1-86cd-9b2a8cf2080c None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:06.393586 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e5f559-328a-478a-a8fb-e693d532f9ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7289515c5c44914a19daa439de98cb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:06.394141 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e5f559-328a-478a-a8fb-e693d532f9ff service neutron] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:06.394425 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e5f559-328a-478a-a8fb-e693d532f9ff service neutron] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:06.394700 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e5f559-328a-478a-a8fb-e693d532f9ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:06.404891 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e5f559-328a-478a-a8fb-e693d532f9ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:06.406412 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e5f559-328a-478a-a8fb-e693d532f9ff service neutron] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:06.417157 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 929/1850] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:02:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 12:02:06.433103 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 922/1851] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Oct 4 12:02:06 2022] POST /identity/v3/users => generated 294 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 12:02:06.437231 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e5f559-328a-478a-a8fb-e693d532f9ff service neutron] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:06.447059 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e5f559-328a-478a-a8fb-e693d532f9ff service neutron] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:06.451962 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061942c0-3b5a-4b56-966f-8a2551aa8f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:06.452659 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061942c0-3b5a-4b56-966f-8a2551aa8f56 admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:06.453027 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061942c0-3b5a-4b56-966f-8a2551aa8f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:06.453366 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061942c0-3b5a-4b56-966f-8a2551aa8f56 admin admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:06.454108 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061942c0-3b5a-4b56-966f-8a2551aa8f56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:06.455827 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061942c0-3b5a-4b56-966f-8a2551aa8f56 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:06.467246 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 930/1852] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:02:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 12:02:06.471133 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1f2102-541f-400e-8cf4-53d8c2343958 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:06.481488 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1f2102-541f-400e-8cf4-53d8c2343958 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:06.486399 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea96f631-c466-4464-abbf-f504a4f0661c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:06.487070 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea96f631-c466-4464-abbf-f504a4f0661c admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:06.487410 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea96f631-c466-4464-abbf-f504a4f0661c admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:06.487756 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea96f631-c466-4464-abbf-f504a4f0661c admin admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:06.488464 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea96f631-c466-4464-abbf-f504a4f0661c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:06.491338 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea96f631-c466-4464-abbf-f504a4f0661c admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:06.507168 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 923/1853] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:02:06 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:02:06.511146 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061942c0-3b5a-4b56-966f-8a2551aa8f56 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:06.521848 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061942c0-3b5a-4b56-966f-8a2551aa8f56 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:06.526612 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3322dd-c82d-4a48-bc20-a684ba3d8e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:06.527935 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3322dd-c82d-4a48-bc20-a684ba3d8e19 admin admin] REQUEST_METHOD: `PUT` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:06.527935 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3322dd-c82d-4a48-bc20-a684ba3d8e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:06.527935 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3322dd-c82d-4a48-bc20-a684ba3d8e19 admin admin] PATH_INFO: `/v3/projects/7e1fd5a40cb34e5fbf2b6d4d3a71c544/users/4a36cb8aa18e4bba961047fee4188a5b/roles/ab4307f3b7994c1c80036fa7db93b6b9` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:06.543757 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3322dd-c82d-4a48-bc20-a684ba3d8e19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e1fd5a40cb34e5fbf2b6d4d3a71c544, user_id=4a36cb8aa18e4bba961047fee4188a5b, role_id=ab4307f3b7994c1c80036fa7db93b6b9)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:06.546532 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3322dd-c82d-4a48-bc20-a684ba3d8e19 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:06.767305 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 931/1854] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Oct 4 12:02:06 2022] PUT /identity/v3/projects/7e1fd5a40cb34e5fbf2b6d4d3a71c544/users/4a36cb8aa18e4bba961047fee4188a5b/roles/ab4307f3b7994c1c80036fa7db93b6b9 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:02:06.769619 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327ffb57-d212-49da-bf4d-37e7c6cc9be8 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:06.769942 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327ffb57-d212-49da-bf4d-37e7c6cc9be8 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:06.770299 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327ffb57-d212-49da-bf4d-37e7c6cc9be8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:06.818180 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-327ffb57-d212-49da-bf4d-37e7c6cc9be8 None None] MFA Rules not processed for user `4a36cb8aa18e4bba961047fee4188a5b`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:02:06.819585 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-327ffb57-d212-49da-bf4d-37e7c6cc9be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:06.970984 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 924/1855] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:02:06 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:02:06.977303 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3322dd-c82d-4a48-bc20-a684ba3d8e19 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:06.978696 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:02:07.121347 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3322dd-c82d-4a48-bc20-a684ba3d8e19 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:07.126620 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c681aeb7-e603-41a7-8f3d-dd4f32980e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:07.127324 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c681aeb7-e603-41a7-8f3d-dd4f32980e88 admin admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:07.127680 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c681aeb7-e603-41a7-8f3d-dd4f32980e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:07.128118 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c681aeb7-e603-41a7-8f3d-dd4f32980e88 admin admin] PATH_INFO: `/v3/projects` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:07.129883 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c681aeb7-e603-41a7-8f3d-dd4f32980e88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:07.132338 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c681aeb7-e603-41a7-8f3d-dd4f32980e88 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:07.170385 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327ffb57-d212-49da-bf4d-37e7c6cc9be8 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:07.171941 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-327ffb57-d212-49da-bf4d-37e7c6cc9be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:07.190514 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327ffb57-d212-49da-bf4d-37e7c6cc9be8 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:07.224848 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a666fbdf-edf6-438b-9b02-f89a6ed47b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:07.225552 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a666fbdf-edf6-438b-9b02-f89a6ed47b7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:07.225816 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a666fbdf-edf6-438b-9b02-f89a6ed47b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:07.226098 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a666fbdf-edf6-438b-9b02-f89a6ed47b7d admin admin] PATH_INFO: `/v3/projects/6bf68661b62644b8b4e4784f488dd1a6` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:07.227569 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a666fbdf-edf6-438b-9b02-f89a6ed47b7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bf68661b62644b8b4e4784f488dd1a6)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:07.229878 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a666fbdf-edf6-438b-9b02-f89a6ed47b7d admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:07.250006 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 932/1856] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Oct 4 12:02:06 2022] POST /identity/v3/projects => generated 387 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:02:07.257423 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c681aeb7-e603-41a7-8f3d-dd4f32980e88 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:07.363910 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c681aeb7-e603-41a7-8f3d-dd4f32980e88 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:07.368914 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c98de4-3af2-4001-9c85-62014b618d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:07.369535 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c98de4-3af2-4001-9c85-62014b618d96 admin admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:07.370155 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c98de4-3af2-4001-9c85-62014b618d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:07.370628 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c98de4-3af2-4001-9c85-62014b618d96 admin admin] PATH_INFO: `/v3/users` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:07.371276 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c98de4-3af2-4001-9c85-62014b618d96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:07.373352 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c98de4-3af2-4001-9c85-62014b618d96 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:07.511973 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 933/1857] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Oct 4 12:02:07 2022] POST /identity/v3/users => generated 294 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:02:07.513096 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c98de4-3af2-4001-9c85-62014b618d96 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:07.526510 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c98de4-3af2-4001-9c85-62014b618d96 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:07.542458 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-a666fbdf-edf6-438b-9b02-f89a6ed47b7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bf68661b62644b8b4e4784f488dd1a6', 'request_id': 'req-a666fbdf-edf6-438b-9b02-f89a6ed47b7d'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:07.550575 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-a666fbdf-edf6-438b-9b02-f89a6ed47b7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bf68661b62644b8b4e4784f488dd1a6', 'request_id': 'req-a666fbdf-edf6-438b-9b02-f89a6ed47b7d'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:07.621961 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0994ffed-9bf8-42ef-a95d-1289242464a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:07.622952 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0994ffed-9bf8-42ef-a95d-1289242464a2 admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:07.623847 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0994ffed-9bf8-42ef-a95d-1289242464a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:07.626090 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0994ffed-9bf8-42ef-a95d-1289242464a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:07.626090 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0994ffed-9bf8-42ef-a95d-1289242464a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:07.626673 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0994ffed-9bf8-42ef-a95d-1289242464a2 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:07.637906 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 934/1858] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:02:07 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:02:07.642691 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0994ffed-9bf8-42ef-a95d-1289242464a2 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:07.658887 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0994ffed-9bf8-42ef-a95d-1289242464a2 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:07.674076 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e187df-aff6-49d8-b191-b3aca133bbb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:07.674978 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e187df-aff6-49d8-b191-b3aca133bbb9 admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:07.675490 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e187df-aff6-49d8-b191-b3aca133bbb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:07.675786 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e187df-aff6-49d8-b191-b3aca133bbb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:07.677185 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e187df-aff6-49d8-b191-b3aca133bbb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:07.679018 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e187df-aff6-49d8-b191-b3aca133bbb9 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:07.684323 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-a666fbdf-edf6-438b-9b02-f89a6ed47b7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bf68661b62644b8b4e4784f488dd1a6', 'request_id': 'req-a666fbdf-edf6-438b-9b02-f89a6ed47b7d'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:07.695197 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 935/1859] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:02:07 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 12:02:07.696542 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e187df-aff6-49d8-b191-b3aca133bbb9 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:07.702588 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-a666fbdf-edf6-438b-9b02-f89a6ed47b7d admin admin] The token cache is being invalidate because project 6bf68661b62644b8b4e4784f488dd1a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:02:07.702885 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-a666fbdf-edf6-438b-9b02-f89a6ed47b7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:07.703545 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-a666fbdf-edf6-438b-9b02-f89a6ed47b7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:07.705127 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 925/1860] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Oct 4 12:02:07 2022] DELETE /identity/v3/projects/6bf68661b62644b8b4e4784f488dd1a6 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:02:07.708733 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e187df-aff6-49d8-b191-b3aca133bbb9 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:07.711330 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a666fbdf-edf6-438b-9b02-f89a6ed47b7d admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:07.713602 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-a666fbdf-edf6-438b-9b02-f89a6ed47b7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:07.714532 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afbb926-e9eb-4953-b702-3b2b5e9e83de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:07.715197 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afbb926-e9eb-4953-b702-3b2b5e9e83de admin admin] REQUEST_METHOD: `PUT` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:07.715573 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afbb926-e9eb-4953-b702-3b2b5e9e83de admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:07.715852 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afbb926-e9eb-4953-b702-3b2b5e9e83de admin admin] PATH_INFO: `/v3/projects/01dffde7e90a4b338ce82db3aca6e962/users/5929de891c694ab9bf3252acd0159cb2/roles/ab4307f3b7994c1c80036fa7db93b6b9` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:07.731324 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a666fbdf-edf6-438b-9b02-f89a6ed47b7d admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:07.740853 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afbb926-e9eb-4953-b702-3b2b5e9e83de admin admin] RBAC: Authorizing `identity:create_grant(project_id=01dffde7e90a4b338ce82db3aca6e962, user_id=5929de891c694ab9bf3252acd0159cb2, role_id=ab4307f3b7994c1c80036fa7db93b6b9)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:07.740853 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afbb926-e9eb-4953-b702-3b2b5e9e83de admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:07.741154 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a769fc-1168-4a71-8d5d-a1ca92d398ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:07.741154 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a769fc-1168-4a71-8d5d-a1ca92d398ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:07.741154 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a769fc-1168-4a71-8d5d-a1ca92d398ac admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:07.741154 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a769fc-1168-4a71-8d5d-a1ca92d398ac admin admin] PATH_INFO: `/v3/users/2d8ea17a10bb416bb627fa7daae0ee14` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:07.742684 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a769fc-1168-4a71-8d5d-a1ca92d398ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d8ea17a10bb416bb627fa7daae0ee14)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:07.744621 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a769fc-1168-4a71-8d5d-a1ca92d398ac admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:07.846725 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 936/1861] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Oct 4 12:02:07 2022] PUT /identity/v3/projects/01dffde7e90a4b338ce82db3aca6e962/users/5929de891c694ab9bf3252acd0159cb2/roles/ab4307f3b7994c1c80036fa7db93b6b9 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:02:07.861886 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0559c7-0501-4f3a-821e-12ebafee4945 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:07.862415 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0559c7-0501-4f3a-821e-12ebafee4945 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:07.862878 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0559c7-0501-4f3a-821e-12ebafee4945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:07.896373 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-9f0559c7-0501-4f3a-821e-12ebafee4945 None None] MFA Rules not processed for user `5929de891c694ab9bf3252acd0159cb2`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:02:07.897681 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-9f0559c7-0501-4f3a-821e-12ebafee4945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:07.975117 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 937/1862] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:02:07 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 12:02:07.976415 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0559c7-0501-4f3a-821e-12ebafee4945 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:07.977834 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-9f0559c7-0501-4f3a-821e-12ebafee4945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:08.026940 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-58a769fc-1168-4a71-8d5d-a1ca92d398ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d8ea17a10bb416bb627fa7daae0ee14'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:08.034407 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-58a769fc-1168-4a71-8d5d-a1ca92d398ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d8ea17a10bb416bb627fa7daae0ee14'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:08.035179 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-58a769fc-1168-4a71-8d5d-a1ca92d398ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d8ea17a10bb416bb627fa7daae0ee14'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:08.035850 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-58a769fc-1168-4a71-8d5d-a1ca92d398ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d8ea17a10bb416bb627fa7daae0ee14'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:08.067813 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0559c7-0501-4f3a-821e-12ebafee4945 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:08.074112 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44bb84a-2a13-4300-babd-a85e2240bfce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:08.074807 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44bb84a-2a13-4300-babd-a85e2240bfce admin admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:08.075157 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44bb84a-2a13-4300-babd-a85e2240bfce admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:08.075498 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44bb84a-2a13-4300-babd-a85e2240bfce admin admin] PATH_INFO: `/v3/projects` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:08.076213 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44bb84a-2a13-4300-babd-a85e2240bfce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:08.078424 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44bb84a-2a13-4300-babd-a85e2240bfce admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:08.140892 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-58a769fc-1168-4a71-8d5d-a1ca92d398ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d8ea17a10bb416bb627fa7daae0ee14'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:08.161581 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 926/1863] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Oct 4 12:02:07 2022] DELETE /identity/v3/users/2d8ea17a10bb416bb627fa7daae0ee14 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:02:08.205008 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 938/1864] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Oct 4 12:02:07 2022] POST /identity/v3/projects => generated 385 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 12:02:08.205110 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a769fc-1168-4a71-8d5d-a1ca92d398ac admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:08.205110 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-58a769fc-1168-4a71-8d5d-a1ca92d398ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:08.239799 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:02:08.317491 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a769fc-1168-4a71-8d5d-a1ca92d398ac admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:08.366044 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44bb84a-2a13-4300-babd-a85e2240bfce admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:08.367882 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-e44bb84a-2a13-4300-babd-a85e2240bfce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:08.457714 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e14e94e-6747-4196-a812-707591fc50f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:08.458359 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e14e94e-6747-4196-a812-707591fc50f6 admin admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:08.458626 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e14e94e-6747-4196-a812-707591fc50f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:08.458905 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e14e94e-6747-4196-a812-707591fc50f6 admin admin] PATH_INFO: `/v3/users` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:08.459562 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e14e94e-6747-4196-a812-707591fc50f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:08.462720 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e14e94e-6747-4196-a812-707591fc50f6 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:08.491090 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44bb84a-2a13-4300-babd-a85e2240bfce admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:08.495251 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b39232-793a-42c9-82f4-e90f99a44f90 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e2a05b782424ab2928b5864f1bfd556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:08.495874 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b39232-793a-42c9-82f4-e90f99a44f90 service cinder] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:08.496158 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b39232-793a-42c9-82f4-e90f99a44f90 service cinder] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:08.496438 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b39232-793a-42c9-82f4-e90f99a44f90 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:08.499124 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-48b39232-793a-42c9-82f4-e90f99a44f90 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:08.597905 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b39232-793a-42c9-82f4-e90f99a44f90 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:08.599565 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b39232-793a-42c9-82f4-e90f99a44f90 service cinder] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:08.620939 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 939/1865] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:02:08 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 12:02:08.631760 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 927/1866] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Oct 4 12:02:08 2022] POST /identity/v3/users => generated 299 bytes in 431 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 12:02:08.635692 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b39232-793a-42c9-82f4-e90f99a44f90 service cinder] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:08.656643 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b39232-793a-42c9-82f4-e90f99a44f90 service cinder] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:08.662880 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5df07b5-be2b-45cc-81ea-72b3aabbf38f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:08.663581 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5df07b5-be2b-45cc-81ea-72b3aabbf38f admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:08.663852 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5df07b5-be2b-45cc-81ea-72b3aabbf38f admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:08.664121 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5df07b5-be2b-45cc-81ea-72b3aabbf38f admin admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:08.664961 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5df07b5-be2b-45cc-81ea-72b3aabbf38f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:08.666818 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5df07b5-be2b-45cc-81ea-72b3aabbf38f admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:08.678628 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 940/1867] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:02:08 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:02:08.683410 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e14e94e-6747-4196-a812-707591fc50f6 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:08.694665 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e14e94e-6747-4196-a812-707591fc50f6 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:08.699348 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64225e7-efcd-442f-a4c9-7d7b54539f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:08.700005 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64225e7-efcd-442f-a4c9-7d7b54539f61 admin admin] REQUEST_METHOD: `PUT` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:08.700316 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64225e7-efcd-442f-a4c9-7d7b54539f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:08.700619 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64225e7-efcd-442f-a4c9-7d7b54539f61 admin admin] PATH_INFO: `/v3/projects/a77eb4e4efc64c5cb3fab90f0c27e09c/users/d05cbe8f670d4c4392cb2fa545ee9875/roles/d6e7421d1ff9451c808004b818354550` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:08.715246 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64225e7-efcd-442f-a4c9-7d7b54539f61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a77eb4e4efc64c5cb3fab90f0c27e09c, user_id=d05cbe8f670d4c4392cb2fa545ee9875, role_id=d6e7421d1ff9451c808004b818354550)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:08.717943 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64225e7-efcd-442f-a4c9-7d7b54539f61 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:08.793387 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5df07b5-be2b-45cc-81ea-72b3aabbf38f admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:08.801668 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-d5df07b5-be2b-45cc-81ea-72b3aabbf38f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:08.815639 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5df07b5-be2b-45cc-81ea-72b3aabbf38f admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:08.821362 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347eff77-581b-4473-a58f-a5c0d52529f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:08.821953 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347eff77-581b-4473-a58f-a5c0d52529f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:08.825236 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347eff77-581b-4473-a58f-a5c0d52529f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:08.825236 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347eff77-581b-4473-a58f-a5c0d52529f6 admin admin] PATH_INFO: `/v3/projects/9db42037bb0f4290ac2d4247025ed3f6` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:08.825236 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347eff77-581b-4473-a58f-a5c0d52529f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9db42037bb0f4290ac2d4247025ed3f6)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:08.826060 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347eff77-581b-4473-a58f-a5c0d52529f6 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:08.835179 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 928/1868] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Oct 4 12:02:08 2022] PUT /identity/v3/projects/a77eb4e4efc64c5cb3fab90f0c27e09c/users/d05cbe8f670d4c4392cb2fa545ee9875/roles/d6e7421d1ff9451c808004b818354550 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:02:08.840713 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64225e7-efcd-442f-a4c9-7d7b54539f61 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:08.912230 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64225e7-efcd-442f-a4c9-7d7b54539f61 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:08.917141 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0432405-9e43-40f3-ae05-e6835bb51357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:08.917868 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0432405-9e43-40f3-ae05-e6835bb51357 admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:08.918148 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0432405-9e43-40f3-ae05-e6835bb51357 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:08.918421 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0432405-9e43-40f3-ae05-e6835bb51357 admin admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:08.919063 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0432405-9e43-40f3-ae05-e6835bb51357 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:08.920806 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0432405-9e43-40f3-ae05-e6835bb51357 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:08.935126 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 929/1869] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:02:08 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 12:02:08.936396 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0432405-9e43-40f3-ae05-e6835bb51357 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:08.947086 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0432405-9e43-40f3-ae05-e6835bb51357 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:08.952071 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7620938-8d23-4458-8a38-62d0f477bc10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:08.952847 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7620938-8d23-4458-8a38-62d0f477bc10 admin admin] REQUEST_METHOD: `PUT` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:08.953222 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7620938-8d23-4458-8a38-62d0f477bc10 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:08.953553 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7620938-8d23-4458-8a38-62d0f477bc10 admin admin] PATH_INFO: `/v3/projects/a77eb4e4efc64c5cb3fab90f0c27e09c/users/d05cbe8f670d4c4392cb2fa545ee9875/roles/d6e7421d1ff9451c808004b818354550` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:08.959094 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7620938-8d23-4458-8a38-62d0f477bc10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a77eb4e4efc64c5cb3fab90f0c27e09c, user_id=d05cbe8f670d4c4392cb2fa545ee9875, role_id=d6e7421d1ff9451c808004b818354550)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:08.959997 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7620938-8d23-4458-8a38-62d0f477bc10 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:08.981377 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 930/1870] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Oct 4 12:02:08 2022] PUT /identity/v3/projects/a77eb4e4efc64c5cb3fab90f0c27e09c/users/d05cbe8f670d4c4392cb2fa545ee9875/roles/d6e7421d1ff9451c808004b818354550 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:02:08.985163 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287c5bd1-fd14-4c46-9fd6-f7b32c0d151e None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:08.985674 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287c5bd1-fd14-4c46-9fd6-f7b32c0d151e None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:08.985799 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287c5bd1-fd14-4c46-9fd6-f7b32c0d151e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:08.998509 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-347eff77-581b-4473-a58f-a5c0d52529f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9db42037bb0f4290ac2d4247025ed3f6', 'request_id': 'req-347eff77-581b-4473-a58f-a5c0d52529f6'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:09.023541 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-287c5bd1-fd14-4c46-9fd6-f7b32c0d151e None None] MFA Rules not processed for user `d05cbe8f670d4c4392cb2fa545ee9875`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:02:09.024779 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-287c5bd1-fd14-4c46-9fd6-f7b32c0d151e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:09.084148 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-347eff77-581b-4473-a58f-a5c0d52529f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9db42037bb0f4290ac2d4247025ed3f6', 'request_id': 'req-347eff77-581b-4473-a58f-a5c0d52529f6'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:09.091710 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-347eff77-581b-4473-a58f-a5c0d52529f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9db42037bb0f4290ac2d4247025ed3f6', 'request_id': 'req-347eff77-581b-4473-a58f-a5c0d52529f6'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:09.094259 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 931/1871] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:02:08 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 12:02:09.106955 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-347eff77-581b-4473-a58f-a5c0d52529f6 admin admin] The token cache is being invalidate because project 9db42037bb0f4290ac2d4247025ed3f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:02:09.107205 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287c5bd1-fd14-4c46-9fd6-f7b32c0d151e None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:09.107322 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-347eff77-581b-4473-a58f-a5c0d52529f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:09.107931 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-347eff77-581b-4473-a58f-a5c0d52529f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:09.108752 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-287c5bd1-fd14-4c46-9fd6-f7b32c0d151e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:09.109773 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 941/1872] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Oct 4 12:02:08 2022] DELETE /identity/v3/projects/9db42037bb0f4290ac2d4247025ed3f6 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:02:09.114957 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8702fd07-30a9-4aba-9e62-a4841c76b619 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:09.115390 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8702fd07-30a9-4aba-9e62-a4841c76b619 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:09.115694 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8702fd07-30a9-4aba-9e62-a4841c76b619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:09.135758 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-8702fd07-30a9-4aba-9e62-a4841c76b619 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:02:09.137002 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-8702fd07-30a9-4aba-9e62-a4841c76b619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:09.168181 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287c5bd1-fd14-4c46-9fd6-f7b32c0d151e None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:09.171835 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1696f362-2f57-4500-9d1a-e0e63114b2ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e2a05b782424ab2928b5864f1bfd556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:09.172481 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1696f362-2f57-4500-9d1a-e0e63114b2ff service cinder] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:09.172787 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1696f362-2f57-4500-9d1a-e0e63114b2ff service cinder] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:09.173061 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1696f362-2f57-4500-9d1a-e0e63114b2ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:09.174928 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-1696f362-2f57-4500-9d1a-e0e63114b2ff service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:09.186555 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1696f362-2f57-4500-9d1a-e0e63114b2ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:09.187970 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1696f362-2f57-4500-9d1a-e0e63114b2ff service cinder] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:09.196789 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 942/1873] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:02:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:02:09.198233 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 932/1874] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:02:09 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 12:02:09.208621 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442bfffe-e4e0-4452-84a2-2f94a1c3d4a9 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:09.208621 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442bfffe-e4e0-4452-84a2-2f94a1c3d4a9 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:09.208621 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442bfffe-e4e0-4452-84a2-2f94a1c3d4a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:09.231189 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-442bfffe-e4e0-4452-84a2-2f94a1c3d4a9 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:02:09.232393 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-442bfffe-e4e0-4452-84a2-2f94a1c3d4a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:09.254893 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 943/1875] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:02:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 12:02:09.264423 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1696f362-2f57-4500-9d1a-e0e63114b2ff service cinder] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:09.280376 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1696f362-2f57-4500-9d1a-e0e63114b2ff service cinder] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:09.285364 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6806a9-ff88-4266-9d2f-12142cddba67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:09.287808 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6806a9-ff88-4266-9d2f-12142cddba67 admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:09.287808 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6806a9-ff88-4266-9d2f-12142cddba67 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:09.287808 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6806a9-ff88-4266-9d2f-12142cddba67 admin admin] PATH_INFO: `/v3/domains` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:09.287808 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6806a9-ff88-4266-9d2f-12142cddba67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:02:09.287808 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6806a9-ff88-4266-9d2f-12142cddba67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:09.289639 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6806a9-ff88-4266-9d2f-12142cddba67 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:09.322600 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 933/1876] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Oct 4 12:02:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:02:09.325842 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442bfffe-e4e0-4452-84a2-2f94a1c3d4a9 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:09.340823 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442bfffe-e4e0-4452-84a2-2f94a1c3d4a9 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:09.348761 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82cb8a7-38bb-49c5-845c-601d75f0e0d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:09.349795 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82cb8a7-38bb-49c5-845c-601d75f0e0d8 admin admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:09.350331 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82cb8a7-38bb-49c5-845c-601d75f0e0d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:09.350804 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82cb8a7-38bb-49c5-845c-601d75f0e0d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:09.352304 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82cb8a7-38bb-49c5-845c-601d75f0e0d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:09.354553 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82cb8a7-38bb-49c5-845c-601d75f0e0d8 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:09.638186 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 944/1877] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Oct 4 12:02:09 2022] POST /identity/v3/projects => generated 373 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:02:09.643343 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6806a9-ff88-4266-9d2f-12142cddba67 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:09.654015 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6806a9-ff88-4266-9d2f-12142cddba67 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:09.732224 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce30571b-cd61-46ac-980e-423baffab718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:09.733419 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce30571b-cd61-46ac-980e-423baffab718 admin admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:09.733755 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce30571b-cd61-46ac-980e-423baffab718 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:09.734228 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce30571b-cd61-46ac-980e-423baffab718 admin admin] PATH_INFO: `/v3/users` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:09.735181 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce30571b-cd61-46ac-980e-423baffab718 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:09.737881 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce30571b-cd61-46ac-980e-423baffab718 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:09.891314 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 934/1878] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Oct 4 12:02:09 2022] POST /identity/v3/users => generated 287 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:02:09.896139 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82cb8a7-38bb-49c5-845c-601d75f0e0d8 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:09.908586 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82cb8a7-38bb-49c5-845c-601d75f0e0d8 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:09.911933 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:02:09.922361 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfca518-c7bd-4a65-9760-50e2b8d02f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:09.923845 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfca518-c7bd-4a65-9760-50e2b8d02f13 admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:09.924347 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfca518-c7bd-4a65-9760-50e2b8d02f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:09.924860 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfca518-c7bd-4a65-9760-50e2b8d02f13 admin admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:09.925729 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfca518-c7bd-4a65-9760-50e2b8d02f13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:09.928271 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfca518-c7bd-4a65-9760-50e2b8d02f13 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:09.941236 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 945/1879] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:02:09 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:02:09.945894 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce30571b-cd61-46ac-980e-423baffab718 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:09.957222 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce30571b-cd61-46ac-980e-423baffab718 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:09.962099 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f30ad11-9d01-476a-97df-ced9ea50d02d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:09.962709 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f30ad11-9d01-476a-97df-ced9ea50d02d admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:09.962992 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f30ad11-9d01-476a-97df-ced9ea50d02d admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:09.963264 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f30ad11-9d01-476a-97df-ced9ea50d02d admin admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:09.963985 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f30ad11-9d01-476a-97df-ced9ea50d02d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:09.965572 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f30ad11-9d01-476a-97df-ced9ea50d02d admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:09.976467 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 935/1880] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:02:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:02:09.980851 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfca518-c7bd-4a65-9760-50e2b8d02f13 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:09.993073 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfca518-c7bd-4a65-9760-50e2b8d02f13 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:09.998738 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e15825-df99-40d8-8bbb-2c56d48871dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:09.999338 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e15825-df99-40d8-8bbb-2c56d48871dd admin admin] REQUEST_METHOD: `PUT` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:09.999536 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e15825-df99-40d8-8bbb-2c56d48871dd admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:09.999811 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e15825-df99-40d8-8bbb-2c56d48871dd admin admin] PATH_INFO: `/v3/projects/00f99ba26ad24ba2898a1d70c18eed44/users/a51757d93d2943879ad8cb7e531e6558/roles/ab4307f3b7994c1c80036fa7db93b6b9` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:10.015600 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e15825-df99-40d8-8bbb-2c56d48871dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=00f99ba26ad24ba2898a1d70c18eed44, user_id=a51757d93d2943879ad8cb7e531e6558, role_id=ab4307f3b7994c1c80036fa7db93b6b9)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:10.018286 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e15825-df99-40d8-8bbb-2c56d48871dd admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:10.170393 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 946/1881] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Oct 4 12:02:09 2022] PUT /identity/v3/projects/00f99ba26ad24ba2898a1d70c18eed44/users/a51757d93d2943879ad8cb7e531e6558/roles/ab4307f3b7994c1c80036fa7db93b6b9 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:02:10.181238 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc78154-863d-4741-92d8-b849e2e2429c None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:10.181529 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc78154-863d-4741-92d8-b849e2e2429c None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:10.181812 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc78154-863d-4741-92d8-b849e2e2429c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:10.210622 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-edc78154-863d-4741-92d8-b849e2e2429c None None] MFA Rules not processed for user `a51757d93d2943879ad8cb7e531e6558`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:02:10.211863 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-edc78154-863d-4741-92d8-b849e2e2429c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:10.281443 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 936/1882] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:02:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:02:10.365823 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602c7e81-850b-47da-a256-05d23ed76a38 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:10.366028 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602c7e81-850b-47da-a256-05d23ed76a38 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:10.366752 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602c7e81-850b-47da-a256-05d23ed76a38 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:10.368117 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 947/1883] 10.222.0.59 () {54 vars in 921 bytes} [Tue Oct 4 12:02:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:02:10.384209 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c747e4d-2569-4402-a9e7-348b6f73a3fc None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:10.384371 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c747e4d-2569-4402-a9e7-348b6f73a3fc None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:10.384684 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c747e4d-2569-4402-a9e7-348b6f73a3fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:10.405367 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-7c747e4d-2569-4402-a9e7-348b6f73a3fc None None] MFA Rules not processed for user `a8e23d1d2fe24bdf9552e7c2f0ae3424`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:02:10.406637 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-7c747e4d-2569-4402-a9e7-348b6f73a3fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:10.479327 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 937/1884] 10.222.0.59 () {58 vars in 1018 bytes} [Tue Oct 4 12:02:10 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:02:10.499994 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602c7e81-850b-47da-a256-05d23ed76a38 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:10.499994 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-602c7e81-850b-47da-a256-05d23ed76a38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:10.530780 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602c7e81-850b-47da-a256-05d23ed76a38 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:10.541816 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143ab39e-3634-4158-930d-690c1b751e6d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8e23d1d2fe24bdf9552e7c2f0ae3424', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:10.541816 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143ab39e-3634-4158-930d-690c1b751e6d service nova] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:10.541816 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143ab39e-3634-4158-930d-690c1b751e6d service nova] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:10.541816 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143ab39e-3634-4158-930d-690c1b751e6d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:10.551127 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143ab39e-3634-4158-930d-690c1b751e6d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:10.553215 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143ab39e-3634-4158-930d-690c1b751e6d service nova] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:10.568103 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c747e4d-2569-4402-a9e7-348b6f73a3fc None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:10.571046 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-7c747e4d-2569-4402-a9e7-348b6f73a3fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:10.579173 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 948/1885] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:02:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:02:10.651700 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c747e4d-2569-4402-a9e7-348b6f73a3fc None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:10.656238 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834e7898-8b1a-4bda-b1c3-63228db740d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e2a05b782424ab2928b5864f1bfd556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:10.657161 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834e7898-8b1a-4bda-b1c3-63228db740d9 service cinder] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:10.657449 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834e7898-8b1a-4bda-b1c3-63228db740d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:10.657726 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834e7898-8b1a-4bda-b1c3-63228db740d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:10.687525 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834e7898-8b1a-4bda-b1c3-63228db740d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:10.689039 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834e7898-8b1a-4bda-b1c3-63228db740d9 service cinder] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:10.728267 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 938/1886] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:02:10 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:02:10.772296 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143ab39e-3634-4158-930d-690c1b751e6d service nova] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:10.886268 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143ab39e-3634-4158-930d-690c1b751e6d service nova] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:10.938139 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ca65f4-52e1-496e-86f6-aeed6690e1a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:10.938139 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ca65f4-52e1-496e-86f6-aeed6690e1a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:10.938139 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ca65f4-52e1-496e-86f6-aeed6690e1a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:10.938139 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ca65f4-52e1-496e-86f6-aeed6690e1a1 admin admin] PATH_INFO: `/v3/users/a51757d93d2943879ad8cb7e531e6558` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:10.965951 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ca65f4-52e1-496e-86f6-aeed6690e1a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a51757d93d2943879ad8cb7e531e6558)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:10.965951 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ca65f4-52e1-496e-86f6-aeed6690e1a1 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:11.111398 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834e7898-8b1a-4bda-b1c3-63228db740d9 service cinder] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:11.112853 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-834e7898-8b1a-4bda-b1c3-63228db740d9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:11.126179 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834e7898-8b1a-4bda-b1c3-63228db740d9 service cinder] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:11.130191 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98455e41-4bec-4472-862c-2921ec018380 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e2a05b782424ab2928b5864f1bfd556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:11.153739 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98455e41-4bec-4472-862c-2921ec018380 service cinder] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:11.153739 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98455e41-4bec-4472-862c-2921ec018380 service cinder] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:11.153739 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98455e41-4bec-4472-862c-2921ec018380 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:11.153739 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-98455e41-4bec-4472-862c-2921ec018380 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:11.205362 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98455e41-4bec-4472-862c-2921ec018380 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:11.208783 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98455e41-4bec-4472-862c-2921ec018380 service cinder] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:11.219884 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 939/1887] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:02:11 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:02:11.620703 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-41ca65f4-52e1-496e-86f6-aeed6690e1a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a51757d93d2943879ad8cb7e531e6558'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:11.633468 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-41ca65f4-52e1-496e-86f6-aeed6690e1a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a51757d93d2943879ad8cb7e531e6558'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:11.634531 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-41ca65f4-52e1-496e-86f6-aeed6690e1a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a51757d93d2943879ad8cb7e531e6558'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:11.635170 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-41ca65f4-52e1-496e-86f6-aeed6690e1a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a51757d93d2943879ad8cb7e531e6558'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:11.718320 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-41ca65f4-52e1-496e-86f6-aeed6690e1a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a51757d93d2943879ad8cb7e531e6558'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:11.757825 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 949/1888] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Oct 4 12:02:10 2022] DELETE /identity/v3/users/a51757d93d2943879ad8cb7e531e6558 => generated 0 bytes in 986 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:02:11.763616 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25b2edb-5dea-4937-8864-b9f0be54c1d4 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:11.764950 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25b2edb-5dea-4937-8864-b9f0be54c1d4 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:11.765466 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25b2edb-5dea-4937-8864-b9f0be54c1d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:11.787587 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-e25b2edb-5dea-4937-8864-b9f0be54c1d4 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:02:11.788976 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-e25b2edb-5dea-4937-8864-b9f0be54c1d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:11.869614 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 940/1889] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:02:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 12:02:11.881348 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ca65f4-52e1-496e-86f6-aeed6690e1a1 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:11.887341 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-41ca65f4-52e1-496e-86f6-aeed6690e1a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:11.963831 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ca65f4-52e1-496e-86f6-aeed6690e1a1 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:11.967853 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e114fe-9951-4e01-afff-2aa85db96188 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7289515c5c44914a19daa439de98cb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:11.968482 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e114fe-9951-4e01-afff-2aa85db96188 service neutron] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:11.968795 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e114fe-9951-4e01-afff-2aa85db96188 service neutron] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:11.977228 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e114fe-9951-4e01-afff-2aa85db96188 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:11.978417 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e114fe-9951-4e01-afff-2aa85db96188 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:11.979859 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e114fe-9951-4e01-afff-2aa85db96188 service neutron] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:11.990579 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 950/1890] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:02:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:02:12.185177 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:02:12.758275 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25b2edb-5dea-4937-8864-b9f0be54c1d4 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:12.758275 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-e25b2edb-5dea-4937-8864-b9f0be54c1d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:12.767602 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25b2edb-5dea-4937-8864-b9f0be54c1d4 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:12.790955 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c678a9d1-d36f-4b80-b357-2989db76d20f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:12.793502 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c678a9d1-d36f-4b80-b357-2989db76d20f admin admin] REQUEST_METHOD: `DELETE` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:12.795004 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c678a9d1-d36f-4b80-b357-2989db76d20f admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:12.796114 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c678a9d1-d36f-4b80-b357-2989db76d20f admin admin] PATH_INFO: `/v3/projects/00f99ba26ad24ba2898a1d70c18eed44` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:12.800747 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c678a9d1-d36f-4b80-b357-2989db76d20f admin admin] RBAC: Authorizing `identity:delete_project(project_id=00f99ba26ad24ba2898a1d70c18eed44)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:12.809131 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c678a9d1-d36f-4b80-b357-2989db76d20f admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:13.052277 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-c678a9d1-d36f-4b80-b357-2989db76d20f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00f99ba26ad24ba2898a1d70c18eed44', 'request_id': 'req-c678a9d1-d36f-4b80-b357-2989db76d20f'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:13.059928 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-c678a9d1-d36f-4b80-b357-2989db76d20f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00f99ba26ad24ba2898a1d70c18eed44', 'request_id': 'req-c678a9d1-d36f-4b80-b357-2989db76d20f'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:13.358292 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-c678a9d1-d36f-4b80-b357-2989db76d20f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00f99ba26ad24ba2898a1d70c18eed44', 'request_id': 'req-c678a9d1-d36f-4b80-b357-2989db76d20f'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:13.368029 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-c678a9d1-d36f-4b80-b357-2989db76d20f admin admin] The token cache is being invalidate because project 00f99ba26ad24ba2898a1d70c18eed44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:02:13.370723 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-c678a9d1-d36f-4b80-b357-2989db76d20f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:13.371478 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-c678a9d1-d36f-4b80-b357-2989db76d20f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:13.374840 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 941/1891] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Oct 4 12:02:12 2022] DELETE /identity/v3/projects/00f99ba26ad24ba2898a1d70c18eed44 => generated 0 bytes in 632 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:02:13.380557 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d57af8-2d5f-48d8-8ad2-ac71b0c65a93 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:13.381463 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d57af8-2d5f-48d8-8ad2-ac71b0c65a93 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:13.381880 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d57af8-2d5f-48d8-8ad2-ac71b0c65a93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:13.412714 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-05d57af8-2d5f-48d8-8ad2-ac71b0c65a93 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:02:13.414349 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-05d57af8-2d5f-48d8-8ad2-ac71b0c65a93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:13.543958 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 951/1892] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:02:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:02:13.552259 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052aa4fa-bb0c-48c2-a54c-3bfbe755f89a None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:13.552760 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052aa4fa-bb0c-48c2-a54c-3bfbe755f89a None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:13.553346 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052aa4fa-bb0c-48c2-a54c-3bfbe755f89a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:13.583304 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-052aa4fa-bb0c-48c2-a54c-3bfbe755f89a None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:02:13.585117 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-052aa4fa-bb0c-48c2-a54c-3bfbe755f89a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:13.599551 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 942/1893] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:02:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:02:13.600492 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d57af8-2d5f-48d8-8ad2-ac71b0c65a93 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:13.614966 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d57af8-2d5f-48d8-8ad2-ac71b0c65a93 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:13.619985 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6d9350-6d42-433d-98af-d784cc91aa91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:13.620582 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6d9350-6d42-433d-98af-d784cc91aa91 admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:13.620916 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6d9350-6d42-433d-98af-d784cc91aa91 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:13.621188 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6d9350-6d42-433d-98af-d784cc91aa91 admin admin] PATH_INFO: `/v3/domains` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:13.621990 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6d9350-6d42-433d-98af-d784cc91aa91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:02:13.622289 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6d9350-6d42-433d-98af-d784cc91aa91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:13.623937 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6d9350-6d42-433d-98af-d784cc91aa91 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:13.637177 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 952/1894] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Oct 4 12:02:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:02:13.642864 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052aa4fa-bb0c-48c2-a54c-3bfbe755f89a None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:13.653634 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052aa4fa-bb0c-48c2-a54c-3bfbe755f89a None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:13.658943 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ed08a2-9d59-49db-904a-96c2ce35da29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:13.660071 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ed08a2-9d59-49db-904a-96c2ce35da29 admin admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:13.660387 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ed08a2-9d59-49db-904a-96c2ce35da29 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:13.660749 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ed08a2-9d59-49db-904a-96c2ce35da29 admin admin] PATH_INFO: `/v3/projects` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:13.661717 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ed08a2-9d59-49db-904a-96c2ce35da29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:13.663596 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ed08a2-9d59-49db-904a-96c2ce35da29 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:13.823747 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 943/1895] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Oct 4 12:02:13 2022] POST /identity/v3/projects => generated 373 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:02:13.827646 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6d9350-6d42-433d-98af-d784cc91aa91 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:13.837846 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6d9350-6d42-433d-98af-d784cc91aa91 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:13.896501 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7533650c-e97b-4f46-9be5-43787c69dc09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:13.897149 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7533650c-e97b-4f46-9be5-43787c69dc09 admin admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:13.897432 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7533650c-e97b-4f46-9be5-43787c69dc09 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:13.897732 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7533650c-e97b-4f46-9be5-43787c69dc09 admin admin] PATH_INFO: `/v3/users` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:13.898374 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7533650c-e97b-4f46-9be5-43787c69dc09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:13.900403 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7533650c-e97b-4f46-9be5-43787c69dc09 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:14.017175 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:02:14.023685 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 953/1896] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Oct 4 12:02:13 2022] POST /identity/v3/users => generated 287 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:02:14.027693 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ed08a2-9d59-49db-904a-96c2ce35da29 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:14.037918 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ed08a2-9d59-49db-904a-96c2ce35da29 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:14.042467 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8509c4c0-be7e-49b6-b8b4-df012040d486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:14.043079 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8509c4c0-be7e-49b6-b8b4-df012040d486 admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:14.043368 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8509c4c0-be7e-49b6-b8b4-df012040d486 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:14.043646 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8509c4c0-be7e-49b6-b8b4-df012040d486 admin admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:14.044291 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8509c4c0-be7e-49b6-b8b4-df012040d486 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:14.045906 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8509c4c0-be7e-49b6-b8b4-df012040d486 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:14.056758 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 944/1897] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:02:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:02:14.060753 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7533650c-e97b-4f46-9be5-43787c69dc09 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:14.071846 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7533650c-e97b-4f46-9be5-43787c69dc09 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:14.082946 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a29f6cd-3246-41b6-bfb5-1620b562b290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:14.082946 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a29f6cd-3246-41b6-bfb5-1620b562b290 admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:14.082946 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a29f6cd-3246-41b6-bfb5-1620b562b290 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:14.082946 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a29f6cd-3246-41b6-bfb5-1620b562b290 admin admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:14.083376 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a29f6cd-3246-41b6-bfb5-1620b562b290 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:14.083376 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a29f6cd-3246-41b6-bfb5-1620b562b290 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:14.093406 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 954/1898] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:02:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:02:14.094600 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8509c4c0-be7e-49b6-b8b4-df012040d486 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:14.107175 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8509c4c0-be7e-49b6-b8b4-df012040d486 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:14.112780 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed4a61d-4a8b-43c0-86e4-c7b4997babd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:14.114448 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed4a61d-4a8b-43c0-86e4-c7b4997babd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:14.114875 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed4a61d-4a8b-43c0-86e4-c7b4997babd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:14.115291 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed4a61d-4a8b-43c0-86e4-c7b4997babd1 admin admin] PATH_INFO: `/v3/projects/0802bd3c6efe4c19be49647f77008541/users/2d375ed76f2d4e3080a9f0d7b563d943/roles/ab4307f3b7994c1c80036fa7db93b6b9` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:14.134447 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed4a61d-4a8b-43c0-86e4-c7b4997babd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0802bd3c6efe4c19be49647f77008541, user_id=2d375ed76f2d4e3080a9f0d7b563d943, role_id=ab4307f3b7994c1c80036fa7db93b6b9)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:14.137451 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed4a61d-4a8b-43c0-86e4-c7b4997babd1 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:14.218498 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 945/1899] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Oct 4 12:02:14 2022] PUT /identity/v3/projects/0802bd3c6efe4c19be49647f77008541/users/2d375ed76f2d4e3080a9f0d7b563d943/roles/ab4307f3b7994c1c80036fa7db93b6b9 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:02:14.230766 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f24873-99ad-4469-82b9-04e6de250d23 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:14.231204 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f24873-99ad-4469-82b9-04e6de250d23 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:14.231611 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f24873-99ad-4469-82b9-04e6de250d23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:14.274607 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-c2f24873-99ad-4469-82b9-04e6de250d23 None None] MFA Rules not processed for user `2d375ed76f2d4e3080a9f0d7b563d943`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:02:14.276662 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-c2f24873-99ad-4469-82b9-04e6de250d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:14.362256 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 955/1900] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:02:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 12:02:14.374795 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed4a61d-4a8b-43c0-86e4-c7b4997babd1 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:14.377158 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-2ed4a61d-4a8b-43c0-86e4-c7b4997babd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:14.440069 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed4a61d-4a8b-43c0-86e4-c7b4997babd1 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:14.443883 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c640ad-e5be-424d-9ad3-a5d5544bfeb0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e2a05b782424ab2928b5864f1bfd556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:14.444490 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c640ad-e5be-424d-9ad3-a5d5544bfeb0 service cinder] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:14.444805 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c640ad-e5be-424d-9ad3-a5d5544bfeb0 service cinder] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:14.445074 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c640ad-e5be-424d-9ad3-a5d5544bfeb0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:14.453540 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c640ad-e5be-424d-9ad3-a5d5544bfeb0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:14.457990 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c640ad-e5be-424d-9ad3-a5d5544bfeb0 service cinder] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:14.468885 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 946/1901] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:02:14 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:02:14.496801 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f24873-99ad-4469-82b9-04e6de250d23 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:14.566025 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f24873-99ad-4469-82b9-04e6de250d23 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:14.571366 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7864a6-1597-4ab4-a3ae-541889f7de5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:14.572018 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7864a6-1597-4ab4-a3ae-541889f7de5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:14.572883 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7864a6-1597-4ab4-a3ae-541889f7de5a admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:14.572883 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7864a6-1597-4ab4-a3ae-541889f7de5a admin admin] PATH_INFO: `/v3/users/2d375ed76f2d4e3080a9f0d7b563d943` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:14.578769 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7864a6-1597-4ab4-a3ae-541889f7de5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d375ed76f2d4e3080a9f0d7b563d943)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:14.578769 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7864a6-1597-4ab4-a3ae-541889f7de5a admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:14.835578 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-9e7864a6-1597-4ab4-a3ae-541889f7de5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d375ed76f2d4e3080a9f0d7b563d943'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:14.845363 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-9e7864a6-1597-4ab4-a3ae-541889f7de5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d375ed76f2d4e3080a9f0d7b563d943'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:14.846450 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-9e7864a6-1597-4ab4-a3ae-541889f7de5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d375ed76f2d4e3080a9f0d7b563d943'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:14.847100 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-9e7864a6-1597-4ab4-a3ae-541889f7de5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d375ed76f2d4e3080a9f0d7b563d943'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:14.975354 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-9e7864a6-1597-4ab4-a3ae-541889f7de5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d375ed76f2d4e3080a9f0d7b563d943'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:14.995321 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 956/1902] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Oct 4 12:02:14 2022] DELETE /identity/v3/users/2d375ed76f2d4e3080a9f0d7b563d943 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:02:14.999869 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87d188a-23bb-499a-b8b6-26d56025ee84 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:15.000357 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87d188a-23bb-499a-b8b6-26d56025ee84 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:15.000612 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87d188a-23bb-499a-b8b6-26d56025ee84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:15.023403 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-c87d188a-23bb-499a-b8b6-26d56025ee84 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:02:15.025018 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-c87d188a-23bb-499a-b8b6-26d56025ee84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:15.096543 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 947/1903] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:02:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:02:15.106682 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7864a6-1597-4ab4-a3ae-541889f7de5a admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:15.108114 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-9e7864a6-1597-4ab4-a3ae-541889f7de5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:15.168270 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7864a6-1597-4ab4-a3ae-541889f7de5a admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:15.172014 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac5a7d0-a854-4425-90b9-064783f3bea8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7289515c5c44914a19daa439de98cb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:15.172791 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac5a7d0-a854-4425-90b9-064783f3bea8 service neutron] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:15.173071 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac5a7d0-a854-4425-90b9-064783f3bea8 service neutron] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:15.173340 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac5a7d0-a854-4425-90b9-064783f3bea8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:15.183809 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac5a7d0-a854-4425-90b9-064783f3bea8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:15.185277 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac5a7d0-a854-4425-90b9-064783f3bea8 service neutron] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:15.196355 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 957/1904] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:02:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:02:15.919148 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87d188a-23bb-499a-b8b6-26d56025ee84 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:15.919148 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-c87d188a-23bb-499a-b8b6-26d56025ee84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:15.930382 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87d188a-23bb-499a-b8b6-26d56025ee84 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:15.935836 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164172f9-6eac-4999-9e4b-9a3b27c983b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:15.936531 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164172f9-6eac-4999-9e4b-9a3b27c983b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:15.936853 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164172f9-6eac-4999-9e4b-9a3b27c983b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:15.937157 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164172f9-6eac-4999-9e4b-9a3b27c983b9 admin admin] PATH_INFO: `/v3/projects/0802bd3c6efe4c19be49647f77008541` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:15.938258 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164172f9-6eac-4999-9e4b-9a3b27c983b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0802bd3c6efe4c19be49647f77008541)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:15.940555 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164172f9-6eac-4999-9e4b-9a3b27c983b9 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:15.954369 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:02:16.177317 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-164172f9-6eac-4999-9e4b-9a3b27c983b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0802bd3c6efe4c19be49647f77008541', 'request_id': 'req-164172f9-6eac-4999-9e4b-9a3b27c983b9'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:16.183854 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-164172f9-6eac-4999-9e4b-9a3b27c983b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0802bd3c6efe4c19be49647f77008541', 'request_id': 'req-164172f9-6eac-4999-9e4b-9a3b27c983b9'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:16.318629 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-164172f9-6eac-4999-9e4b-9a3b27c983b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0802bd3c6efe4c19be49647f77008541', 'request_id': 'req-164172f9-6eac-4999-9e4b-9a3b27c983b9'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:16.330627 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-164172f9-6eac-4999-9e4b-9a3b27c983b9 admin admin] The token cache is being invalidate because project 0802bd3c6efe4c19be49647f77008541 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:02:16.331820 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-164172f9-6eac-4999-9e4b-9a3b27c983b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:16.335557 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-164172f9-6eac-4999-9e4b-9a3b27c983b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:16.335557 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 948/1905] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Oct 4 12:02:15 2022] DELETE /identity/v3/projects/0802bd3c6efe4c19be49647f77008541 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:02:16.341214 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909a7fa7-5a3b-458e-84fd-153e8a7b4049 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:16.341626 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909a7fa7-5a3b-458e-84fd-153e8a7b4049 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:16.341702 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909a7fa7-5a3b-458e-84fd-153e8a7b4049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:16.364017 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-909a7fa7-5a3b-458e-84fd-153e8a7b4049 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:02:16.365296 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-909a7fa7-5a3b-458e-84fd-153e8a7b4049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:16.436653 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 958/1906] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:02:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:02:16.438473 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44164d6b-9dd9-4709-ada3-47fb181ae7c2 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:16.438762 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44164d6b-9dd9-4709-ada3-47fb181ae7c2 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:16.439043 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44164d6b-9dd9-4709-ada3-47fb181ae7c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:16.462960 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-44164d6b-9dd9-4709-ada3-47fb181ae7c2 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:02:16.465199 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-44164d6b-9dd9-4709-ada3-47fb181ae7c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:16.472433 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 949/1907] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:02:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:02:16.476968 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909a7fa7-5a3b-458e-84fd-153e8a7b4049 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:16.487086 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909a7fa7-5a3b-458e-84fd-153e8a7b4049 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:16.492315 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb62313-9f17-4487-8c99-35e8f7069228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:16.496518 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb62313-9f17-4487-8c99-35e8f7069228 admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:16.496518 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb62313-9f17-4487-8c99-35e8f7069228 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:16.496518 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb62313-9f17-4487-8c99-35e8f7069228 admin admin] PATH_INFO: `/v3/domains` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:16.496518 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb62313-9f17-4487-8c99-35e8f7069228 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:02:16.496518 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb62313-9f17-4487-8c99-35e8f7069228 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:16.496518 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb62313-9f17-4487-8c99-35e8f7069228 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:16.512124 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 959/1908] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Oct 4 12:02:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:02:16.513333 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44164d6b-9dd9-4709-ada3-47fb181ae7c2 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:16.524062 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44164d6b-9dd9-4709-ada3-47fb181ae7c2 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:16.528827 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbbb1a4-174c-4ee3-a2ce-9a539404f1da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:16.529401 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbbb1a4-174c-4ee3-a2ce-9a539404f1da admin admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:16.529674 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbbb1a4-174c-4ee3-a2ce-9a539404f1da admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:16.529942 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbbb1a4-174c-4ee3-a2ce-9a539404f1da admin admin] PATH_INFO: `/v3/projects` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:16.530600 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbbb1a4-174c-4ee3-a2ce-9a539404f1da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:16.532503 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbbb1a4-174c-4ee3-a2ce-9a539404f1da admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:16.614177 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 950/1909] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Oct 4 12:02:16 2022] POST /identity/v3/projects => generated 371 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 12:02:16.618247 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb62313-9f17-4487-8c99-35e8f7069228 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:16.628904 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb62313-9f17-4487-8c99-35e8f7069228 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:16.684628 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bf89c9-957a-4be9-9c51-ecdd9cd31987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:16.685223 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bf89c9-957a-4be9-9c51-ecdd9cd31987 admin admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:16.685498 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bf89c9-957a-4be9-9c51-ecdd9cd31987 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:16.685775 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bf89c9-957a-4be9-9c51-ecdd9cd31987 admin admin] PATH_INFO: `/v3/users` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:16.686405 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bf89c9-957a-4be9-9c51-ecdd9cd31987 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:16.688295 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bf89c9-957a-4be9-9c51-ecdd9cd31987 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:16.815796 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 960/1910] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Oct 4 12:02:16 2022] POST /identity/v3/users => generated 286 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:02:16.820236 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbbb1a4-174c-4ee3-a2ce-9a539404f1da admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:16.830337 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbbb1a4-174c-4ee3-a2ce-9a539404f1da admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:16.835758 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8245f9cc-f8a0-4eae-ab7a-bcd8b03a35cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:16.836303 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8245f9cc-f8a0-4eae-ab7a-bcd8b03a35cf admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:16.836814 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8245f9cc-f8a0-4eae-ab7a-bcd8b03a35cf admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:16.837092 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8245f9cc-f8a0-4eae-ab7a-bcd8b03a35cf admin admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:16.837771 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8245f9cc-f8a0-4eae-ab7a-bcd8b03a35cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:16.839358 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8245f9cc-f8a0-4eae-ab7a-bcd8b03a35cf admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:16.850320 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 951/1911] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:02:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 12:02:16.854345 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bf89c9-957a-4be9-9c51-ecdd9cd31987 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:16.865511 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bf89c9-957a-4be9-9c51-ecdd9cd31987 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:16.870297 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ffc9f1-2804-44e6-a2e0-56aafb2e3306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:16.871166 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ffc9f1-2804-44e6-a2e0-56aafb2e3306 admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:16.872533 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ffc9f1-2804-44e6-a2e0-56aafb2e3306 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:16.872858 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ffc9f1-2804-44e6-a2e0-56aafb2e3306 admin admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:16.873513 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ffc9f1-2804-44e6-a2e0-56aafb2e3306 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:16.875134 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ffc9f1-2804-44e6-a2e0-56aafb2e3306 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:16.891957 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 961/1912] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:02:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:02:16.894046 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8245f9cc-f8a0-4eae-ab7a-bcd8b03a35cf admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:16.924740 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8245f9cc-f8a0-4eae-ab7a-bcd8b03a35cf admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:16.924740 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e99646-0a71-4d91-8712-f8b136925291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:16.924740 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e99646-0a71-4d91-8712-f8b136925291 admin admin] REQUEST_METHOD: `PUT` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:16.924740 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e99646-0a71-4d91-8712-f8b136925291 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:16.928082 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e99646-0a71-4d91-8712-f8b136925291 admin admin] PATH_INFO: `/v3/projects/d8384f08ca14447395a91459b34a2099/users/a0df8dcc8c554e5ca9cdd5b3d5d71cdf/roles/ab4307f3b7994c1c80036fa7db93b6b9` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:16.944791 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e99646-0a71-4d91-8712-f8b136925291 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8384f08ca14447395a91459b34a2099, user_id=a0df8dcc8c554e5ca9cdd5b3d5d71cdf, role_id=ab4307f3b7994c1c80036fa7db93b6b9)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:16.947573 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e99646-0a71-4d91-8712-f8b136925291 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:17.128243 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 952/1913] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Oct 4 12:02:16 2022] PUT /identity/v3/projects/d8384f08ca14447395a91459b34a2099/users/a0df8dcc8c554e5ca9cdd5b3d5d71cdf/roles/ab4307f3b7994c1c80036fa7db93b6b9 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:02:17.133133 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0048d319-feff-4fd6-835d-8e6cfba2997b None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:17.133424 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0048d319-feff-4fd6-835d-8e6cfba2997b None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:17.133754 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0048d319-feff-4fd6-835d-8e6cfba2997b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:17.159342 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-0048d319-feff-4fd6-835d-8e6cfba2997b None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:02:17.161337 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-0048d319-feff-4fd6-835d-8e6cfba2997b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:17.236382 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 962/1914] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:02:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:02:17.266193 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e99646-0a71-4d91-8712-f8b136925291 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:17.268635 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-81e99646-0a71-4d91-8712-f8b136925291 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:17.339759 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e99646-0a71-4d91-8712-f8b136925291 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:17.348807 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed06a1b-77c2-4fa5-9dcd-a132f81255c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7289515c5c44914a19daa439de98cb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:17.349508 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed06a1b-77c2-4fa5-9dcd-a132f81255c6 service neutron] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:17.349860 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed06a1b-77c2-4fa5-9dcd-a132f81255c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:17.350200 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed06a1b-77c2-4fa5-9dcd-a132f81255c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:17.362142 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed06a1b-77c2-4fa5-9dcd-a132f81255c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:17.364865 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed06a1b-77c2-4fa5-9dcd-a132f81255c6 service neutron] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:17.374495 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 953/1915] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:02:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:02:17.432852 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:02:18.583807 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0048d319-feff-4fd6-835d-8e6cfba2997b None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:18.588905 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-0048d319-feff-4fd6-835d-8e6cfba2997b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:18.666263 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0048d319-feff-4fd6-835d-8e6cfba2997b None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:18.671782 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93880266-0c73-4074-99fd-a1e8fa22a040 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e2a05b782424ab2928b5864f1bfd556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:18.672455 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93880266-0c73-4074-99fd-a1e8fa22a040 service cinder] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:18.672762 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93880266-0c73-4074-99fd-a1e8fa22a040 service cinder] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:18.673158 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93880266-0c73-4074-99fd-a1e8fa22a040 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:18.677696 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-93880266-0c73-4074-99fd-a1e8fa22a040 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:18.748650 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93880266-0c73-4074-99fd-a1e8fa22a040 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:18.755650 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93880266-0c73-4074-99fd-a1e8fa22a040 service cinder] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:18.766048 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 963/1916] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:02:18 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:02:18.822039 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:02:22.358408 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:02:23.433103 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:DELETE=11,keystone:SELECT=85,keystone:INSERT=4 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:02:23.616785 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:02:26.086878 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed06a1b-77c2-4fa5-9dcd-a132f81255c6 service neutron] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:26.088685 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-7ed06a1b-77c2-4fa5-9dcd-a132f81255c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:26.110088 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed06a1b-77c2-4fa5-9dcd-a132f81255c6 service neutron] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:26.116140 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db818547-f4d2-4e3f-89c5-594a37c6ec38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:26.116852 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db818547-f4d2-4e3f-89c5-594a37c6ec38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:26.117145 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db818547-f4d2-4e3f-89c5-594a37c6ec38 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:26.117545 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db818547-f4d2-4e3f-89c5-594a37c6ec38 admin admin] PATH_INFO: `/v3/users/4a36cb8aa18e4bba961047fee4188a5b` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:26.118718 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db818547-f4d2-4e3f-89c5-594a37c6ec38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a36cb8aa18e4bba961047fee4188a5b)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:26.121626 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db818547-f4d2-4e3f-89c5-594a37c6ec38 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:26.143926 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb61116a-e745-4c41-8282-1d89f723c570 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:26.145855 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb61116a-e745-4c41-8282-1d89f723c570 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:26.146329 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb61116a-e745-4c41-8282-1d89f723c570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:26.217570 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-eb61116a-e745-4c41-8282-1d89f723c570 None None] MFA Rules not processed for user `a0df8dcc8c554e5ca9cdd5b3d5d71cdf`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:02:26.219619 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-eb61116a-e745-4c41-8282-1d89f723c570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:26.372904 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 964/1917] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:02:26 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:02:26.388895 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb61116a-e745-4c41-8282-1d89f723c570 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:26.413339 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb61116a-e745-4c41-8282-1d89f723c570 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:26.421471 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd74cb34-1e5b-460f-9330-fce9fc700ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:26.422342 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd74cb34-1e5b-460f-9330-fce9fc700ef5 admin admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:26.422853 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd74cb34-1e5b-460f-9330-fce9fc700ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:26.423123 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd74cb34-1e5b-460f-9330-fce9fc700ef5 admin admin] PATH_INFO: `/v3/projects` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:26.423977 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd74cb34-1e5b-460f-9330-fce9fc700ef5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:26.427018 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd74cb34-1e5b-460f-9330-fce9fc700ef5 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:26.674518 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-db818547-f4d2-4e3f-89c5-594a37c6ec38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a36cb8aa18e4bba961047fee4188a5b'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:26.682471 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-db818547-f4d2-4e3f-89c5-594a37c6ec38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a36cb8aa18e4bba961047fee4188a5b'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:26.683165 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-db818547-f4d2-4e3f-89c5-594a37c6ec38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a36cb8aa18e4bba961047fee4188a5b'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:26.683767 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-db818547-f4d2-4e3f-89c5-594a37c6ec38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a36cb8aa18e4bba961047fee4188a5b'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:26.752446 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 965/1918] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Oct 4 12:02:26 2022] POST /identity/v3/projects => generated 371 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:02:26.752446 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd74cb34-1e5b-460f-9330-fce9fc700ef5 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:26.752446 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-bd74cb34-1e5b-460f-9330-fce9fc700ef5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:26.791504 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd74cb34-1e5b-460f-9330-fce9fc700ef5 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:26.796480 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc81a2e0-64d3-4580-863d-67d50e662854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:26.797117 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc81a2e0-64d3-4580-863d-67d50e662854 admin admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:26.797399 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc81a2e0-64d3-4580-863d-67d50e662854 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:26.797675 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc81a2e0-64d3-4580-863d-67d50e662854 admin admin] PATH_INFO: `/v3/users` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:26.798333 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc81a2e0-64d3-4580-863d-67d50e662854 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:26.800265 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc81a2e0-64d3-4580-863d-67d50e662854 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:27.027393 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-db818547-f4d2-4e3f-89c5-594a37c6ec38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a36cb8aa18e4bba961047fee4188a5b'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:27.037697 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 966/1919] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Oct 4 12:02:26 2022] POST /identity/v3/users => generated 292 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:02:27.042009 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc81a2e0-64d3-4580-863d-67d50e662854 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:27.053241 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc81a2e0-64d3-4580-863d-67d50e662854 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:27.058220 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09354ad9-2363-4b6c-9add-324289161f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:27.058848 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09354ad9-2363-4b6c-9add-324289161f73 admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:27.059167 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09354ad9-2363-4b6c-9add-324289161f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:27.059397 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09354ad9-2363-4b6c-9add-324289161f73 admin admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:27.060050 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09354ad9-2363-4b6c-9add-324289161f73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:27.061702 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09354ad9-2363-4b6c-9add-324289161f73 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:27.073128 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 954/1920] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Oct 4 12:02:26 2022] DELETE /identity/v3/users/4a36cb8aa18e4bba961047fee4188a5b => generated 0 bytes in 977 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:02:27.074862 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24282c50-ab44-4e81-a96c-324e202a508b None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:27.075221 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24282c50-ab44-4e81-a96c-324e202a508b None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:27.076445 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 967/1921] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:02:27 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 12:02:27.076812 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24282c50-ab44-4e81-a96c-324e202a508b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:27.077356 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09354ad9-2363-4b6c-9add-324289161f73 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:27.087961 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09354ad9-2363-4b6c-9add-324289161f73 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:27.100911 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-24282c50-ab44-4e81-a96c-324e202a508b None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:02:27.105485 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-24282c50-ab44-4e81-a96c-324e202a508b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:27.158868 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdca93b-c37b-4e7b-91f1-65fa82f47558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:27.159542 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdca93b-c37b-4e7b-91f1-65fa82f47558 admin admin] REQUEST_METHOD: `PUT` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:27.160351 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdca93b-c37b-4e7b-91f1-65fa82f47558 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:27.160836 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdca93b-c37b-4e7b-91f1-65fa82f47558 admin admin] PATH_INFO: `/v3/projects/08b1a97d2ba640d48ad46cc8ce005a80/users/a120ff91fbf9410c98c5b9fa566704f2/roles/d6e7421d1ff9451c808004b818354550` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:27.175522 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 955/1922] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:02:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:02:27.181393 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdca93b-c37b-4e7b-91f1-65fa82f47558 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08b1a97d2ba640d48ad46cc8ce005a80, user_id=a120ff91fbf9410c98c5b9fa566704f2, role_id=d6e7421d1ff9451c808004b818354550)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:27.184752 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdca93b-c37b-4e7b-91f1-65fa82f47558 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:27.185580 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24282c50-ab44-4e81-a96c-324e202a508b None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:27.187011 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-24282c50-ab44-4e81-a96c-324e202a508b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:27.248808 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24282c50-ab44-4e81-a96c-324e202a508b None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:27.252543 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f745477-16fa-430b-991d-2b6d417aacfe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7289515c5c44914a19daa439de98cb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:27.253193 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f745477-16fa-430b-991d-2b6d417aacfe service neutron] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:27.253473 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f745477-16fa-430b-991d-2b6d417aacfe service neutron] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:27.254480 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f745477-16fa-430b-991d-2b6d417aacfe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:27.264756 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f745477-16fa-430b-991d-2b6d417aacfe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:27.266186 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f745477-16fa-430b-991d-2b6d417aacfe service neutron] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:27.280683 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 956/1923] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:02:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 12:02:27.332166 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 968/1924] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Oct 4 12:02:27 2022] PUT /identity/v3/projects/08b1a97d2ba640d48ad46cc8ce005a80/users/a120ff91fbf9410c98c5b9fa566704f2/roles/d6e7421d1ff9451c808004b818354550 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:02:27.339028 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f745477-16fa-430b-991d-2b6d417aacfe service neutron] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:27.362714 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f745477-16fa-430b-991d-2b6d417aacfe service neutron] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:27.436969 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c4a68d-87c8-4772-a22b-c8c7724006c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:27.440835 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c4a68d-87c8-4772-a22b-c8c7724006c6 admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:27.440835 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c4a68d-87c8-4772-a22b-c8c7724006c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:27.440835 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c4a68d-87c8-4772-a22b-c8c7724006c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:27.440835 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c4a68d-87c8-4772-a22b-c8c7724006c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:27.440835 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c4a68d-87c8-4772-a22b-c8c7724006c6 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:27.452494 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 957/1925] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:02:27 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:02:27.457128 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdca93b-c37b-4e7b-91f1-65fa82f47558 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:27.468022 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdca93b-c37b-4e7b-91f1-65fa82f47558 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:27.472562 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e096220-c7d5-42f8-868a-a5990105f9d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:27.475348 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e096220-c7d5-42f8-868a-a5990105f9d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:27.475348 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e096220-c7d5-42f8-868a-a5990105f9d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:27.475348 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e096220-c7d5-42f8-868a-a5990105f9d1 admin admin] PATH_INFO: `/v3/projects/08b1a97d2ba640d48ad46cc8ce005a80/users/a120ff91fbf9410c98c5b9fa566704f2/roles/d6e7421d1ff9451c808004b818354550` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:27.475877 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e096220-c7d5-42f8-868a-a5990105f9d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08b1a97d2ba640d48ad46cc8ce005a80, user_id=a120ff91fbf9410c98c5b9fa566704f2, role_id=d6e7421d1ff9451c808004b818354550)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:27.478523 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e096220-c7d5-42f8-868a-a5990105f9d1 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:27.489824 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 969/1926] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Oct 4 12:02:27 2022] PUT /identity/v3/projects/08b1a97d2ba640d48ad46cc8ce005a80/users/a120ff91fbf9410c98c5b9fa566704f2/roles/d6e7421d1ff9451c808004b818354550 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:02:27.832714 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c4a68d-87c8-4772-a22b-c8c7724006c6 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:27.834785 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-20c4a68d-87c8-4772-a22b-c8c7724006c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:27.854953 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c4a68d-87c8-4772-a22b-c8c7724006c6 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:27.934606 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46cba51-a848-4747-9b1f-da5504da5429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:27.934606 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46cba51-a848-4747-9b1f-da5504da5429 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:27.934606 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46cba51-a848-4747-9b1f-da5504da5429 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:27.934606 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46cba51-a848-4747-9b1f-da5504da5429 admin admin] PATH_INFO: `/v3/projects/7e1fd5a40cb34e5fbf2b6d4d3a71c544` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:27.935594 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46cba51-a848-4747-9b1f-da5504da5429 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e1fd5a40cb34e5fbf2b6d4d3a71c544)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:27.937537 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46cba51-a848-4747-9b1f-da5504da5429 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:28.135738 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-e46cba51-a848-4747-9b1f-da5504da5429 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e1fd5a40cb34e5fbf2b6d4d3a71c544', 'request_id': 'req-e46cba51-a848-4747-9b1f-da5504da5429'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:28.144084 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-e46cba51-a848-4747-9b1f-da5504da5429 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e1fd5a40cb34e5fbf2b6d4d3a71c544', 'request_id': 'req-e46cba51-a848-4747-9b1f-da5504da5429'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:28.295881 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-e46cba51-a848-4747-9b1f-da5504da5429 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e1fd5a40cb34e5fbf2b6d4d3a71c544', 'request_id': 'req-e46cba51-a848-4747-9b1f-da5504da5429'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:28.309018 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-e46cba51-a848-4747-9b1f-da5504da5429 admin admin] The token cache is being invalidate because project 7e1fd5a40cb34e5fbf2b6d4d3a71c544 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:02:28.309383 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-e46cba51-a848-4747-9b1f-da5504da5429 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:28.310103 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-e46cba51-a848-4747-9b1f-da5504da5429 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:28.314836 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 958/1927] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Oct 4 12:02:27 2022] DELETE /identity/v3/projects/7e1fd5a40cb34e5fbf2b6d4d3a71c544 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:02:28.315899 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e096220-c7d5-42f8-868a-a5990105f9d1 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:28.317990 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-6e096220-c7d5-42f8-868a-a5990105f9d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:28.331252 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e096220-c7d5-42f8-868a-a5990105f9d1 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:28.408061 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5be956-4d66-4c74-a7b2-3ca2f99ec626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:28.409028 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5be956-4d66-4c74-a7b2-3ca2f99ec626 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:28.409427 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5be956-4d66-4c74-a7b2-3ca2f99ec626 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:28.409774 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5be956-4d66-4c74-a7b2-3ca2f99ec626 admin admin] PATH_INFO: `/v3/users/5929de891c694ab9bf3252acd0159cb2` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:28.410991 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5be956-4d66-4c74-a7b2-3ca2f99ec626 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5929de891c694ab9bf3252acd0159cb2)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:28.412954 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5be956-4d66-4c74-a7b2-3ca2f99ec626 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:28.622201 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:02:28.724210 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:02:28.727904 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-3f5be956-4d66-4c74-a7b2-3ca2f99ec626 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5929de891c694ab9bf3252acd0159cb2'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:28.735926 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-3f5be956-4d66-4c74-a7b2-3ca2f99ec626 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5929de891c694ab9bf3252acd0159cb2'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:28.736878 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-3f5be956-4d66-4c74-a7b2-3ca2f99ec626 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5929de891c694ab9bf3252acd0159cb2'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:28.737489 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-3f5be956-4d66-4c74-a7b2-3ca2f99ec626 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5929de891c694ab9bf3252acd0159cb2'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:28.827222 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-3f5be956-4d66-4c74-a7b2-3ca2f99ec626 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5929de891c694ab9bf3252acd0159cb2'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:28.849817 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 970/1928] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Oct 4 12:02:28 2022] DELETE /identity/v3/users/5929de891c694ab9bf3252acd0159cb2 => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:02:29.204180 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46cba51-a848-4747-9b1f-da5504da5429 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:29.205777 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-e46cba51-a848-4747-9b1f-da5504da5429 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:29.232970 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46cba51-a848-4747-9b1f-da5504da5429 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:29.349839 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7244ff5f-d82d-44ef-b4af-19537d8a0ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:29.355816 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7244ff5f-d82d-44ef-b4af-19537d8a0ca4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:29.355816 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7244ff5f-d82d-44ef-b4af-19537d8a0ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:29.355816 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7244ff5f-d82d-44ef-b4af-19537d8a0ca4 admin admin] PATH_INFO: `/v3/users/7e7f38d9013b4d379d7a1a6bf6147f24` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:29.355816 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7244ff5f-d82d-44ef-b4af-19537d8a0ca4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e7f38d9013b4d379d7a1a6bf6147f24)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:29.357483 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7244ff5f-d82d-44ef-b4af-19537d8a0ca4 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:29.727416 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5be956-4d66-4c74-a7b2-3ca2f99ec626 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:29.731459 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-3f5be956-4d66-4c74-a7b2-3ca2f99ec626 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:29.750345 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5be956-4d66-4c74-a7b2-3ca2f99ec626 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:29.756010 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb226158-26c8-4f7d-8175-c908014c3063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:29.756856 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb226158-26c8-4f7d-8175-c908014c3063 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:29.757322 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb226158-26c8-4f7d-8175-c908014c3063 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:29.757787 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb226158-26c8-4f7d-8175-c908014c3063 admin admin] PATH_INFO: `/v3/projects/01dffde7e90a4b338ce82db3aca6e962` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:29.759788 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb226158-26c8-4f7d-8175-c908014c3063 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01dffde7e90a4b338ce82db3aca6e962)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:29.763448 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb226158-26c8-4f7d-8175-c908014c3063 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:29.800042 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-7244ff5f-d82d-44ef-b4af-19537d8a0ca4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e7f38d9013b4d379d7a1a6bf6147f24'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:29.810203 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-7244ff5f-d82d-44ef-b4af-19537d8a0ca4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e7f38d9013b4d379d7a1a6bf6147f24'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:29.811666 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-7244ff5f-d82d-44ef-b4af-19537d8a0ca4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e7f38d9013b4d379d7a1a6bf6147f24'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:29.812474 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-7244ff5f-d82d-44ef-b4af-19537d8a0ca4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e7f38d9013b4d379d7a1a6bf6147f24'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:29.953929 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-7244ff5f-d82d-44ef-b4af-19537d8a0ca4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e7f38d9013b4d379d7a1a6bf6147f24'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:29.999012 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 959/1929] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Oct 4 12:02:29 2022] DELETE /identity/v3/users/7e7f38d9013b4d379d7a1a6bf6147f24 => generated 0 bytes in 792 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:02:30.003162 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44138714-07c3-498d-868e-f63b3b93c739 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:30.004353 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44138714-07c3-498d-868e-f63b3b93c739 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:30.004810 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44138714-07c3-498d-868e-f63b3b93c739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:30.006708 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-bb226158-26c8-4f7d-8175-c908014c3063 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01dffde7e90a4b338ce82db3aca6e962', 'request_id': 'req-bb226158-26c8-4f7d-8175-c908014c3063'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:30.032020 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-44138714-07c3-498d-868e-f63b3b93c739 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:02:30.033571 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-44138714-07c3-498d-868e-f63b3b93c739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:30.142582 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 960/1930] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:02:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:02:30.153623 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44138714-07c3-498d-868e-f63b3b93c739 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:30.155364 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-44138714-07c3-498d-868e-f63b3b93c739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:30.158650 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-bb226158-26c8-4f7d-8175-c908014c3063 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01dffde7e90a4b338ce82db3aca6e962', 'request_id': 'req-bb226158-26c8-4f7d-8175-c908014c3063'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:30.170028 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-bb226158-26c8-4f7d-8175-c908014c3063 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01dffde7e90a4b338ce82db3aca6e962', 'request_id': 'req-bb226158-26c8-4f7d-8175-c908014c3063'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:30.187774 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-bb226158-26c8-4f7d-8175-c908014c3063 admin admin] The token cache is being invalidate because project 01dffde7e90a4b338ce82db3aca6e962 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:02:30.188309 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-bb226158-26c8-4f7d-8175-c908014c3063 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:30.189211 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-bb226158-26c8-4f7d-8175-c908014c3063 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:30.191793 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 971/1931] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Oct 4 12:02:29 2022] DELETE /identity/v3/projects/01dffde7e90a4b338ce82db3aca6e962 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:02:30.195858 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb226158-26c8-4f7d-8175-c908014c3063 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:30.197756 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-bb226158-26c8-4f7d-8175-c908014c3063 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:30.232137 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44138714-07c3-498d-868e-f63b3b93c739 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:30.237175 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d415df-49a9-4d32-b746-a1f362d5d88f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7289515c5c44914a19daa439de98cb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:30.238011 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d415df-49a9-4d32-b746-a1f362d5d88f service neutron] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:30.238597 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d415df-49a9-4d32-b746-a1f362d5d88f service neutron] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:30.239006 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d415df-49a9-4d32-b746-a1f362d5d88f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:30.241442 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-84d415df-49a9-4d32-b746-a1f362d5d88f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:30.256536 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d415df-49a9-4d32-b746-a1f362d5d88f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:30.258225 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d415df-49a9-4d32-b746-a1f362d5d88f service neutron] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:30.271829 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 961/1932] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:02:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 12:02:30.290163 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb226158-26c8-4f7d-8175-c908014c3063 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:30.298178 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97636097-1408-454d-a22a-9663efd904b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:30.299627 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97636097-1408-454d-a22a-9663efd904b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:30.300073 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97636097-1408-454d-a22a-9663efd904b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:30.300942 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97636097-1408-454d-a22a-9663efd904b7 admin admin] PATH_INFO: `/v3/users/d05cbe8f670d4c4392cb2fa545ee9875` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:30.303266 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97636097-1408-454d-a22a-9663efd904b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d05cbe8f670d4c4392cb2fa545ee9875)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:30.305823 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97636097-1408-454d-a22a-9663efd904b7 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:30.690876 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-97636097-1408-454d-a22a-9663efd904b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd05cbe8f670d4c4392cb2fa545ee9875'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:30.711471 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-97636097-1408-454d-a22a-9663efd904b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd05cbe8f670d4c4392cb2fa545ee9875'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:30.712224 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-97636097-1408-454d-a22a-9663efd904b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd05cbe8f670d4c4392cb2fa545ee9875'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:30.712999 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-97636097-1408-454d-a22a-9663efd904b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd05cbe8f670d4c4392cb2fa545ee9875'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:30.866586 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-97636097-1408-454d-a22a-9663efd904b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd05cbe8f670d4c4392cb2fa545ee9875'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:30.900564 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 972/1933] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Oct 4 12:02:30 2022] DELETE /identity/v3/users/d05cbe8f670d4c4392cb2fa545ee9875 => generated 0 bytes in 705 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:02:31.094192 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d415df-49a9-4d32-b746-a1f362d5d88f service neutron] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:31.096082 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-84d415df-49a9-4d32-b746-a1f362d5d88f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:31.116639 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d415df-49a9-4d32-b746-a1f362d5d88f service neutron] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:31.320687 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2178b2-f3c5-44c8-bf07-383f468dd33a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:31.333476 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2178b2-f3c5-44c8-bf07-383f468dd33a admin admin] REQUEST_METHOD: `DELETE` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:31.338656 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2178b2-f3c5-44c8-bf07-383f468dd33a admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:31.338995 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2178b2-f3c5-44c8-bf07-383f468dd33a admin admin] PATH_INFO: `/v3/projects/abede9f1a0314f26b44d46f9681962d7` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:31.343387 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2178b2-f3c5-44c8-bf07-383f468dd33a admin admin] RBAC: Authorizing `identity:delete_project(project_id=abede9f1a0314f26b44d46f9681962d7)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:31.345482 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2178b2-f3c5-44c8-bf07-383f468dd33a admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:31.610942 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:02:31.640418 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-4f2178b2-f3c5-44c8-bf07-383f468dd33a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abede9f1a0314f26b44d46f9681962d7', 'request_id': 'req-4f2178b2-f3c5-44c8-bf07-383f468dd33a'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:31.664429 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-4f2178b2-f3c5-44c8-bf07-383f468dd33a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abede9f1a0314f26b44d46f9681962d7', 'request_id': 'req-4f2178b2-f3c5-44c8-bf07-383f468dd33a'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:31.775837 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-4f2178b2-f3c5-44c8-bf07-383f468dd33a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abede9f1a0314f26b44d46f9681962d7', 'request_id': 'req-4f2178b2-f3c5-44c8-bf07-383f468dd33a'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:31.803157 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-4f2178b2-f3c5-44c8-bf07-383f468dd33a admin admin] The token cache is being invalidate because project abede9f1a0314f26b44d46f9681962d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:02:31.803754 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-4f2178b2-f3c5-44c8-bf07-383f468dd33a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:31.806454 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-4f2178b2-f3c5-44c8-bf07-383f468dd33a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:31.814205 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97636097-1408-454d-a22a-9663efd904b7 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:31.814969 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 962/1934] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Oct 4 12:02:31 2022] DELETE /identity/v3/projects/abede9f1a0314f26b44d46f9681962d7 => generated 0 bytes in 715 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:02:31.817223 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-97636097-1408-454d-a22a-9663efd904b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:31.853906 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97636097-1408-454d-a22a-9663efd904b7 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:31.992218 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aed2ce-e312-49c7-b350-792cc632c641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:31.993321 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aed2ce-e312-49c7-b350-792cc632c641 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:31.993876 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aed2ce-e312-49c7-b350-792cc632c641 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:31.994353 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aed2ce-e312-49c7-b350-792cc632c641 admin admin] PATH_INFO: `/v3/users/d5a0c471a64b490db505ae0a6b45cf97` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:31.995793 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79aed2ce-e312-49c7-b350-792cc632c641 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5a0c471a64b490db505ae0a6b45cf97)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:31.998412 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79aed2ce-e312-49c7-b350-792cc632c641 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:32.396377 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2178b2-f3c5-44c8-bf07-383f468dd33a admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:32.398083 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-4f2178b2-f3c5-44c8-bf07-383f468dd33a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:32.414938 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2178b2-f3c5-44c8-bf07-383f468dd33a admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:32.424540 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521fc349-8e4a-43b5-89f2-c5e65b078661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:32.427186 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521fc349-8e4a-43b5-89f2-c5e65b078661 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:32.427473 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521fc349-8e4a-43b5-89f2-c5e65b078661 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:32.427744 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521fc349-8e4a-43b5-89f2-c5e65b078661 admin admin] PATH_INFO: `/v3/projects/a77eb4e4efc64c5cb3fab90f0c27e09c` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:32.429966 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521fc349-8e4a-43b5-89f2-c5e65b078661 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a77eb4e4efc64c5cb3fab90f0c27e09c)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:32.434596 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521fc349-8e4a-43b5-89f2-c5e65b078661 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:32.459818 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-79aed2ce-e312-49c7-b350-792cc632c641 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5a0c471a64b490db505ae0a6b45cf97'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:32.487904 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-79aed2ce-e312-49c7-b350-792cc632c641 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5a0c471a64b490db505ae0a6b45cf97'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:32.489421 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-79aed2ce-e312-49c7-b350-792cc632c641 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5a0c471a64b490db505ae0a6b45cf97'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:32.493069 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-79aed2ce-e312-49c7-b350-792cc632c641 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5a0c471a64b490db505ae0a6b45cf97'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:32.581109 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-79aed2ce-e312-49c7-b350-792cc632c641 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5a0c471a64b490db505ae0a6b45cf97'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:32.619515 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-521fc349-8e4a-43b5-89f2-c5e65b078661 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a77eb4e4efc64c5cb3fab90f0c27e09c', 'request_id': 'req-521fc349-8e4a-43b5-89f2-c5e65b078661'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:32.626579 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 973/1935] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Oct 4 12:02:31 2022] DELETE /identity/v3/users/d5a0c471a64b490db505ae0a6b45cf97 => generated 0 bytes in 813 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:02:32.640675 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-521fc349-8e4a-43b5-89f2-c5e65b078661 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a77eb4e4efc64c5cb3fab90f0c27e09c', 'request_id': 'req-521fc349-8e4a-43b5-89f2-c5e65b078661'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:32.770704 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-521fc349-8e4a-43b5-89f2-c5e65b078661 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a77eb4e4efc64c5cb3fab90f0c27e09c', 'request_id': 'req-521fc349-8e4a-43b5-89f2-c5e65b078661'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:32.793777 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-521fc349-8e4a-43b5-89f2-c5e65b078661 admin admin] The token cache is being invalidate because project a77eb4e4efc64c5cb3fab90f0c27e09c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:02:32.796141 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-521fc349-8e4a-43b5-89f2-c5e65b078661 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:32.809093 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-521fc349-8e4a-43b5-89f2-c5e65b078661 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:32.816703 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 963/1936] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Oct 4 12:02:32 2022] DELETE /identity/v3/projects/a77eb4e4efc64c5cb3fab90f0c27e09c => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:02:32.822500 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02226a1-9b5e-4221-9e42-57c06a38eb5a None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:32.822779 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02226a1-9b5e-4221-9e42-57c06a38eb5a None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:32.823214 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02226a1-9b5e-4221-9e42-57c06a38eb5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:32.872247 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-f02226a1-9b5e-4221-9e42-57c06a38eb5a None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:02:32.886842 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-f02226a1-9b5e-4221-9e42-57c06a38eb5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:33.026960 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 974/1937] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:02:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:02:33.036914 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ad8cac-394c-43ca-afa0-82b78a169d8a None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:33.037595 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ad8cac-394c-43ca-afa0-82b78a169d8a None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:33.038191 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ad8cac-394c-43ca-afa0-82b78a169d8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:33.071544 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-54ad8cac-394c-43ca-afa0-82b78a169d8a None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:02:33.073146 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-54ad8cac-394c-43ca-afa0-82b78a169d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:33.091239 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 964/1938] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:02:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 12:02:33.092152 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02226a1-9b5e-4221-9e42-57c06a38eb5a None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:33.108083 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02226a1-9b5e-4221-9e42-57c06a38eb5a None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:33.117967 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09bd941-61ff-451f-8874-6fb0e5be75d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:33.118921 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09bd941-61ff-451f-8874-6fb0e5be75d3 admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:33.120951 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09bd941-61ff-451f-8874-6fb0e5be75d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:33.121436 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09bd941-61ff-451f-8874-6fb0e5be75d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:33.122447 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09bd941-61ff-451f-8874-6fb0e5be75d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:02:33.130909 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09bd941-61ff-451f-8874-6fb0e5be75d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:33.130909 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09bd941-61ff-451f-8874-6fb0e5be75d3 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:33.146467 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 975/1939] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Oct 4 12:02:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:02:33.152147 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ad8cac-394c-43ca-afa0-82b78a169d8a None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:33.166564 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ad8cac-394c-43ca-afa0-82b78a169d8a None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:33.171942 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d86f948-e98b-4841-bec6-a9e41b056482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:33.173371 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d86f948-e98b-4841-bec6-a9e41b056482 admin admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:33.173987 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d86f948-e98b-4841-bec6-a9e41b056482 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:33.174485 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d86f948-e98b-4841-bec6-a9e41b056482 admin admin] PATH_INFO: `/v3/projects` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:33.176159 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d86f948-e98b-4841-bec6-a9e41b056482 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:33.179183 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d86f948-e98b-4841-bec6-a9e41b056482 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:33.292159 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:02:33.363257 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 965/1940] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Oct 4 12:02:33 2022] POST /identity/v3/projects => generated 401 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:02:33.367529 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09bd941-61ff-451f-8874-6fb0e5be75d3 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:33.380524 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09bd941-61ff-451f-8874-6fb0e5be75d3 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:33.492706 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c536272b-c411-4b8b-b876-aa26f7dec34d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:33.493347 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c536272b-c411-4b8b-b876-aa26f7dec34d admin admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:33.493604 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c536272b-c411-4b8b-b876-aa26f7dec34d admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:33.493875 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c536272b-c411-4b8b-b876-aa26f7dec34d admin admin] PATH_INFO: `/v3/users` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:33.494656 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c536272b-c411-4b8b-b876-aa26f7dec34d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:33.496706 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c536272b-c411-4b8b-b876-aa26f7dec34d admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:33.517096 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d86f948-e98b-4841-bec6-a9e41b056482 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:33.520520 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-8d86f948-e98b-4841-bec6-a9e41b056482 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:33.548281 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d86f948-e98b-4841-bec6-a9e41b056482 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:33.559070 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae3ad98-484a-4627-bc65-728aa76e2105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:33.559896 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae3ad98-484a-4627-bc65-728aa76e2105 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:33.560162 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae3ad98-484a-4627-bc65-728aa76e2105 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:33.560515 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae3ad98-484a-4627-bc65-728aa76e2105 admin admin] PATH_INFO: `/v3/projects/0e4ac3f998b44ccdac7ac4bca53553f8` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:33.565550 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae3ad98-484a-4627-bc65-728aa76e2105 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e4ac3f998b44ccdac7ac4bca53553f8)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:33.568511 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae3ad98-484a-4627-bc65-728aa76e2105 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:33.608635 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 976/1941] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Oct 4 12:02:33 2022] POST /identity/v3/users => generated 301 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:02:33.619372 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c536272b-c411-4b8b-b876-aa26f7dec34d admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:33.630311 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c536272b-c411-4b8b-b876-aa26f7dec34d admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:33.635988 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4efb6f7-755b-4e3f-b63d-33616715aba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:33.636882 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4efb6f7-755b-4e3f-b63d-33616715aba5 admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:33.637255 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4efb6f7-755b-4e3f-b63d-33616715aba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:33.637526 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4efb6f7-755b-4e3f-b63d-33616715aba5 admin admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:33.638600 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4efb6f7-755b-4e3f-b63d-33616715aba5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:33.642659 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4efb6f7-755b-4e3f-b63d-33616715aba5 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:33.659605 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 977/1942] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:02:33 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 12:02:33.663665 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4efb6f7-755b-4e3f-b63d-33616715aba5 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:33.678128 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4efb6f7-755b-4e3f-b63d-33616715aba5 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:33.685691 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3554e5b-6e17-4487-af0d-f2c1b9149119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:33.685691 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3554e5b-6e17-4487-af0d-f2c1b9149119 admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:33.686996 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3554e5b-6e17-4487-af0d-f2c1b9149119 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:33.686996 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3554e5b-6e17-4487-af0d-f2c1b9149119 admin admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:33.687849 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3554e5b-6e17-4487-af0d-f2c1b9149119 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:33.689778 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3554e5b-6e17-4487-af0d-f2c1b9149119 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:33.703684 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 978/1943] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:02:33 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 12:02:33.708656 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3554e5b-6e17-4487-af0d-f2c1b9149119 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:33.729947 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3554e5b-6e17-4487-af0d-f2c1b9149119 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:33.737351 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7f43b0-47ff-4241-9ec8-55b2e11dbb78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:33.739785 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7f43b0-47ff-4241-9ec8-55b2e11dbb78 admin admin] REQUEST_METHOD: `PUT` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:33.740482 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7f43b0-47ff-4241-9ec8-55b2e11dbb78 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:33.740883 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7f43b0-47ff-4241-9ec8-55b2e11dbb78 admin admin] PATH_INFO: `/v3/projects/96faf7a690ef4f60aeefbb28b0c9e7ec/users/60b7654a75bb4ae8a9fb256d4034bf67/roles/ab4307f3b7994c1c80036fa7db93b6b9` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:33.786425 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7f43b0-47ff-4241-9ec8-55b2e11dbb78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96faf7a690ef4f60aeefbb28b0c9e7ec, user_id=60b7654a75bb4ae8a9fb256d4034bf67, role_id=ab4307f3b7994c1c80036fa7db93b6b9)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:33.798301 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7f43b0-47ff-4241-9ec8-55b2e11dbb78 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:33.815053 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-2ae3ad98-484a-4627-bc65-728aa76e2105 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e4ac3f998b44ccdac7ac4bca53553f8', 'request_id': 'req-2ae3ad98-484a-4627-bc65-728aa76e2105'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:33.826433 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-2ae3ad98-484a-4627-bc65-728aa76e2105 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e4ac3f998b44ccdac7ac4bca53553f8', 'request_id': 'req-2ae3ad98-484a-4627-bc65-728aa76e2105'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:33.959789 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-2ae3ad98-484a-4627-bc65-728aa76e2105 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e4ac3f998b44ccdac7ac4bca53553f8', 'request_id': 'req-2ae3ad98-484a-4627-bc65-728aa76e2105'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:33.991168 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-2ae3ad98-484a-4627-bc65-728aa76e2105 admin admin] The token cache is being invalidate because project 0e4ac3f998b44ccdac7ac4bca53553f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:02:33.993270 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-2ae3ad98-484a-4627-bc65-728aa76e2105 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:33.994192 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 979/1944] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Oct 4 12:02:33 2022] PUT /identity/v3/projects/96faf7a690ef4f60aeefbb28b0c9e7ec/users/60b7654a75bb4ae8a9fb256d4034bf67/roles/ab4307f3b7994c1c80036fa7db93b6b9 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:02:34.009102 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-2ae3ad98-484a-4627-bc65-728aa76e2105 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:34.009555 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bee8c49-76d1-4547-bb2b-592b1904b76c None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:34.013292 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bee8c49-76d1-4547-bb2b-592b1904b76c None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:34.013292 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bee8c49-76d1-4547-bb2b-592b1904b76c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:34.017373 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 966/1945] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Oct 4 12:02:33 2022] DELETE /identity/v3/projects/0e4ac3f998b44ccdac7ac4bca53553f8 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:02:34.023277 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9a3d48-b566-4766-9ce4-3cb80ae0357f None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:34.024004 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9a3d48-b566-4766-9ce4-3cb80ae0357f None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:34.025664 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9a3d48-b566-4766-9ce4-3cb80ae0357f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:34.074934 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-bb9a3d48-b566-4766-9ce4-3cb80ae0357f None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:02:34.076097 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-bb9a3d48-b566-4766-9ce4-3cb80ae0357f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:34.098028 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-6bee8c49-76d1-4547-bb2b-592b1904b76c None None] MFA Rules not processed for user `60b7654a75bb4ae8a9fb256d4034bf67`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:02:34.099171 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-6bee8c49-76d1-4547-bb2b-592b1904b76c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:34.261091 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 967/1946] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:02:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:02:34.270618 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df63686d-ddbe-4ee8-9304-579bb3110f64 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:34.271539 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df63686d-ddbe-4ee8-9304-579bb3110f64 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:34.272369 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df63686d-ddbe-4ee8-9304-579bb3110f64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:34.291811 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 980/1947] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:02:34 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:02:34.294113 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bee8c49-76d1-4547-bb2b-592b1904b76c None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:34.301257 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-6bee8c49-76d1-4547-bb2b-592b1904b76c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:34.316278 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bee8c49-76d1-4547-bb2b-592b1904b76c None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:34.326369 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-df63686d-ddbe-4ee8-9304-579bb3110f64 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:02:34.328331 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-df63686d-ddbe-4ee8-9304-579bb3110f64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:34.332130 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64725b41-f682-4b1c-b9d3-078846dac84b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:34.333313 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64725b41-f682-4b1c-b9d3-078846dac84b admin admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:34.334684 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64725b41-f682-4b1c-b9d3-078846dac84b admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:34.335261 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64725b41-f682-4b1c-b9d3-078846dac84b admin admin] PATH_INFO: `/v3/projects` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:34.337583 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64725b41-f682-4b1c-b9d3-078846dac84b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:34.340095 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64725b41-f682-4b1c-b9d3-078846dac84b admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:34.340226 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 968/1948] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:02:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 12:02:34.347852 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df63686d-ddbe-4ee8-9304-579bb3110f64 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:34.366250 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df63686d-ddbe-4ee8-9304-579bb3110f64 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:34.372742 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19f1676-aef4-4a6a-8353-c028f62b63c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:34.373536 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19f1676-aef4-4a6a-8353-c028f62b63c8 admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:34.373986 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19f1676-aef4-4a6a-8353-c028f62b63c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:34.374340 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19f1676-aef4-4a6a-8353-c028f62b63c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:34.375230 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19f1676-aef4-4a6a-8353-c028f62b63c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:02:34.376133 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19f1676-aef4-4a6a-8353-c028f62b63c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:34.378042 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19f1676-aef4-4a6a-8353-c028f62b63c8 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:34.397495 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 969/1949] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Oct 4 12:02:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 12:02:34.403315 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19f1676-aef4-4a6a-8353-c028f62b63c8 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:34.453307 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19f1676-aef4-4a6a-8353-c028f62b63c8 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:34.475821 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc45701-5fc7-495f-b994-06b1747e45cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:34.476463 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc45701-5fc7-495f-b994-06b1747e45cc admin admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:34.476775 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc45701-5fc7-495f-b994-06b1747e45cc admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:34.477054 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc45701-5fc7-495f-b994-06b1747e45cc admin admin] PATH_INFO: `/v3/projects` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:34.477699 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc45701-5fc7-495f-b994-06b1747e45cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:34.479618 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc45701-5fc7-495f-b994-06b1747e45cc admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:34.506229 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 981/1950] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Oct 4 12:02:34 2022] POST /identity/v3/projects => generated 399 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 12:02:34.510331 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64725b41-f682-4b1c-b9d3-078846dac84b admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:34.596893 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64725b41-f682-4b1c-b9d3-078846dac84b admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:34.602481 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fdc74b-1eed-44e3-931c-3ee2a62e6106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:34.603104 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fdc74b-1eed-44e3-931c-3ee2a62e6106 admin admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:34.603387 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fdc74b-1eed-44e3-931c-3ee2a62e6106 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:34.603672 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fdc74b-1eed-44e3-931c-3ee2a62e6106 admin admin] PATH_INFO: `/v3/users` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:34.625355 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fdc74b-1eed-44e3-931c-3ee2a62e6106 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:34.625355 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fdc74b-1eed-44e3-931c-3ee2a62e6106 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:34.625641 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 970/1951] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Oct 4 12:02:34 2022] POST /identity/v3/projects => generated 379 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:02:34.625641 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc45701-5fc7-495f-b994-06b1747e45cc admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:34.683722 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc45701-5fc7-495f-b994-06b1747e45cc admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:34.688830 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a696ab59-d464-48a2-bbdc-c09273ca9fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:34.689574 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a696ab59-d464-48a2-bbdc-c09273ca9fa0 admin admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:34.689924 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a696ab59-d464-48a2-bbdc-c09273ca9fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:34.690272 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a696ab59-d464-48a2-bbdc-c09273ca9fa0 admin admin] PATH_INFO: `/v3/users` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:34.692122 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a696ab59-d464-48a2-bbdc-c09273ca9fa0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:34.699662 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a696ab59-d464-48a2-bbdc-c09273ca9fa0 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:34.949607 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:02:34.960239 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 982/1952] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Oct 4 12:02:34 2022] POST /identity/v3/users => generated 306 bytes in 450 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 12:02:34.960743 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 971/1953] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Oct 4 12:02:34 2022] POST /identity/v3/users => generated 290 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 12:02:34.966843 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fdc74b-1eed-44e3-931c-3ee2a62e6106 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:34.966950 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a696ab59-d464-48a2-bbdc-c09273ca9fa0 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:34.991955 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fdc74b-1eed-44e3-931c-3ee2a62e6106 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:34.994599 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a696ab59-d464-48a2-bbdc-c09273ca9fa0 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:35.005090 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adbfe81-c975-4a63-bcef-7447ff76a68c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:35.009016 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4175cbdb-a749-467a-b0a4-ec869c26e7fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:35.010025 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adbfe81-c975-4a63-bcef-7447ff76a68c admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:35.010025 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adbfe81-c975-4a63-bcef-7447ff76a68c admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:35.010025 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adbfe81-c975-4a63-bcef-7447ff76a68c admin admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:35.010025 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adbfe81-c975-4a63-bcef-7447ff76a68c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:35.010331 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4175cbdb-a749-467a-b0a4-ec869c26e7fc admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:35.010331 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4175cbdb-a749-467a-b0a4-ec869c26e7fc admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:35.010331 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4175cbdb-a749-467a-b0a4-ec869c26e7fc admin admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:35.010331 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4175cbdb-a749-467a-b0a4-ec869c26e7fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:35.011915 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adbfe81-c975-4a63-bcef-7447ff76a68c admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:35.013714 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4175cbdb-a749-467a-b0a4-ec869c26e7fc admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:35.032032 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 983/1954] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:02:34 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 12:02:35.035057 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 972/1955] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:02:34 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:02:35.040077 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adbfe81-c975-4a63-bcef-7447ff76a68c admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:35.055902 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4175cbdb-a749-467a-b0a4-ec869c26e7fc admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:35.062656 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adbfe81-c975-4a63-bcef-7447ff76a68c admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:35.075063 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4175cbdb-a749-467a-b0a4-ec869c26e7fc admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:35.076379 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119003a1-8444-43f3-b05d-8b1770934dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:35.089875 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119003a1-8444-43f3-b05d-8b1770934dfd admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:35.089875 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119003a1-8444-43f3-b05d-8b1770934dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:35.089875 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119003a1-8444-43f3-b05d-8b1770934dfd admin admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:35.089875 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119003a1-8444-43f3-b05d-8b1770934dfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:35.089875 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119003a1-8444-43f3-b05d-8b1770934dfd admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:35.095978 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a61e0cb-3c00-48d8-b5ac-87cf52fe0688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:35.096700 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a61e0cb-3c00-48d8-b5ac-87cf52fe0688 admin admin] REQUEST_METHOD: `PUT` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:35.097315 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a61e0cb-3c00-48d8-b5ac-87cf52fe0688 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:35.097607 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a61e0cb-3c00-48d8-b5ac-87cf52fe0688 admin admin] PATH_INFO: `/v3/projects/821d979649064f748e03781247552ebd/users/b5a64b0786ed42f39046a6bbd9412404/roles/d6e7421d1ff9451c808004b818354550` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:35.116169 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 984/1956] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:02:35 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:02:35.121606 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119003a1-8444-43f3-b05d-8b1770934dfd admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:35.127777 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a61e0cb-3c00-48d8-b5ac-87cf52fe0688 admin admin] RBAC: Authorizing `identity:create_grant(project_id=821d979649064f748e03781247552ebd, user_id=b5a64b0786ed42f39046a6bbd9412404, role_id=d6e7421d1ff9451c808004b818354550)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:35.132092 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a61e0cb-3c00-48d8-b5ac-87cf52fe0688 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:35.147201 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119003a1-8444-43f3-b05d-8b1770934dfd admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:35.153506 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5738e8-7f2a-4c8b-95d7-b136a7026f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:35.154270 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5738e8-7f2a-4c8b-95d7-b136a7026f38 admin admin] REQUEST_METHOD: `PUT` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:35.154747 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5738e8-7f2a-4c8b-95d7-b136a7026f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:35.155167 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5738e8-7f2a-4c8b-95d7-b136a7026f38 admin admin] PATH_INFO: `/v3/projects/c0d60a643d494a2a8cdaf9c62a398204/users/5e2173fb1b3e4945a60aaceb152658f8/roles/ab4307f3b7994c1c80036fa7db93b6b9` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:35.184882 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5738e8-7f2a-4c8b-95d7-b136a7026f38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0d60a643d494a2a8cdaf9c62a398204, user_id=5e2173fb1b3e4945a60aaceb152658f8, role_id=ab4307f3b7994c1c80036fa7db93b6b9)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:35.188399 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5738e8-7f2a-4c8b-95d7-b136a7026f38 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:35.324922 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 973/1957] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Oct 4 12:02:35 2022] PUT /identity/v3/projects/821d979649064f748e03781247552ebd/users/b5a64b0786ed42f39046a6bbd9412404/roles/d6e7421d1ff9451c808004b818354550 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:02:35.328812 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a61e0cb-3c00-48d8-b5ac-87cf52fe0688 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:35.366392 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 985/1958] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Oct 4 12:02:35 2022] PUT /identity/v3/projects/c0d60a643d494a2a8cdaf9c62a398204/users/5e2173fb1b3e4945a60aaceb152658f8/roles/ab4307f3b7994c1c80036fa7db93b6b9 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:02:35.384111 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05b9a56-ccb2-4459-add6-4c72cf5bc58e None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:35.384444 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05b9a56-ccb2-4459-add6-4c72cf5bc58e None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:35.385179 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05b9a56-ccb2-4459-add6-4c72cf5bc58e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:35.419357 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-c05b9a56-ccb2-4459-add6-4c72cf5bc58e None None] MFA Rules not processed for user `5e2173fb1b3e4945a60aaceb152658f8`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:02:35.421906 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-c05b9a56-ccb2-4459-add6-4c72cf5bc58e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:35.426742 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a61e0cb-3c00-48d8-b5ac-87cf52fe0688 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:35.506882 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3416aafc-4fda-4872-9a3a-ce9f2d926650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:35.508752 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3416aafc-4fda-4872-9a3a-ce9f2d926650 admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:35.509665 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3416aafc-4fda-4872-9a3a-ce9f2d926650 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:35.510390 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3416aafc-4fda-4872-9a3a-ce9f2d926650 admin admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:35.511275 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3416aafc-4fda-4872-9a3a-ce9f2d926650 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:35.516912 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 986/1959] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:02:35 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:02:35.518083 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3416aafc-4fda-4872-9a3a-ce9f2d926650 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:35.525537 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05b9a56-ccb2-4459-add6-4c72cf5bc58e None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:35.538126 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05b9a56-ccb2-4459-add6-4c72cf5bc58e None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:35.542276 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 974/1960] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:02:35 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:02:35.553032 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776bbea8-f2e4-4876-8f12-a406c8d115b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:35.553202 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776bbea8-f2e4-4876-8f12-a406c8d115b9 admin admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:35.553577 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776bbea8-f2e4-4876-8f12-a406c8d115b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:35.553855 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776bbea8-f2e4-4876-8f12-a406c8d115b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:35.554657 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776bbea8-f2e4-4876-8f12-a406c8d115b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:35.554776 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3416aafc-4fda-4872-9a3a-ce9f2d926650 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:35.557174 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776bbea8-f2e4-4876-8f12-a406c8d115b9 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:35.571770 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3416aafc-4fda-4872-9a3a-ce9f2d926650 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:35.588442 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e11eed-de93-4e9b-95f8-2e9456d699c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:35.589566 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e11eed-de93-4e9b-95f8-2e9456d699c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:35.590047 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e11eed-de93-4e9b-95f8-2e9456d699c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:35.590599 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e11eed-de93-4e9b-95f8-2e9456d699c9 admin admin] PATH_INFO: `/v3/projects/821d979649064f748e03781247552ebd/users/b5a64b0786ed42f39046a6bbd9412404/roles/d6e7421d1ff9451c808004b818354550` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:35.592902 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e11eed-de93-4e9b-95f8-2e9456d699c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=821d979649064f748e03781247552ebd, user_id=b5a64b0786ed42f39046a6bbd9412404, role_id=d6e7421d1ff9451c808004b818354550)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:35.595990 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e11eed-de93-4e9b-95f8-2e9456d699c9 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:35.609445 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 975/1961] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Oct 4 12:02:35 2022] PUT /identity/v3/projects/821d979649064f748e03781247552ebd/users/b5a64b0786ed42f39046a6bbd9412404/roles/d6e7421d1ff9451c808004b818354550 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:02:35.622021 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afe69ab-e622-4b5c-81e9-73eddf91db97 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:35.622422 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afe69ab-e622-4b5c-81e9-73eddf91db97 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:35.625585 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afe69ab-e622-4b5c-81e9-73eddf91db97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:35.669166 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-3afe69ab-e622-4b5c-81e9-73eddf91db97 None None] MFA Rules not processed for user `b5a64b0786ed42f39046a6bbd9412404`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:02:35.670369 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-3afe69ab-e622-4b5c-81e9-73eddf91db97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:35.703751 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 987/1962] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Oct 4 12:02:35 2022] POST /identity/v3/projects => generated 377 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 12:02:35.708212 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776bbea8-f2e4-4876-8f12-a406c8d115b9 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:35.770117 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 976/1963] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:02:35 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 12:02:35.781558 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afe69ab-e622-4b5c-81e9-73eddf91db97 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:35.783532 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-3afe69ab-e622-4b5c-81e9-73eddf91db97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:35.792626 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776bbea8-f2e4-4876-8f12-a406c8d115b9 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:35.799976 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a871af-93c1-4474-98d0-8dd21abc6309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:35.801948 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a871af-93c1-4474-98d0-8dd21abc6309 admin admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:35.802388 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a871af-93c1-4474-98d0-8dd21abc6309 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:35.802840 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a871af-93c1-4474-98d0-8dd21abc6309 admin admin] PATH_INFO: `/v3/users` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:35.803676 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a871af-93c1-4474-98d0-8dd21abc6309 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:35.806919 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a871af-93c1-4474-98d0-8dd21abc6309 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:35.868589 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afe69ab-e622-4b5c-81e9-73eddf91db97 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:35.937644 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1b9a30-2601-4feb-98a3-300703a6d9b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e2a05b782424ab2928b5864f1bfd556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:35.938282 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1b9a30-2601-4feb-98a3-300703a6d9b3 service cinder] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:35.938565 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1b9a30-2601-4feb-98a3-300703a6d9b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:35.938892 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1b9a30-2601-4feb-98a3-300703a6d9b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:36.012864 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 988/1964] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Oct 4 12:02:35 2022] POST /identity/v3/users => generated 295 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:02:36.017085 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a871af-93c1-4474-98d0-8dd21abc6309 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:36.037424 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a871af-93c1-4474-98d0-8dd21abc6309 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:36.049749 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8e629a-a536-456c-b7a0-0c57e03acb3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:36.051035 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8e629a-a536-456c-b7a0-0c57e03acb3d admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:36.051413 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8e629a-a536-456c-b7a0-0c57e03acb3d admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:36.051695 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8e629a-a536-456c-b7a0-0c57e03acb3d admin admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:36.052362 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8e629a-a536-456c-b7a0-0c57e03acb3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:36.054891 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8e629a-a536-456c-b7a0-0c57e03acb3d admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:36.065783 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1b9a30-2601-4feb-98a3-300703a6d9b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:36.067484 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1b9a30-2601-4feb-98a3-300703a6d9b3 service cinder] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:36.082411 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 989/1965] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:02:36 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:02:36.084542 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 977/1966] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:02:35 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:02:36.096813 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8e629a-a536-456c-b7a0-0c57e03acb3d admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:36.122130 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8e629a-a536-456c-b7a0-0c57e03acb3d admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:36.131367 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266fc5f0-bf63-4daa-ac79-4fd2be112129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:36.132079 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266fc5f0-bf63-4daa-ac79-4fd2be112129 admin admin] REQUEST_METHOD: `PUT` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:36.132417 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266fc5f0-bf63-4daa-ac79-4fd2be112129 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:36.132626 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266fc5f0-bf63-4daa-ac79-4fd2be112129 admin admin] PATH_INFO: `/v3/projects/2fffb0c430ce48108ff76c21dfc6b67f/users/447d90a504c0488fb2def479e635c530/roles/d6e7421d1ff9451c808004b818354550` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:36.152353 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266fc5f0-bf63-4daa-ac79-4fd2be112129 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fffb0c430ce48108ff76c21dfc6b67f, user_id=447d90a504c0488fb2def479e635c530, role_id=d6e7421d1ff9451c808004b818354550)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:36.155532 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266fc5f0-bf63-4daa-ac79-4fd2be112129 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:36.339584 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 990/1967] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Oct 4 12:02:36 2022] PUT /identity/v3/projects/2fffb0c430ce48108ff76c21dfc6b67f/users/447d90a504c0488fb2def479e635c530/roles/d6e7421d1ff9451c808004b818354550 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:02:36.343477 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1b9a30-2601-4feb-98a3-300703a6d9b3 service cinder] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:36.354700 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1b9a30-2601-4feb-98a3-300703a6d9b3 service cinder] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:36.418957 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe497f4c-1839-47a8-a905-35ef46c6d504 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:36.420021 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe497f4c-1839-47a8-a905-35ef46c6d504 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:36.420695 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe497f4c-1839-47a8-a905-35ef46c6d504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:36.462237 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-fe497f4c-1839-47a8-a905-35ef46c6d504 None None] MFA Rules not processed for user `a120ff91fbf9410c98c5b9fa566704f2`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:02:36.463770 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-fe497f4c-1839-47a8-a905-35ef46c6d504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:36.466492 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e941909-151f-4273-8ca6-89f3b6d9c09b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:36.468630 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e941909-151f-4273-8ca6-89f3b6d9c09b admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:36.469087 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e941909-151f-4273-8ca6-89f3b6d9c09b admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:36.469374 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e941909-151f-4273-8ca6-89f3b6d9c09b admin admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:36.470026 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e941909-151f-4273-8ca6-89f3b6d9c09b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:36.471855 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e941909-151f-4273-8ca6-89f3b6d9c09b admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:36.485150 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 978/1968] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:02:36 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:02:36.489611 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e941909-151f-4273-8ca6-89f3b6d9c09b admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:36.512341 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e941909-151f-4273-8ca6-89f3b6d9c09b admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:36.517872 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91b6b1d-f077-404b-b308-ba6ccde168a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:36.518626 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91b6b1d-f077-404b-b308-ba6ccde168a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:36.518757 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91b6b1d-f077-404b-b308-ba6ccde168a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:36.519639 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91b6b1d-f077-404b-b308-ba6ccde168a2 admin admin] PATH_INFO: `/v3/projects/2fffb0c430ce48108ff76c21dfc6b67f/users/447d90a504c0488fb2def479e635c530/roles/d6e7421d1ff9451c808004b818354550` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:36.527279 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91b6b1d-f077-404b-b308-ba6ccde168a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fffb0c430ce48108ff76c21dfc6b67f, user_id=447d90a504c0488fb2def479e635c530, role_id=d6e7421d1ff9451c808004b818354550)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:36.527279 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91b6b1d-f077-404b-b308-ba6ccde168a2 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:36.547083 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 979/1969] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Oct 4 12:02:36 2022] PUT /identity/v3/projects/2fffb0c430ce48108ff76c21dfc6b67f/users/447d90a504c0488fb2def479e635c530/roles/d6e7421d1ff9451c808004b818354550 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:02:36.548743 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91b6b1d-f077-404b-b308-ba6ccde168a2 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:36.551367 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-b91b6b1d-f077-404b-b308-ba6ccde168a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:36.577975 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 991/1970] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:02:36 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 12:02:36.579472 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a01020-7a2d-4ffe-aede-375a8dabb900 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:36.579770 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a01020-7a2d-4ffe-aede-375a8dabb900 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:36.580149 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a01020-7a2d-4ffe-aede-375a8dabb900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:36.628307 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-70a01020-7a2d-4ffe-aede-375a8dabb900 None None] MFA Rules not processed for user `447d90a504c0488fb2def479e635c530`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:02:36.629963 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-70a01020-7a2d-4ffe-aede-375a8dabb900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:36.639248 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91b6b1d-f077-404b-b308-ba6ccde168a2 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:36.641130 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:02:36.645630 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359da4b5-37e8-4f20-ab01-51f870363497 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e2a05b782424ab2928b5864f1bfd556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:36.646344 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359da4b5-37e8-4f20-ab01-51f870363497 service cinder] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:36.646699 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359da4b5-37e8-4f20-ab01-51f870363497 service cinder] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:36.647050 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359da4b5-37e8-4f20-ab01-51f870363497 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:36.720515 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359da4b5-37e8-4f20-ab01-51f870363497 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:36.722621 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359da4b5-37e8-4f20-ab01-51f870363497 service cinder] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:36.732946 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 992/1971] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:02:36 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:02:36.732946 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a01020-7a2d-4ffe-aede-375a8dabb900 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:36.732946 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-70a01020-7a2d-4ffe-aede-375a8dabb900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:36.740297 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 980/1972] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:02:36 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:02:36.742273 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359da4b5-37e8-4f20-ab01-51f870363497 service cinder] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:36.753995 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359da4b5-37e8-4f20-ab01-51f870363497 service cinder] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:36.759674 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330874ad-7420-4462-b419-0ff4d1187e61 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e2a05b782424ab2928b5864f1bfd556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:36.761457 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330874ad-7420-4462-b419-0ff4d1187e61 service cinder] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:36.761935 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330874ad-7420-4462-b419-0ff4d1187e61 service cinder] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:36.762409 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330874ad-7420-4462-b419-0ff4d1187e61 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:36.847455 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330874ad-7420-4462-b419-0ff4d1187e61 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:36.851193 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330874ad-7420-4462-b419-0ff4d1187e61 service cinder] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:36.863452 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a01020-7a2d-4ffe-aede-375a8dabb900 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:36.864556 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 981/1973] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:02:36 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:02:36.881841 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adc397c-4aa4-4446-9f13-c7577a8759d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8e23d1d2fe24bdf9552e7c2f0ae3424', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:36.882343 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adc397c-4aa4-4446-9f13-c7577a8759d5 service nova] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:36.882614 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adc397c-4aa4-4446-9f13-c7577a8759d5 service nova] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:36.882892 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adc397c-4aa4-4446-9f13-c7577a8759d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:36.884881 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-5adc397c-4aa4-4446-9f13-c7577a8759d5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:36.953257 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adc397c-4aa4-4446-9f13-c7577a8759d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:36.955208 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adc397c-4aa4-4446-9f13-c7577a8759d5 service nova] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:36.967105 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 993/1974] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:02:36 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:02:38.825719 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330874ad-7420-4462-b419-0ff4d1187e61 service cinder] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:38.827371 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-330874ad-7420-4462-b419-0ff4d1187e61 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:38.946716 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330874ad-7420-4462-b419-0ff4d1187e61 service cinder] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:38.951553 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa22c23c-3f82-4195-b058-291922adc1e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:38.952212 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa22c23c-3f82-4195-b058-291922adc1e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:38.952497 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa22c23c-3f82-4195-b058-291922adc1e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:38.952807 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa22c23c-3f82-4195-b058-291922adc1e4 admin admin] PATH_INFO: `/v3/users/b78fc856c86a465db4d3100b3db2578a` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:38.953968 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa22c23c-3f82-4195-b058-291922adc1e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b78fc856c86a465db4d3100b3db2578a)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:38.955931 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa22c23c-3f82-4195-b058-291922adc1e4 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:39.084083 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adc397c-4aa4-4446-9f13-c7577a8759d5 service nova] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:39.094002 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adc397c-4aa4-4446-9f13-c7577a8759d5 service nova] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:39.098620 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:02:39.106003 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b6340a-5f83-4b01-889a-c6a31fa45a54 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e2a05b782424ab2928b5864f1bfd556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:39.106003 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b6340a-5f83-4b01-889a-c6a31fa45a54 service cinder] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:39.106003 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b6340a-5f83-4b01-889a-c6a31fa45a54 service cinder] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:39.106003 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b6340a-5f83-4b01-889a-c6a31fa45a54 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:39.122509 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b6340a-5f83-4b01-889a-c6a31fa45a54 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:39.124112 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b6340a-5f83-4b01-889a-c6a31fa45a54 service cinder] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:39.150546 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 994/1975] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:02:39 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:02:39.215625 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:02:39.342923 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-aa22c23c-3f82-4195-b058-291922adc1e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b78fc856c86a465db4d3100b3db2578a'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:39.376862 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-aa22c23c-3f82-4195-b058-291922adc1e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b78fc856c86a465db4d3100b3db2578a'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:39.377712 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-aa22c23c-3f82-4195-b058-291922adc1e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b78fc856c86a465db4d3100b3db2578a'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:39.379476 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-aa22c23c-3f82-4195-b058-291922adc1e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b78fc856c86a465db4d3100b3db2578a'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:39.501313 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-aa22c23c-3f82-4195-b058-291922adc1e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b78fc856c86a465db4d3100b3db2578a'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:39.542814 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 982/1976] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Oct 4 12:02:38 2022] DELETE /identity/v3/users/b78fc856c86a465db4d3100b3db2578a => generated 0 bytes in 718 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:02:39.547823 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93fa814-aa42-45c9-9220-56f1d7b588f8 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:39.548330 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93fa814-aa42-45c9-9220-56f1d7b588f8 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:39.548788 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93fa814-aa42-45c9-9220-56f1d7b588f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:39.581034 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-b93fa814-aa42-45c9-9220-56f1d7b588f8 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:02:39.583005 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-b93fa814-aa42-45c9-9220-56f1d7b588f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:39.718114 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 995/1977] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:02:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:02:39.756233 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa22c23c-3f82-4195-b058-291922adc1e4 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:39.758076 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-aa22c23c-3f82-4195-b058-291922adc1e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:39.888020 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa22c23c-3f82-4195-b058-291922adc1e4 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:39.900696 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8a0b85-3396-4ee9-a4ac-5a6bcc886d79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7289515c5c44914a19daa439de98cb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:39.901440 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8a0b85-3396-4ee9-a4ac-5a6bcc886d79 service neutron] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:39.901534 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8a0b85-3396-4ee9-a4ac-5a6bcc886d79 service neutron] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:39.901733 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8a0b85-3396-4ee9-a4ac-5a6bcc886d79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:39.930040 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8a0b85-3396-4ee9-a4ac-5a6bcc886d79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:39.931893 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8a0b85-3396-4ee9-a4ac-5a6bcc886d79 service neutron] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:39.954478 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 983/1978] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:02:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 12:02:40.861313 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93fa814-aa42-45c9-9220-56f1d7b588f8 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:40.864339 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-b93fa814-aa42-45c9-9220-56f1d7b588f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:40.891718 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93fa814-aa42-45c9-9220-56f1d7b588f8 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:40.897814 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4495619-96b7-4eb9-ba44-3a296866f778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:40.899044 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4495619-96b7-4eb9-ba44-3a296866f778 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:40.899559 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4495619-96b7-4eb9-ba44-3a296866f778 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:40.900306 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4495619-96b7-4eb9-ba44-3a296866f778 admin admin] PATH_INFO: `/v3/projects/3726ecad03ec45d182535b00130fa5c5` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:40.902028 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4495619-96b7-4eb9-ba44-3a296866f778 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3726ecad03ec45d182535b00130fa5c5)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:40.904248 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4495619-96b7-4eb9-ba44-3a296866f778 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:41.104472 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-d4495619-96b7-4eb9-ba44-3a296866f778 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3726ecad03ec45d182535b00130fa5c5', 'request_id': 'req-d4495619-96b7-4eb9-ba44-3a296866f778'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:41.267947 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-d4495619-96b7-4eb9-ba44-3a296866f778 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3726ecad03ec45d182535b00130fa5c5', 'request_id': 'req-d4495619-96b7-4eb9-ba44-3a296866f778'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:41.278118 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-d4495619-96b7-4eb9-ba44-3a296866f778 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3726ecad03ec45d182535b00130fa5c5', 'request_id': 'req-d4495619-96b7-4eb9-ba44-3a296866f778'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:41.294894 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-d4495619-96b7-4eb9-ba44-3a296866f778 admin admin] The token cache is being invalidate because project 3726ecad03ec45d182535b00130fa5c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:02:41.295701 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-d4495619-96b7-4eb9-ba44-3a296866f778 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:41.296658 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-d4495619-96b7-4eb9-ba44-3a296866f778 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:41.298719 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 996/1979] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Oct 4 12:02:40 2022] DELETE /identity/v3/projects/3726ecad03ec45d182535b00130fa5c5 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:02:41.302887 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8a0b85-3396-4ee9-a4ac-5a6bcc886d79 service neutron] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:41.315318 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8a0b85-3396-4ee9-a4ac-5a6bcc886d79 service neutron] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:41.397063 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713dc9e3-d276-4bab-b1c7-30e544f325ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:41.397063 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713dc9e3-d276-4bab-b1c7-30e544f325ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:41.397063 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713dc9e3-d276-4bab-b1c7-30e544f325ac admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:41.397063 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713dc9e3-d276-4bab-b1c7-30e544f325ac admin admin] PATH_INFO: `/v3/users/28114f9302b24e10b65b4adf6bf1c6d0` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:41.397509 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713dc9e3-d276-4bab-b1c7-30e544f325ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=28114f9302b24e10b65b4adf6bf1c6d0)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:41.397509 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713dc9e3-d276-4bab-b1c7-30e544f325ac admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:41.835816 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:02:41.997978 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-713dc9e3-d276-4bab-b1c7-30e544f325ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28114f9302b24e10b65b4adf6bf1c6d0'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:42.012196 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-713dc9e3-d276-4bab-b1c7-30e544f325ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28114f9302b24e10b65b4adf6bf1c6d0'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:42.013091 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-713dc9e3-d276-4bab-b1c7-30e544f325ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28114f9302b24e10b65b4adf6bf1c6d0'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:42.015926 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-713dc9e3-d276-4bab-b1c7-30e544f325ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28114f9302b24e10b65b4adf6bf1c6d0'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:42.141938 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-713dc9e3-d276-4bab-b1c7-30e544f325ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28114f9302b24e10b65b4adf6bf1c6d0'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:42.194358 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 984/1980] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Oct 4 12:02:41 2022] DELETE /identity/v3/users/28114f9302b24e10b65b4adf6bf1c6d0 => generated 0 bytes in 892 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:02:42.291179 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df057176-32d3-49b9-bda4-e0605b5df89d None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:42.291721 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df057176-32d3-49b9-bda4-e0605b5df89d None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:42.291920 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df057176-32d3-49b9-bda4-e0605b5df89d None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:42.293812 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 997/1981] 10.222.0.59 () {54 vars in 921 bytes} [Tue Oct 4 12:02:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 12:02:42.341128 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a499297-999c-4773-b9bf-dc460f1884a1 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:42.341640 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a499297-999c-4773-b9bf-dc460f1884a1 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:42.341836 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a499297-999c-4773-b9bf-dc460f1884a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:42.345512 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcec2ac-4c67-43e3-b39a-e2588e1044dd None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:42.346483 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcec2ac-4c67-43e3-b39a-e2588e1044dd None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:42.347474 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcec2ac-4c67-43e3-b39a-e2588e1044dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:42.400136 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-dbcec2ac-4c67-43e3-b39a-e2588e1044dd None None] MFA Rules not processed for user `a0df8dcc8c554e5ca9cdd5b3d5d71cdf`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:02:42.400136 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-dbcec2ac-4c67-43e3-b39a-e2588e1044dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:42.411237 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-0a499297-999c-4773-b9bf-dc460f1884a1 None None] MFA Rules not processed for user `be119968b02440adbbbc85c553077b92`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:02:42.417257 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-0a499297-999c-4773-b9bf-dc460f1884a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:42.544003 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 985/1982] 10.222.0.59 () {58 vars in 1018 bytes} [Tue Oct 4 12:02:42 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 12:02:42.553391 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 998/1983] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:02:42 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:02:42.571190 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a499297-999c-4773-b9bf-dc460f1884a1 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:42.573076 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-0a499297-999c-4773-b9bf-dc460f1884a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:42.576244 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcec2ac-4c67-43e3-b39a-e2588e1044dd None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:42.577896 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-dbcec2ac-4c67-43e3-b39a-e2588e1044dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:42.626762 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcec2ac-4c67-43e3-b39a-e2588e1044dd None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:42.636588 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db09f9d-4398-4d9f-ba5b-89413bda2f03 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be119968b02440adbbbc85c553077b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:42.637256 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db09f9d-4398-4d9f-ba5b-89413bda2f03 service placement] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:42.637685 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db09f9d-4398-4d9f-ba5b-89413bda2f03 service placement] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:42.637967 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db09f9d-4398-4d9f-ba5b-89413bda2f03 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:42.657576 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a499297-999c-4773-b9bf-dc460f1884a1 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:42.662296 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db09f9d-4398-4d9f-ba5b-89413bda2f03 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:42.667468 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db09f9d-4398-4d9f-ba5b-89413bda2f03 service placement] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:42.671574 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120d0184-00e8-45ce-8ee4-45665fbf7063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:42.672367 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120d0184-00e8-45ce-8ee4-45665fbf7063 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:42.672755 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120d0184-00e8-45ce-8ee4-45665fbf7063 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:42.673113 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120d0184-00e8-45ce-8ee4-45665fbf7063 admin admin] PATH_INFO: `/v3/users/4fabb75bbc354ac7a3f109edfaefb291` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:42.674717 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120d0184-00e8-45ce-8ee4-45665fbf7063 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fabb75bbc354ac7a3f109edfaefb291)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:42.678516 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120d0184-00e8-45ce-8ee4-45665fbf7063 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:42.697867 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 999/1984] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:02:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:02:42.946957 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db09f9d-4398-4d9f-ba5b-89413bda2f03 service placement] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:42.948500 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-9db09f9d-4398-4d9f-ba5b-89413bda2f03 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:42.951221 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-120d0184-00e8-45ce-8ee4-45665fbf7063 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fabb75bbc354ac7a3f109edfaefb291'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:42.959219 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-120d0184-00e8-45ce-8ee4-45665fbf7063 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fabb75bbc354ac7a3f109edfaefb291'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:42.959792 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-120d0184-00e8-45ce-8ee4-45665fbf7063 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fabb75bbc354ac7a3f109edfaefb291'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:42.960402 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-120d0184-00e8-45ce-8ee4-45665fbf7063 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fabb75bbc354ac7a3f109edfaefb291'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:42.962954 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db09f9d-4398-4d9f-ba5b-89413bda2f03 service placement] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:42.967484 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf8f435-a757-40e3-a551-77a94864e947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:42.968260 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf8f435-a757-40e3-a551-77a94864e947 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:42.968525 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf8f435-a757-40e3-a551-77a94864e947 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:42.977834 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf8f435-a757-40e3-a551-77a94864e947 admin admin] PATH_INFO: `/v3/projects/f930219ea1d34cce8435d351e7f87659` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:42.977834 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf8f435-a757-40e3-a551-77a94864e947 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f930219ea1d34cce8435d351e7f87659)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:42.977834 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf8f435-a757-40e3-a551-77a94864e947 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:43.117535 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-120d0184-00e8-45ce-8ee4-45665fbf7063 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fabb75bbc354ac7a3f109edfaefb291'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:43.136615 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 986/1985] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Oct 4 12:02:42 2022] DELETE /identity/v3/users/4fabb75bbc354ac7a3f109edfaefb291 => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:02:43.160198 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-bdf8f435-a757-40e3-a551-77a94864e947 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f930219ea1d34cce8435d351e7f87659', 'request_id': 'req-bdf8f435-a757-40e3-a551-77a94864e947'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:43.306554 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-bdf8f435-a757-40e3-a551-77a94864e947 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f930219ea1d34cce8435d351e7f87659', 'request_id': 'req-bdf8f435-a757-40e3-a551-77a94864e947'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:43.313603 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-bdf8f435-a757-40e3-a551-77a94864e947 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f930219ea1d34cce8435d351e7f87659', 'request_id': 'req-bdf8f435-a757-40e3-a551-77a94864e947'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:43.324670 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-bdf8f435-a757-40e3-a551-77a94864e947 admin admin] The token cache is being invalidate because project f930219ea1d34cce8435d351e7f87659 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:02:43.324965 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-bdf8f435-a757-40e3-a551-77a94864e947 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:43.325613 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-bdf8f435-a757-40e3-a551-77a94864e947 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:43.327104 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1000/1986] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Oct 4 12:02:42 2022] DELETE /identity/v3/projects/f930219ea1d34cce8435d351e7f87659 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:02:43.333531 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceae8f8-2fbb-437f-995c-94e6fcc82ff9 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:43.333827 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceae8f8-2fbb-437f-995c-94e6fcc82ff9 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:43.334109 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceae8f8-2fbb-437f-995c-94e6fcc82ff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:43.354736 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-eceae8f8-2fbb-437f-995c-94e6fcc82ff9 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:02:43.356219 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-eceae8f8-2fbb-437f-995c-94e6fcc82ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:43.418090 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf8f435-a757-40e3-a551-77a94864e947 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:43.419416 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 987/1987] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:02:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:02:43.427309 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-bdf8f435-a757-40e3-a551-77a94864e947 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:43.428209 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c41fa26-d9e7-40ed-8dde-f56cb0e4205b None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:43.428497 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c41fa26-d9e7-40ed-8dde-f56cb0e4205b None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:43.428875 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c41fa26-d9e7-40ed-8dde-f56cb0e4205b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:43.441715 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf8f435-a757-40e3-a551-77a94864e947 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:43.446560 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0d58b9-4c7d-4ae6-9c15-c93bbd37e70a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:43.447203 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0d58b9-4c7d-4ae6-9c15-c93bbd37e70a admin admin] REQUEST_METHOD: `DELETE` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:43.447488 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0d58b9-4c7d-4ae6-9c15-c93bbd37e70a admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:43.447767 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0d58b9-4c7d-4ae6-9c15-c93bbd37e70a admin admin] PATH_INFO: `/v3/projects/6ed36bb056c24fd1b4a65c96bbb33801` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:43.449363 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0d58b9-4c7d-4ae6-9c15-c93bbd37e70a admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ed36bb056c24fd1b4a65c96bbb33801)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:43.451196 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0d58b9-4c7d-4ae6-9c15-c93bbd37e70a admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:43.452742 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-5c41fa26-d9e7-40ed-8dde-f56cb0e4205b None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:02:43.454531 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-5c41fa26-d9e7-40ed-8dde-f56cb0e4205b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:43.464019 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 988/1988] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:02:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:02:43.468258 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c41fa26-d9e7-40ed-8dde-f56cb0e4205b None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:43.477821 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c41fa26-d9e7-40ed-8dde-f56cb0e4205b None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:43.482949 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463b5bc3-c0a4-4ae3-9488-c2ad4d8e2e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:43.483566 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463b5bc3-c0a4-4ae3-9488-c2ad4d8e2e33 admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:43.483846 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463b5bc3-c0a4-4ae3-9488-c2ad4d8e2e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:43.484120 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463b5bc3-c0a4-4ae3-9488-c2ad4d8e2e33 admin admin] PATH_INFO: `/v3/domains` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:43.485062 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463b5bc3-c0a4-4ae3-9488-c2ad4d8e2e33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:02:43.485369 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463b5bc3-c0a4-4ae3-9488-c2ad4d8e2e33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:43.486965 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463b5bc3-c0a4-4ae3-9488-c2ad4d8e2e33 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:43.499305 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 989/1989] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Oct 4 12:02:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 12:02:43.504382 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463b5bc3-c0a4-4ae3-9488-c2ad4d8e2e33 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:43.514143 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463b5bc3-c0a4-4ae3-9488-c2ad4d8e2e33 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:43.519202 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcdef59-0bb6-48da-8bf3-ae183beced60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:43.520031 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcdef59-0bb6-48da-8bf3-ae183beced60 admin admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:43.520031 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcdef59-0bb6-48da-8bf3-ae183beced60 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:43.520326 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcdef59-0bb6-48da-8bf3-ae183beced60 admin admin] PATH_INFO: `/v3/projects` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:43.520960 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcdef59-0bb6-48da-8bf3-ae183beced60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:43.522900 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcdef59-0bb6-48da-8bf3-ae183beced60 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:43.623358 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-ba0d58b9-4c7d-4ae6-9c15-c93bbd37e70a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ed36bb056c24fd1b4a65c96bbb33801', 'request_id': 'req-ba0d58b9-4c7d-4ae6-9c15-c93bbd37e70a'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:43.674776 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 990/1990] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Oct 4 12:02:43 2022] POST /identity/v3/projects => generated 383 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 12:02:43.679526 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcdef59-0bb6-48da-8bf3-ae183beced60 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:43.695456 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-ba0d58b9-4c7d-4ae6-9c15-c93bbd37e70a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ed36bb056c24fd1b4a65c96bbb33801', 'request_id': 'req-ba0d58b9-4c7d-4ae6-9c15-c93bbd37e70a'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:43.704986 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-ba0d58b9-4c7d-4ae6-9c15-c93bbd37e70a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ed36bb056c24fd1b4a65c96bbb33801', 'request_id': 'req-ba0d58b9-4c7d-4ae6-9c15-c93bbd37e70a'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:43.708069 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:02:43.760955 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-ba0d58b9-4c7d-4ae6-9c15-c93bbd37e70a admin admin] The token cache is being invalidate because project 6ed36bb056c24fd1b4a65c96bbb33801 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:02:43.760955 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-ba0d58b9-4c7d-4ae6-9c15-c93bbd37e70a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:43.760955 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-ba0d58b9-4c7d-4ae6-9c15-c93bbd37e70a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:43.765782 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1001/1991] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Oct 4 12:02:43 2022] DELETE /identity/v3/projects/6ed36bb056c24fd1b4a65c96bbb33801 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:02:43.767547 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d877e862-ec14-423c-a1d7-c70aadf19355 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:43.768917 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d877e862-ec14-423c-a1d7-c70aadf19355 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:43.769707 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d877e862-ec14-423c-a1d7-c70aadf19355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:43.798106 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-d877e862-ec14-423c-a1d7-c70aadf19355 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:02:43.799424 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-d877e862-ec14-423c-a1d7-c70aadf19355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:43.852231 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcdef59-0bb6-48da-8bf3-ae183beced60 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:43.853791 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5e2c48-8588-4e4a-ab0e-5e393f92aeb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:43.854479 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5e2c48-8588-4e4a-ab0e-5e393f92aeb3 admin admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:43.854822 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5e2c48-8588-4e4a-ab0e-5e393f92aeb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:43.855107 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5e2c48-8588-4e4a-ab0e-5e393f92aeb3 admin admin] PATH_INFO: `/v3/users` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:43.855760 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5e2c48-8588-4e4a-ab0e-5e393f92aeb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:43.857837 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5e2c48-8588-4e4a-ab0e-5e393f92aeb3 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:43.890037 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1002/1992] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:02:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:02:43.898280 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601ad053-7998-4e2d-970f-d037c978309a None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:43.898564 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601ad053-7998-4e2d-970f-d037c978309a None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:43.898855 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601ad053-7998-4e2d-970f-d037c978309a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:43.929137 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-601ad053-7998-4e2d-970f-d037c978309a None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:02:43.930843 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-601ad053-7998-4e2d-970f-d037c978309a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:43.940805 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1003/1993] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:02:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 12:02:43.941696 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601ad053-7998-4e2d-970f-d037c978309a None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:43.943473 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-601ad053-7998-4e2d-970f-d037c978309a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:43.955441 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601ad053-7998-4e2d-970f-d037c978309a None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:43.960821 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ce31cc-ca53-4bb6-b1a9-8527fad1ffdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:43.961445 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ce31cc-ca53-4bb6-b1a9-8527fad1ffdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:43.961875 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ce31cc-ca53-4bb6-b1a9-8527fad1ffdf admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:43.962351 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ce31cc-ca53-4bb6-b1a9-8527fad1ffdf admin admin] PATH_INFO: `/v3/users/60b7654a75bb4ae8a9fb256d4034bf67` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:43.964191 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ce31cc-ca53-4bb6-b1a9-8527fad1ffdf admin admin] RBAC: Authorizing `identity:delete_user(user_id=60b7654a75bb4ae8a9fb256d4034bf67)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:43.967924 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ce31cc-ca53-4bb6-b1a9-8527fad1ffdf admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:44.063937 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 991/1994] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Oct 4 12:02:43 2022] POST /identity/v3/users => generated 292 bytes in 382 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:02:44.063937 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5e2c48-8588-4e4a-ab0e-5e393f92aeb3 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:44.071201 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5e2c48-8588-4e4a-ab0e-5e393f92aeb3 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:44.076140 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4309bc69-9bd3-4762-bbdf-35f8cd7f8812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:44.076787 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4309bc69-9bd3-4762-bbdf-35f8cd7f8812 admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:44.077066 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4309bc69-9bd3-4762-bbdf-35f8cd7f8812 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:44.077336 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4309bc69-9bd3-4762-bbdf-35f8cd7f8812 admin admin] PATH_INFO: `/v3/domains` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:44.077969 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4309bc69-9bd3-4762-bbdf-35f8cd7f8812 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:02:44.078273 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4309bc69-9bd3-4762-bbdf-35f8cd7f8812 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:44.079995 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4309bc69-9bd3-4762-bbdf-35f8cd7f8812 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:44.093641 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 992/1995] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Oct 4 12:02:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:02:44.094462 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4309bc69-9bd3-4762-bbdf-35f8cd7f8812 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:44.096087 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-4309bc69-9bd3-4762-bbdf-35f8cd7f8812 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:44.108790 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4309bc69-9bd3-4762-bbdf-35f8cd7f8812 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:44.114048 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9319e70-a9b5-4c4a-a8b7-89c89ac5dfd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:44.114645 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9319e70-a9b5-4c4a-a8b7-89c89ac5dfd2 admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:44.114932 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9319e70-a9b5-4c4a-a8b7-89c89ac5dfd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:44.115212 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9319e70-a9b5-4c4a-a8b7-89c89ac5dfd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:44.115844 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9319e70-a9b5-4c4a-a8b7-89c89ac5dfd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:44.117470 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9319e70-a9b5-4c4a-a8b7-89c89ac5dfd2 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:44.127827 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 993/1996] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:02:44 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:02:44.129012 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9319e70-a9b5-4c4a-a8b7-89c89ac5dfd2 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:44.140290 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9319e70-a9b5-4c4a-a8b7-89c89ac5dfd2 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:44.145816 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15cd0ab-97d2-4736-b6e5-897c4ec6fdb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:44.149559 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15cd0ab-97d2-4736-b6e5-897c4ec6fdb8 admin admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:44.149559 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15cd0ab-97d2-4736-b6e5-897c4ec6fdb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:44.149559 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15cd0ab-97d2-4736-b6e5-897c4ec6fdb8 admin admin] PATH_INFO: `/v3/projects` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:44.149559 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15cd0ab-97d2-4736-b6e5-897c4ec6fdb8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:44.149559 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15cd0ab-97d2-4736-b6e5-897c4ec6fdb8 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:44.298138 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 994/1997] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Oct 4 12:02:44 2022] POST /identity/v3/projects => generated 367 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:02:44.299335 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15cd0ab-97d2-4736-b6e5-897c4ec6fdb8 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:44.301871 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-73ce31cc-ca53-4bb6-b1a9-8527fad1ffdf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60b7654a75bb4ae8a9fb256d4034bf67'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:44.309877 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-73ce31cc-ca53-4bb6-b1a9-8527fad1ffdf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60b7654a75bb4ae8a9fb256d4034bf67'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:44.310669 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-73ce31cc-ca53-4bb6-b1a9-8527fad1ffdf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60b7654a75bb4ae8a9fb256d4034bf67'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:44.311308 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-73ce31cc-ca53-4bb6-b1a9-8527fad1ffdf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60b7654a75bb4ae8a9fb256d4034bf67'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:44.367963 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15cd0ab-97d2-4736-b6e5-897c4ec6fdb8 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:44.373011 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9084a4-cf89-403a-b435-c1c9ab831711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:44.373620 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9084a4-cf89-403a-b435-c1c9ab831711 admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:44.373901 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9084a4-cf89-403a-b435-c1c9ab831711 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:44.374174 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9084a4-cf89-403a-b435-c1c9ab831711 admin admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:44.374814 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9084a4-cf89-403a-b435-c1c9ab831711 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:44.376549 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9084a4-cf89-403a-b435-c1c9ab831711 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:44.387293 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 995/1998] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:02:44 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:02:44.388165 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9084a4-cf89-403a-b435-c1c9ab831711 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:44.389959 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-dd9084a4-cf89-403a-b435-c1c9ab831711 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:44.405253 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9084a4-cf89-403a-b435-c1c9ab831711 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:44.411228 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cbbbbe-ec2b-4fef-a329-47ead911f80e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:44.411838 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cbbbbe-ec2b-4fef-a329-47ead911f80e admin admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:44.412122 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cbbbbe-ec2b-4fef-a329-47ead911f80e admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:44.412402 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cbbbbe-ec2b-4fef-a329-47ead911f80e admin admin] PATH_INFO: `/v3/users` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:44.413083 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cbbbbe-ec2b-4fef-a329-47ead911f80e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:44.415041 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cbbbbe-ec2b-4fef-a329-47ead911f80e admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:44.421260 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-73ce31cc-ca53-4bb6-b1a9-8527fad1ffdf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60b7654a75bb4ae8a9fb256d4034bf67'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:44.439463 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1004/1999] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Oct 4 12:02:43 2022] DELETE /identity/v3/users/60b7654a75bb4ae8a9fb256d4034bf67 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:02:44.440208 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ce31cc-ca53-4bb6-b1a9-8527fad1ffdf admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:44.442184 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-73ce31cc-ca53-4bb6-b1a9-8527fad1ffdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:44.510205 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ce31cc-ca53-4bb6-b1a9-8527fad1ffdf admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:44.514942 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7b940f-3f91-4f02-a74c-651da8b6e9b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:44.515622 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7b940f-3f91-4f02-a74c-651da8b6e9b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:44.515938 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7b940f-3f91-4f02-a74c-651da8b6e9b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:44.516208 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7b940f-3f91-4f02-a74c-651da8b6e9b6 admin admin] PATH_INFO: `/v3/projects/d84b0a2debf549cc87f2c8595763738c/users/9a19e0aabf104d619d1b2671ec870481/roles/ab4307f3b7994c1c80036fa7db93b6b9` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:44.532802 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7b940f-3f91-4f02-a74c-651da8b6e9b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d84b0a2debf549cc87f2c8595763738c, user_id=9a19e0aabf104d619d1b2671ec870481, role_id=ab4307f3b7994c1c80036fa7db93b6b9)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:44.535846 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7b940f-3f91-4f02-a74c-651da8b6e9b6 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:44.559575 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 996/2000] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Oct 4 12:02:44 2022] POST /identity/v3/users => generated 284 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:02:44.562452 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5153b75-b1fd-44e6-b9fa-1b36f35391cc None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:44.563541 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5153b75-b1fd-44e6-b9fa-1b36f35391cc None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:44.564004 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5153b75-b1fd-44e6-b9fa-1b36f35391cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:44.588077 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-b5153b75-b1fd-44e6-b9fa-1b36f35391cc None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:02:44.589293 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-b5153b75-b1fd-44e6-b9fa-1b36f35391cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:44.597462 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 997/2001] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:02:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:02:44.598301 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5153b75-b1fd-44e6-b9fa-1b36f35391cc None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:44.610815 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5153b75-b1fd-44e6-b9fa-1b36f35391cc None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:44.616500 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947da0cf-038f-45d7-a64f-7112ede8d72e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:44.617164 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947da0cf-038f-45d7-a64f-7112ede8d72e admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:44.617446 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947da0cf-038f-45d7-a64f-7112ede8d72e admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:44.617720 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947da0cf-038f-45d7-a64f-7112ede8d72e admin admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:44.618363 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947da0cf-038f-45d7-a64f-7112ede8d72e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:44.625247 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947da0cf-038f-45d7-a64f-7112ede8d72e admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:44.637814 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 998/2002] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:02:44 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:02:44.638617 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947da0cf-038f-45d7-a64f-7112ede8d72e admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:44.641935 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-947da0cf-038f-45d7-a64f-7112ede8d72e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:44.701521 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1005/2003] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Oct 4 12:02:44 2022] PUT /identity/v3/projects/d84b0a2debf549cc87f2c8595763738c/users/9a19e0aabf104d619d1b2671ec870481/roles/ab4307f3b7994c1c80036fa7db93b6b9 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:02:44.702367 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7b940f-3f91-4f02-a74c-651da8b6e9b6 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:44.703966 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947da0cf-038f-45d7-a64f-7112ede8d72e admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:44.763236 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58a05f4-c9b0-47d9-9a71-ef0a9b10fb29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7289515c5c44914a19daa439de98cb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:44.763809 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58a05f4-c9b0-47d9-9a71-ef0a9b10fb29 service neutron] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:44.764273 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58a05f4-c9b0-47d9-9a71-ef0a9b10fb29 service neutron] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:44.764851 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58a05f4-c9b0-47d9-9a71-ef0a9b10fb29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:44.777498 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58a05f4-c9b0-47d9-9a71-ef0a9b10fb29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:44.779010 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58a05f4-c9b0-47d9-9a71-ef0a9b10fb29 service neutron] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:44.780841 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7b940f-3f91-4f02-a74c-651da8b6e9b6 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:44.790474 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 999/2004] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:02:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:02:44.790604 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85743f02-00c8-4a55-8123-f51b834171db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:44.792803 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85743f02-00c8-4a55-8123-f51b834171db admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:44.793090 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85743f02-00c8-4a55-8123-f51b834171db admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:44.794242 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85743f02-00c8-4a55-8123-f51b834171db admin admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:44.795387 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85743f02-00c8-4a55-8123-f51b834171db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:44.797219 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85743f02-00c8-4a55-8123-f51b834171db admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:44.798901 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f891201-ffb1-480f-9c5c-c390faafa111 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:44.799273 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f891201-ffb1-480f-9c5c-c390faafa111 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:44.799668 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f891201-ffb1-480f-9c5c-c390faafa111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:44.810694 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1006/2005] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:02:44 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:02:44.814682 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85743f02-00c8-4a55-8123-f51b834171db admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:44.829547 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85743f02-00c8-4a55-8123-f51b834171db admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:44.835376 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f953484-c035-4267-9023-4cb741ec7e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:44.836294 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f953484-c035-4267-9023-4cb741ec7e59 admin admin] REQUEST_METHOD: `PUT` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:44.836840 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f953484-c035-4267-9023-4cb741ec7e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:44.837338 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f953484-c035-4267-9023-4cb741ec7e59 admin admin] PATH_INFO: `/v3/projects/5d7f640ecda04554a0a1c2773830810e/users/eeb82a54892349c8ac377bcb0f8b3a70/roles/ab4307f3b7994c1c80036fa7db93b6b9` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:44.856820 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-4f891201-ffb1-480f-9c5c-c390faafa111 None None] MFA Rules not processed for user `9a19e0aabf104d619d1b2671ec870481`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:02:44.858063 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-4f891201-ffb1-480f-9c5c-c390faafa111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:44.858238 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f953484-c035-4267-9023-4cb741ec7e59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d7f640ecda04554a0a1c2773830810e, user_id=eeb82a54892349c8ac377bcb0f8b3a70, role_id=ab4307f3b7994c1c80036fa7db93b6b9)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:44.865266 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f953484-c035-4267-9023-4cb741ec7e59 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:44.939608 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1000/2006] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:02:44 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:02:44.942432 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f891201-ffb1-480f-9c5c-c390faafa111 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:44.953920 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f891201-ffb1-480f-9c5c-c390faafa111 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:44.961874 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faf5313-cca0-4568-9093-e437bf982a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:44.962791 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faf5313-cca0-4568-9093-e437bf982a92 admin admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:44.963114 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faf5313-cca0-4568-9093-e437bf982a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:44.964372 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faf5313-cca0-4568-9093-e437bf982a92 admin admin] PATH_INFO: `/v3/projects` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:44.965351 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faf5313-cca0-4568-9093-e437bf982a92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:44.967134 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1007/2007] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Oct 4 12:02:44 2022] PUT /identity/v3/projects/5d7f640ecda04554a0a1c2773830810e/users/eeb82a54892349c8ac377bcb0f8b3a70/roles/ab4307f3b7994c1c80036fa7db93b6b9 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:02:44.967967 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faf5313-cca0-4568-9093-e437bf982a92 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:44.986648 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592f36df-09c7-4815-9688-d04a59ddf3ff None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:44.987079 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592f36df-09c7-4815-9688-d04a59ddf3ff None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:44.987615 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592f36df-09c7-4815-9688-d04a59ddf3ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:45.021708 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-592f36df-09c7-4815-9688-d04a59ddf3ff None None] MFA Rules not processed for user `eeb82a54892349c8ac377bcb0f8b3a70`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:02:45.023050 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-592f36df-09c7-4815-9688-d04a59ddf3ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:45.086640 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1001/2008] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Oct 4 12:02:44 2022] POST /identity/v3/projects => generated 385 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:02:45.090925 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faf5313-cca0-4568-9093-e437bf982a92 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:45.092980 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1008/2009] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:02:44 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:02:45.100525 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592f36df-09c7-4815-9688-d04a59ddf3ff None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:45.102831 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-592f36df-09c7-4815-9688-d04a59ddf3ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:45.119907 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:02:45.180927 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faf5313-cca0-4568-9093-e437bf982a92 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:45.186263 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583cb7e1-1e3a-4936-b001-b9fb88d14898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:45.186972 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583cb7e1-1e3a-4936-b001-b9fb88d14898 admin admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:45.187315 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583cb7e1-1e3a-4936-b001-b9fb88d14898 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:45.187785 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583cb7e1-1e3a-4936-b001-b9fb88d14898 admin admin] PATH_INFO: `/v3/users` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:45.188521 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583cb7e1-1e3a-4936-b001-b9fb88d14898 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:45.190721 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583cb7e1-1e3a-4936-b001-b9fb88d14898 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:45.191139 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592f36df-09c7-4815-9688-d04a59ddf3ff None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:45.251324 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff97549-f86f-4043-b78c-d14f23ff54f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e2a05b782424ab2928b5864f1bfd556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:45.251932 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff97549-f86f-4043-b78c-d14f23ff54f8 service cinder] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:45.252206 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff97549-f86f-4043-b78c-d14f23ff54f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:45.252474 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff97549-f86f-4043-b78c-d14f23ff54f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:45.305128 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1002/2010] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Oct 4 12:02:45 2022] POST /identity/v3/users => generated 293 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 12:02:45.305128 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583cb7e1-1e3a-4936-b001-b9fb88d14898 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:45.305128 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-583cb7e1-1e3a-4936-b001-b9fb88d14898 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:45.318122 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583cb7e1-1e3a-4936-b001-b9fb88d14898 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:45.318331 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff97549-f86f-4043-b78c-d14f23ff54f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:45.319900 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff97549-f86f-4043-b78c-d14f23ff54f8 service cinder] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:45.323228 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11676d2-6adc-49d0-a5f3-c89ad99816ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:45.323966 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11676d2-6adc-49d0-a5f3-c89ad99816ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:45.324320 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11676d2-6adc-49d0-a5f3-c89ad99816ff admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:45.324876 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11676d2-6adc-49d0-a5f3-c89ad99816ff admin admin] PATH_INFO: `/v3/users/5e2173fb1b3e4945a60aaceb152658f8` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:45.327705 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11676d2-6adc-49d0-a5f3-c89ad99816ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e2173fb1b3e4945a60aaceb152658f8)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:45.329712 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11676d2-6adc-49d0-a5f3-c89ad99816ff admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:45.334578 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1009/2011] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:02:45 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 12:02:45.335649 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff97549-f86f-4043-b78c-d14f23ff54f8 service cinder] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:45.348062 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff97549-f86f-4043-b78c-d14f23ff54f8 service cinder] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:45.353391 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cff99a-2d00-47b8-88c5-0c69f8d6c071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:45.354225 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cff99a-2d00-47b8-88c5-0c69f8d6c071 admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:45.354576 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cff99a-2d00-47b8-88c5-0c69f8d6c071 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:45.354928 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cff99a-2d00-47b8-88c5-0c69f8d6c071 admin admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:45.355693 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cff99a-2d00-47b8-88c5-0c69f8d6c071 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:45.357520 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cff99a-2d00-47b8-88c5-0c69f8d6c071 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:45.372317 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1010/2012] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:02:45 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:02:45.373641 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cff99a-2d00-47b8-88c5-0c69f8d6c071 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:45.384547 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cff99a-2d00-47b8-88c5-0c69f8d6c071 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:45.389263 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656c8908-beca-4ab0-9fa7-9bbde7ea03d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:45.389851 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656c8908-beca-4ab0-9fa7-9bbde7ea03d5 admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:45.390139 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656c8908-beca-4ab0-9fa7-9bbde7ea03d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:45.390411 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656c8908-beca-4ab0-9fa7-9bbde7ea03d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:45.391053 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656c8908-beca-4ab0-9fa7-9bbde7ea03d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:45.392748 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656c8908-beca-4ab0-9fa7-9bbde7ea03d5 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:45.406602 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1011/2013] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:02:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:02:45.407584 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656c8908-beca-4ab0-9fa7-9bbde7ea03d5 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:45.421360 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656c8908-beca-4ab0-9fa7-9bbde7ea03d5 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:45.427608 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b817a355-c02b-4fd9-b870-f09e4301cc4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:45.428170 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b817a355-c02b-4fd9-b870-f09e4301cc4c admin admin] REQUEST_METHOD: `PUT` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:45.428472 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b817a355-c02b-4fd9-b870-f09e4301cc4c admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:45.429877 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b817a355-c02b-4fd9-b870-f09e4301cc4c admin admin] PATH_INFO: `/v3/projects/f4ea5963c5e441628d3bb59c05f0314e/users/c3b2aa31892b46cbbba2a511fe42d205/roles/ab4307f3b7994c1c80036fa7db93b6b9` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:45.456243 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b817a355-c02b-4fd9-b870-f09e4301cc4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4ea5963c5e441628d3bb59c05f0314e, user_id=c3b2aa31892b46cbbba2a511fe42d205, role_id=ab4307f3b7994c1c80036fa7db93b6b9)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:45.463984 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b817a355-c02b-4fd9-b870-f09e4301cc4c admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:45.589524 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1012/2014] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Oct 4 12:02:45 2022] PUT /identity/v3/projects/f4ea5963c5e441628d3bb59c05f0314e/users/c3b2aa31892b46cbbba2a511fe42d205/roles/ab4307f3b7994c1c80036fa7db93b6b9 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:02:45.589524 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b817a355-c02b-4fd9-b870-f09e4301cc4c admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:45.590389 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-b817a355-c02b-4fd9-b870-f09e4301cc4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:45.654193 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b817a355-c02b-4fd9-b870-f09e4301cc4c admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:45.658879 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be18c4e-4655-47fd-b705-4aba2c9bbeb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:45.660080 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be18c4e-4655-47fd-b705-4aba2c9bbeb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:45.660499 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be18c4e-4655-47fd-b705-4aba2c9bbeb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:45.660804 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be18c4e-4655-47fd-b705-4aba2c9bbeb7 admin admin] PATH_INFO: `/v3/projects/96faf7a690ef4f60aeefbb28b0c9e7ec` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:45.661931 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be18c4e-4655-47fd-b705-4aba2c9bbeb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96faf7a690ef4f60aeefbb28b0c9e7ec)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:45.663851 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be18c4e-4655-47fd-b705-4aba2c9bbeb7 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:45.738117 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-e11676d2-6adc-49d0-a5f3-c89ad99816ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e2173fb1b3e4945a60aaceb152658f8'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:45.745446 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-e11676d2-6adc-49d0-a5f3-c89ad99816ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e2173fb1b3e4945a60aaceb152658f8'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:45.746133 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-e11676d2-6adc-49d0-a5f3-c89ad99816ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e2173fb1b3e4945a60aaceb152658f8'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:45.746736 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-e11676d2-6adc-49d0-a5f3-c89ad99816ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e2173fb1b3e4945a60aaceb152658f8'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:45.846674 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-e11676d2-6adc-49d0-a5f3-c89ad99816ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e2173fb1b3e4945a60aaceb152658f8'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:45.848287 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-6be18c4e-4655-47fd-b705-4aba2c9bbeb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96faf7a690ef4f60aeefbb28b0c9e7ec', 'request_id': 'req-6be18c4e-4655-47fd-b705-4aba2c9bbeb7'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:45.868838 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1003/2015] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Oct 4 12:02:45 2022] DELETE /identity/v3/users/5e2173fb1b3e4945a60aaceb152658f8 => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:02:45.872241 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e027af-c02e-430f-8d96-87d0a753a4f0 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:45.872241 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e027af-c02e-430f-8d96-87d0a753a4f0 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:45.872241 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e027af-c02e-430f-8d96-87d0a753a4f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:45.900771 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-c3e027af-c02e-430f-8d96-87d0a753a4f0 None None] MFA Rules not processed for user `c3b2aa31892b46cbbba2a511fe42d205`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:02:45.901978 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-c3e027af-c02e-430f-8d96-87d0a753a4f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:45.966364 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1004/2016] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:02:45 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:02:45.967874 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ba01be-9c57-4fcd-a59f-bc8b64b09b4d None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:45.968162 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ba01be-9c57-4fcd-a59f-bc8b64b09b4d None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:45.968466 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ba01be-9c57-4fcd-a59f-bc8b64b09b4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:45.986835 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-88ba01be-9c57-4fcd-a59f-bc8b64b09b4d None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:02:45.988028 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-88ba01be-9c57-4fcd-a59f-bc8b64b09b4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:46.001387 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-6be18c4e-4655-47fd-b705-4aba2c9bbeb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96faf7a690ef4f60aeefbb28b0c9e7ec', 'request_id': 'req-6be18c4e-4655-47fd-b705-4aba2c9bbeb7'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:46.016026 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-6be18c4e-4655-47fd-b705-4aba2c9bbeb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96faf7a690ef4f60aeefbb28b0c9e7ec', 'request_id': 'req-6be18c4e-4655-47fd-b705-4aba2c9bbeb7'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:46.039501 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-6be18c4e-4655-47fd-b705-4aba2c9bbeb7 admin admin] The token cache is being invalidate because project 96faf7a690ef4f60aeefbb28b0c9e7ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:02:46.040326 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-6be18c4e-4655-47fd-b705-4aba2c9bbeb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:46.041379 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-6be18c4e-4655-47fd-b705-4aba2c9bbeb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:46.043131 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1013/2017] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Oct 4 12:02:45 2022] DELETE /identity/v3/projects/96faf7a690ef4f60aeefbb28b0c9e7ec => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:02:46.046647 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be18c4e-4655-47fd-b705-4aba2c9bbeb7 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:46.048548 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-6be18c4e-4655-47fd-b705-4aba2c9bbeb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:46.068267 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1005/2018] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:02:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:02:46.069413 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ba01be-9c57-4fcd-a59f-bc8b64b09b4d None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:46.070900 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-88ba01be-9c57-4fcd-a59f-bc8b64b09b4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:46.090713 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ba01be-9c57-4fcd-a59f-bc8b64b09b4d None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:46.095620 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee1578f-ad8d-4525-be8d-c24f9110d13c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:46.096288 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee1578f-ad8d-4525-be8d-c24f9110d13c admin admin] REQUEST_METHOD: `DELETE` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:46.098246 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee1578f-ad8d-4525-be8d-c24f9110d13c admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:46.098246 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee1578f-ad8d-4525-be8d-c24f9110d13c admin admin] PATH_INFO: `/v3/users/b5a64b0786ed42f39046a6bbd9412404` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:46.098456 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee1578f-ad8d-4525-be8d-c24f9110d13c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5a64b0786ed42f39046a6bbd9412404)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:46.100359 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee1578f-ad8d-4525-be8d-c24f9110d13c admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:46.129970 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be18c4e-4655-47fd-b705-4aba2c9bbeb7 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:46.133660 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c102ec4-06ee-4ba4-88f1-7ccb7ccfdf5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:46.134280 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c102ec4-06ee-4ba4-88f1-7ccb7ccfdf5c admin admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:46.134554 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c102ec4-06ee-4ba4-88f1-7ccb7ccfdf5c admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:46.134831 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c102ec4-06ee-4ba4-88f1-7ccb7ccfdf5c admin admin] PATH_INFO: `/v3/projects` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:46.135461 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c102ec4-06ee-4ba4-88f1-7ccb7ccfdf5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:46.137538 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c102ec4-06ee-4ba4-88f1-7ccb7ccfdf5c admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:46.298004 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1014/2019] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Oct 4 12:02:46 2022] POST /identity/v3/projects => generated 383 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:02:46.298004 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c102ec4-06ee-4ba4-88f1-7ccb7ccfdf5c admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:46.299681 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-4c102ec4-06ee-4ba4-88f1-7ccb7ccfdf5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:46.373433 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c102ec4-06ee-4ba4-88f1-7ccb7ccfdf5c admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:46.377193 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989f470c-622d-4beb-807a-56fa768b2433 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7289515c5c44914a19daa439de98cb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:46.377799 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989f470c-622d-4beb-807a-56fa768b2433 service neutron] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:46.378803 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989f470c-622d-4beb-807a-56fa768b2433 service neutron] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:46.379118 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989f470c-622d-4beb-807a-56fa768b2433 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:46.423259 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-fee1578f-ad8d-4525-be8d-c24f9110d13c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5a64b0786ed42f39046a6bbd9412404'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:46.431799 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-fee1578f-ad8d-4525-be8d-c24f9110d13c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5a64b0786ed42f39046a6bbd9412404'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:46.432511 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-fee1578f-ad8d-4525-be8d-c24f9110d13c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5a64b0786ed42f39046a6bbd9412404'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:46.433190 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-fee1578f-ad8d-4525-be8d-c24f9110d13c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5a64b0786ed42f39046a6bbd9412404'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:46.443190 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989f470c-622d-4beb-807a-56fa768b2433 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:46.445313 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989f470c-622d-4beb-807a-56fa768b2433 service neutron] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:46.456960 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1015/2020] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:02:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:02:46.457856 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989f470c-622d-4beb-807a-56fa768b2433 service neutron] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:46.467845 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989f470c-622d-4beb-807a-56fa768b2433 service neutron] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:46.477996 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed8a567-1ea8-4a8b-9e0f-6d3730163364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:46.478635 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed8a567-1ea8-4a8b-9e0f-6d3730163364 admin admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:46.478919 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed8a567-1ea8-4a8b-9e0f-6d3730163364 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:46.479198 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed8a567-1ea8-4a8b-9e0f-6d3730163364 admin admin] PATH_INFO: `/v3/users` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:46.479842 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed8a567-1ea8-4a8b-9e0f-6d3730163364 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:46.481826 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed8a567-1ea8-4a8b-9e0f-6d3730163364 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:46.523804 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-fee1578f-ad8d-4525-be8d-c24f9110d13c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5a64b0786ed42f39046a6bbd9412404'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:46.542935 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1006/2021] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Oct 4 12:02:46 2022] DELETE /identity/v3/users/b5a64b0786ed42f39046a6bbd9412404 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:02:46.598024 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1016/2022] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Oct 4 12:02:46 2022] POST /identity/v3/users => generated 298 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:02:46.602274 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee1578f-ad8d-4525-be8d-c24f9110d13c admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:46.603828 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-fee1578f-ad8d-4525-be8d-c24f9110d13c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:46.692147 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee1578f-ad8d-4525-be8d-c24f9110d13c admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:46.696685 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acd67d3-8b53-46f2-95db-e516e2574dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:46.697295 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acd67d3-8b53-46f2-95db-e516e2574dd0 admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:46.697869 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acd67d3-8b53-46f2-95db-e516e2574dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:46.697869 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acd67d3-8b53-46f2-95db-e516e2574dd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:46.698508 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acd67d3-8b53-46f2-95db-e516e2574dd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:46.700262 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acd67d3-8b53-46f2-95db-e516e2574dd0 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:46.711033 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1007/2023] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:02:46 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:02:46.715510 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed8a567-1ea8-4a8b-9e0f-6d3730163364 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:46.726702 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed8a567-1ea8-4a8b-9e0f-6d3730163364 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:46.732263 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eaae68-e079-406f-accf-95692f854f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:46.733253 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eaae68-e079-406f-accf-95692f854f9f admin admin] REQUEST_METHOD: `PUT` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:46.733692 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eaae68-e079-406f-accf-95692f854f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:46.734053 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eaae68-e079-406f-accf-95692f854f9f admin admin] PATH_INFO: `/v3/projects/e441796f96954755b4d32bca3fa543c3/users/b4682b375c4742318bced81d396a1ce2/roles/d6e7421d1ff9451c808004b818354550` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:46.755654 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eaae68-e079-406f-accf-95692f854f9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e441796f96954755b4d32bca3fa543c3, user_id=b4682b375c4742318bced81d396a1ce2, role_id=d6e7421d1ff9451c808004b818354550)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:46.756266 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eaae68-e079-406f-accf-95692f854f9f admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:46.920862 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1017/2024] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Oct 4 12:02:46 2022] PUT /identity/v3/projects/e441796f96954755b4d32bca3fa543c3/users/b4682b375c4742318bced81d396a1ce2/roles/d6e7421d1ff9451c808004b818354550 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:02:46.925002 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acd67d3-8b53-46f2-95db-e516e2574dd0 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:46.936811 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acd67d3-8b53-46f2-95db-e516e2574dd0 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:46.996166 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bcd0d9-b35c-4ffe-9ecf-9c3aa8be493c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:46.996823 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bcd0d9-b35c-4ffe-9ecf-9c3aa8be493c admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:46.997112 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bcd0d9-b35c-4ffe-9ecf-9c3aa8be493c admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:46.997385 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bcd0d9-b35c-4ffe-9ecf-9c3aa8be493c admin admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:46.998211 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bcd0d9-b35c-4ffe-9ecf-9c3aa8be493c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:46.999708 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bcd0d9-b35c-4ffe-9ecf-9c3aa8be493c admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:47.014271 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1008/2025] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:02:46 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 12:02:47.014405 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eaae68-e079-406f-accf-95692f854f9f admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:47.014405 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-23eaae68-e079-406f-accf-95692f854f9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:47.015774 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bcd0d9-b35c-4ffe-9ecf-9c3aa8be493c admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:47.029085 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bcd0d9-b35c-4ffe-9ecf-9c3aa8be493c admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:47.031327 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eaae68-e079-406f-accf-95692f854f9f admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:47.038772 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ca053f-002b-4361-a76d-df92bead6cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:47.040123 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ca053f-002b-4361-a76d-df92bead6cae admin admin] REQUEST_METHOD: `DELETE` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:47.040714 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ca053f-002b-4361-a76d-df92bead6cae admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:47.041533 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ca053f-002b-4361-a76d-df92bead6cae admin admin] PATH_INFO: `/v3/projects/c0d60a643d494a2a8cdaf9c62a398204` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:47.043337 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ca053f-002b-4361-a76d-df92bead6cae admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0d60a643d494a2a8cdaf9c62a398204)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:47.046395 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16c0b69-1c10-44a1-a135-de40d2880381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:47.046926 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ca053f-002b-4361-a76d-df92bead6cae admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:47.047088 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16c0b69-1c10-44a1-a135-de40d2880381 admin admin] REQUEST_METHOD: `PUT` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:47.047370 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16c0b69-1c10-44a1-a135-de40d2880381 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:47.047824 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16c0b69-1c10-44a1-a135-de40d2880381 admin admin] PATH_INFO: `/v3/projects/e441796f96954755b4d32bca3fa543c3/users/b4682b375c4742318bced81d396a1ce2/roles/d6e7421d1ff9451c808004b818354550` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:47.053685 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16c0b69-1c10-44a1-a135-de40d2880381 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e441796f96954755b4d32bca3fa543c3, user_id=b4682b375c4742318bced81d396a1ce2, role_id=d6e7421d1ff9451c808004b818354550)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:47.056384 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16c0b69-1c10-44a1-a135-de40d2880381 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:47.071448 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1009/2026] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Oct 4 12:02:47 2022] PUT /identity/v3/projects/e441796f96954755b4d32bca3fa543c3/users/b4682b375c4742318bced81d396a1ce2/roles/d6e7421d1ff9451c808004b818354550 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:02:47.081723 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49cda64-5bda-4274-839c-63950fb75031 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:47.082349 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49cda64-5bda-4274-839c-63950fb75031 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:47.082630 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49cda64-5bda-4274-839c-63950fb75031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:47.110829 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-a49cda64-5bda-4274-839c-63950fb75031 None None] MFA Rules not processed for user `b4682b375c4742318bced81d396a1ce2`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:02:47.111991 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-a49cda64-5bda-4274-839c-63950fb75031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:47.178157 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-79ca053f-002b-4361-a76d-df92bead6cae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0d60a643d494a2a8cdaf9c62a398204', 'request_id': 'req-79ca053f-002b-4361-a76d-df92bead6cae'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:47.187106 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1010/2027] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:02:47 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 12:02:47.189736 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49cda64-5bda-4274-839c-63950fb75031 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:47.194044 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-a49cda64-5bda-4274-839c-63950fb75031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:47.266333 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49cda64-5bda-4274-839c-63950fb75031 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:47.318572 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-79ca053f-002b-4361-a76d-df92bead6cae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0d60a643d494a2a8cdaf9c62a398204', 'request_id': 'req-79ca053f-002b-4361-a76d-df92bead6cae'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:47.325720 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-79ca053f-002b-4361-a76d-df92bead6cae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0d60a643d494a2a8cdaf9c62a398204', 'request_id': 'req-79ca053f-002b-4361-a76d-df92bead6cae'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:47.333019 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6422322b-6e5a-44d5-a78e-1e3a2af55b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:47.333698 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6422322b-6e5a-44d5-a78e-1e3a2af55b56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:47.333979 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6422322b-6e5a-44d5-a78e-1e3a2af55b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:47.334257 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6422322b-6e5a-44d5-a78e-1e3a2af55b56 admin admin] PATH_INFO: `/v3/projects/821d979649064f748e03781247552ebd` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:47.335420 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6422322b-6e5a-44d5-a78e-1e3a2af55b56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=821d979649064f748e03781247552ebd)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:47.337384 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6422322b-6e5a-44d5-a78e-1e3a2af55b56 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:47.337972 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-79ca053f-002b-4361-a76d-df92bead6cae admin admin] The token cache is being invalidate because project c0d60a643d494a2a8cdaf9c62a398204 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:02:47.338357 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-79ca053f-002b-4361-a76d-df92bead6cae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:47.339102 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-79ca053f-002b-4361-a76d-df92bead6cae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:47.340727 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1018/2028] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Oct 4 12:02:47 2022] DELETE /identity/v3/projects/c0d60a643d494a2a8cdaf9c62a398204 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:02:47.344869 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ca053f-002b-4361-a76d-df92bead6cae admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:47.346519 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-79ca053f-002b-4361-a76d-df92bead6cae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:47.431851 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ca053f-002b-4361-a76d-df92bead6cae admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:47.436025 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b23f121-a485-429b-96b1-04acd3184d8e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e2a05b782424ab2928b5864f1bfd556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:47.436993 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b23f121-a485-429b-96b1-04acd3184d8e service cinder] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:47.437109 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b23f121-a485-429b-96b1-04acd3184d8e service cinder] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:47.437319 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b23f121-a485-429b-96b1-04acd3184d8e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:47.439219 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-1b23f121-a485-429b-96b1-04acd3184d8e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:47.499954 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b23f121-a485-429b-96b1-04acd3184d8e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:47.501457 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b23f121-a485-429b-96b1-04acd3184d8e service cinder] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:47.511343 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1019/2029] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:02:47 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:02:47.523447 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b23f121-a485-429b-96b1-04acd3184d8e service cinder] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:47.524906 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-1b23f121-a485-429b-96b1-04acd3184d8e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:47.527767 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-6422322b-6e5a-44d5-a78e-1e3a2af55b56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '821d979649064f748e03781247552ebd', 'request_id': 'req-6422322b-6e5a-44d5-a78e-1e3a2af55b56'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:47.536756 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-6422322b-6e5a-44d5-a78e-1e3a2af55b56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '821d979649064f748e03781247552ebd', 'request_id': 'req-6422322b-6e5a-44d5-a78e-1e3a2af55b56'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:47.545647 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b23f121-a485-429b-96b1-04acd3184d8e service cinder] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:47.605502 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a0a3fd-69a6-4cd9-8320-5286a629d9cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:47.606253 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a0a3fd-69a6-4cd9-8320-5286a629d9cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:47.606600 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a0a3fd-69a6-4cd9-8320-5286a629d9cd admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:47.606938 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a0a3fd-69a6-4cd9-8320-5286a629d9cd admin admin] PATH_INFO: `/v3/users/447d90a504c0488fb2def479e635c530` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:47.608136 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a0a3fd-69a6-4cd9-8320-5286a629d9cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=447d90a504c0488fb2def479e635c530)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:47.610571 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a0a3fd-69a6-4cd9-8320-5286a629d9cd admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:47.621147 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-6422322b-6e5a-44d5-a78e-1e3a2af55b56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '821d979649064f748e03781247552ebd', 'request_id': 'req-6422322b-6e5a-44d5-a78e-1e3a2af55b56'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:47.641897 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-6422322b-6e5a-44d5-a78e-1e3a2af55b56 admin admin] The token cache is being invalidate because project 821d979649064f748e03781247552ebd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:02:47.642252 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-6422322b-6e5a-44d5-a78e-1e3a2af55b56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:47.643059 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-6422322b-6e5a-44d5-a78e-1e3a2af55b56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:47.645587 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1011/2030] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Oct 4 12:02:47 2022] DELETE /identity/v3/projects/821d979649064f748e03781247552ebd => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:02:47.650355 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c51b03-6a93-4b0e-afa2-c8b6d44f56ab None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:47.650699 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c51b03-6a93-4b0e-afa2-c8b6d44f56ab None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:47.651067 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c51b03-6a93-4b0e-afa2-c8b6d44f56ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:47.681432 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-d7c51b03-6a93-4b0e-afa2-c8b6d44f56ab None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:02:47.682853 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-d7c51b03-6a93-4b0e-afa2-c8b6d44f56ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:47.691581 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1012/2031] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:02:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 12:02:47.700359 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dfa166-6ba5-464d-aab6-476d38bad3ec None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:47.700674 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dfa166-6ba5-464d-aab6-476d38bad3ec None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:47.700973 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dfa166-6ba5-464d-aab6-476d38bad3ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:47.720994 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-a9dfa166-6ba5-464d-aab6-476d38bad3ec None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:02:47.722268 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-a9dfa166-6ba5-464d-aab6-476d38bad3ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:47.730230 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1013/2032] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:02:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:02:47.734221 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dfa166-6ba5-464d-aab6-476d38bad3ec None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:47.743884 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dfa166-6ba5-464d-aab6-476d38bad3ec None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:47.748802 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f04f59-4389-4bcf-9d41-0d27881ccb22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:47.749519 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f04f59-4389-4bcf-9d41-0d27881ccb22 admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:47.749792 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f04f59-4389-4bcf-9d41-0d27881ccb22 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:47.750087 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f04f59-4389-4bcf-9d41-0d27881ccb22 admin admin] PATH_INFO: `/v3/domains` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:47.750711 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f04f59-4389-4bcf-9d41-0d27881ccb22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:02:47.751009 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f04f59-4389-4bcf-9d41-0d27881ccb22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:47.752624 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f04f59-4389-4bcf-9d41-0d27881ccb22 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:47.765080 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1014/2033] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Oct 4 12:02:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 12:02:47.782808 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f04f59-4389-4bcf-9d41-0d27881ccb22 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:47.794142 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f04f59-4389-4bcf-9d41-0d27881ccb22 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:47.798886 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584fb028-8d45-47ef-96c3-3d19e025da24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:47.799485 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584fb028-8d45-47ef-96c3-3d19e025da24 admin admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:47.800280 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584fb028-8d45-47ef-96c3-3d19e025da24 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:47.801135 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584fb028-8d45-47ef-96c3-3d19e025da24 admin admin] PATH_INFO: `/v3/projects` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:47.801344 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584fb028-8d45-47ef-96c3-3d19e025da24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:47.803085 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584fb028-8d45-47ef-96c3-3d19e025da24 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:47.844156 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:02:47.943576 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-25a0a3fd-69a6-4cd9-8320-5286a629d9cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '447d90a504c0488fb2def479e635c530'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:47.950448 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-25a0a3fd-69a6-4cd9-8320-5286a629d9cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '447d90a504c0488fb2def479e635c530'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:47.951091 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-25a0a3fd-69a6-4cd9-8320-5286a629d9cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '447d90a504c0488fb2def479e635c530'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:47.951682 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-25a0a3fd-69a6-4cd9-8320-5286a629d9cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '447d90a504c0488fb2def479e635c530'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:48.036667 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1015/2034] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Oct 4 12:02:47 2022] POST /identity/v3/projects => generated 383 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 12:02:48.041024 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584fb028-8d45-47ef-96c3-3d19e025da24 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:48.043610 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-584fb028-8d45-47ef-96c3-3d19e025da24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:48.060487 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-25a0a3fd-69a6-4cd9-8320-5286a629d9cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '447d90a504c0488fb2def479e635c530'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:48.080195 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1020/2035] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Oct 4 12:02:47 2022] DELETE /identity/v3/users/447d90a504c0488fb2def479e635c530 => generated 0 bytes in 567 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:02:48.116737 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584fb028-8d45-47ef-96c3-3d19e025da24 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:48.178748 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e5ae85-65a4-4cf0-b10e-f2dd7dc7d374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:48.181199 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e5ae85-65a4-4cf0-b10e-f2dd7dc7d374 admin admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:48.181509 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e5ae85-65a4-4cf0-b10e-f2dd7dc7d374 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:48.181783 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e5ae85-65a4-4cf0-b10e-f2dd7dc7d374 admin admin] PATH_INFO: `/v3/users` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:48.182449 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e5ae85-65a4-4cf0-b10e-f2dd7dc7d374 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:48.197660 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e5ae85-65a4-4cf0-b10e-f2dd7dc7d374 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:48.311336 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1016/2036] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Oct 4 12:02:48 2022] POST /identity/v3/users => generated 292 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 12:02:48.312815 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a0a3fd-69a6-4cd9-8320-5286a629d9cd admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:48.326071 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a0a3fd-69a6-4cd9-8320-5286a629d9cd admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:48.336999 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d16afe-37d1-48a9-8fd7-2a28ac4cd10b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:48.337886 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d16afe-37d1-48a9-8fd7-2a28ac4cd10b admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:48.338464 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d16afe-37d1-48a9-8fd7-2a28ac4cd10b admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:48.338936 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d16afe-37d1-48a9-8fd7-2a28ac4cd10b admin admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:48.339767 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d16afe-37d1-48a9-8fd7-2a28ac4cd10b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:48.343507 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d16afe-37d1-48a9-8fd7-2a28ac4cd10b admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:48.366560 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1021/2037] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:02:48 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:02:48.367226 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e5ae85-65a4-4cf0-b10e-f2dd7dc7d374 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:48.378849 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e5ae85-65a4-4cf0-b10e-f2dd7dc7d374 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:48.385136 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ddfd71-ca0d-4163-844d-b6f7bf2d28ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:48.386703 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ddfd71-ca0d-4163-844d-b6f7bf2d28ce admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:48.387413 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ddfd71-ca0d-4163-844d-b6f7bf2d28ce admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:48.387904 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ddfd71-ca0d-4163-844d-b6f7bf2d28ce admin admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:48.388806 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ddfd71-ca0d-4163-844d-b6f7bf2d28ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:48.390695 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ddfd71-ca0d-4163-844d-b6f7bf2d28ce admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:48.420877 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1017/2038] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:02:48 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:02:48.426149 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d16afe-37d1-48a9-8fd7-2a28ac4cd10b admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:48.443330 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d16afe-37d1-48a9-8fd7-2a28ac4cd10b admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:48.450514 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba94f767-020e-47f7-bf31-28eb886fdcc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:48.451418 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba94f767-020e-47f7-bf31-28eb886fdcc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:48.452565 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba94f767-020e-47f7-bf31-28eb886fdcc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:48.452889 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba94f767-020e-47f7-bf31-28eb886fdcc7 admin admin] PATH_INFO: `/v3/projects/f0ab98781d4e41a5a42d7ae255336ac5/users/8c01d9eceb7945f6a9ba6c1a2ec813ff/roles/ab4307f3b7994c1c80036fa7db93b6b9` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:48.481429 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba94f767-020e-47f7-bf31-28eb886fdcc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0ab98781d4e41a5a42d7ae255336ac5, user_id=8c01d9eceb7945f6a9ba6c1a2ec813ff, role_id=ab4307f3b7994c1c80036fa7db93b6b9)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:48.484456 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba94f767-020e-47f7-bf31-28eb886fdcc7 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:48.620765 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1022/2039] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Oct 4 12:02:48 2022] PUT /identity/v3/projects/f0ab98781d4e41a5a42d7ae255336ac5/users/8c01d9eceb7945f6a9ba6c1a2ec813ff/roles/ab4307f3b7994c1c80036fa7db93b6b9 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:02:48.631844 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5481546-96f7-4a65-bd96-9fe7a47a65fe None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:48.632145 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5481546-96f7-4a65-bd96-9fe7a47a65fe None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:48.632428 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5481546-96f7-4a65-bd96-9fe7a47a65fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:48.661234 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba94f767-020e-47f7-bf31-28eb886fdcc7 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:48.665868 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-ba94f767-020e-47f7-bf31-28eb886fdcc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:48.686421 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-d5481546-96f7-4a65-bd96-9fe7a47a65fe None None] MFA Rules not processed for user `8c01d9eceb7945f6a9ba6c1a2ec813ff`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:02:48.686421 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-d5481546-96f7-4a65-bd96-9fe7a47a65fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:48.776675 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba94f767-020e-47f7-bf31-28eb886fdcc7 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:48.780414 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1018/2040] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:02:48 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:02:48.784673 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37806a98-ef65-404f-ba98-8ef24f943d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:48.784673 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37806a98-ef65-404f-ba98-8ef24f943d5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:48.784673 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37806a98-ef65-404f-ba98-8ef24f943d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:48.784673 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37806a98-ef65-404f-ba98-8ef24f943d5a admin admin] PATH_INFO: `/v3/projects/2fffb0c430ce48108ff76c21dfc6b67f` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:48.792345 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37806a98-ef65-404f-ba98-8ef24f943d5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fffb0c430ce48108ff76c21dfc6b67f)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:48.792345 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37806a98-ef65-404f-ba98-8ef24f943d5a admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:48.793190 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5481546-96f7-4a65-bd96-9fe7a47a65fe None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:48.794628 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-d5481546-96f7-4a65-bd96-9fe7a47a65fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:48.852967 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5481546-96f7-4a65-bd96-9fe7a47a65fe None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:48.856718 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed83783-4b77-4d6f-aaff-15e58abfe3c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e2a05b782424ab2928b5864f1bfd556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:48.857345 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed83783-4b77-4d6f-aaff-15e58abfe3c0 service cinder] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:48.857638 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed83783-4b77-4d6f-aaff-15e58abfe3c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:48.857912 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed83783-4b77-4d6f-aaff-15e58abfe3c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:48.867245 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed83783-4b77-4d6f-aaff-15e58abfe3c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:48.868917 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed83783-4b77-4d6f-aaff-15e58abfe3c0 service cinder] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:48.879247 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1019/2041] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:02:48 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 12:02:48.899178 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed83783-4b77-4d6f-aaff-15e58abfe3c0 service cinder] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:48.910107 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed83783-4b77-4d6f-aaff-15e58abfe3c0 service cinder] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:48.914837 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b43029-ab75-4828-a597-26d5272de95e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:48.915460 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b43029-ab75-4828-a597-26d5272de95e admin admin] REQUEST_METHOD: `DELETE` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:48.915742 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b43029-ab75-4828-a597-26d5272de95e admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:48.916021 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b43029-ab75-4828-a597-26d5272de95e admin admin] PATH_INFO: `/v3/users/8c01d9eceb7945f6a9ba6c1a2ec813ff` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:48.917186 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b43029-ab75-4828-a597-26d5272de95e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c01d9eceb7945f6a9ba6c1a2ec813ff)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:48.919267 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b43029-ab75-4828-a597-26d5272de95e admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:48.957848 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-37806a98-ef65-404f-ba98-8ef24f943d5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fffb0c430ce48108ff76c21dfc6b67f', 'request_id': 'req-37806a98-ef65-404f-ba98-8ef24f943d5a'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:49.123688 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-37806a98-ef65-404f-ba98-8ef24f943d5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fffb0c430ce48108ff76c21dfc6b67f', 'request_id': 'req-37806a98-ef65-404f-ba98-8ef24f943d5a'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:49.131141 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-37806a98-ef65-404f-ba98-8ef24f943d5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fffb0c430ce48108ff76c21dfc6b67f', 'request_id': 'req-37806a98-ef65-404f-ba98-8ef24f943d5a'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:49.141660 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-37806a98-ef65-404f-ba98-8ef24f943d5a admin admin] The token cache is being invalidate because project 2fffb0c430ce48108ff76c21dfc6b67f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:02:49.141973 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-37806a98-ef65-404f-ba98-8ef24f943d5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:49.142630 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-37806a98-ef65-404f-ba98-8ef24f943d5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:49.144194 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1023/2042] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Oct 4 12:02:48 2022] DELETE /identity/v3/projects/2fffb0c430ce48108ff76c21dfc6b67f => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:02:49.148822 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33278108-27fd-4920-9bc3-ff2ddb891ae3 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:49.149110 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33278108-27fd-4920-9bc3-ff2ddb891ae3 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:49.149386 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33278108-27fd-4920-9bc3-ff2ddb891ae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:49.168116 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-33278108-27fd-4920-9bc3-ff2ddb891ae3 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:02:49.169350 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-33278108-27fd-4920-9bc3-ff2ddb891ae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:49.229223 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1024/2043] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:02:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 12:02:49.235689 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-c2b43029-ab75-4828-a597-26d5272de95e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c01d9eceb7945f6a9ba6c1a2ec813ff'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:49.237099 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e60d5f-6e95-470b-bad9-4d47d288e6a6 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:49.237991 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e60d5f-6e95-470b-bad9-4d47d288e6a6 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:49.238300 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e60d5f-6e95-470b-bad9-4d47d288e6a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:49.245489 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-c2b43029-ab75-4828-a597-26d5272de95e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c01d9eceb7945f6a9ba6c1a2ec813ff'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:49.246335 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-c2b43029-ab75-4828-a597-26d5272de95e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c01d9eceb7945f6a9ba6c1a2ec813ff'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:49.247756 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-c2b43029-ab75-4828-a597-26d5272de95e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c01d9eceb7945f6a9ba6c1a2ec813ff'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:49.256258 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:02:49.258248 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-66e60d5f-6e95-470b-bad9-4d47d288e6a6 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:02:49.259448 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-66e60d5f-6e95-470b-bad9-4d47d288e6a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:49.267265 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1025/2044] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:02:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 12:02:49.275782 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e60d5f-6e95-470b-bad9-4d47d288e6a6 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:49.286207 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e60d5f-6e95-470b-bad9-4d47d288e6a6 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:49.292144 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55d1896-0434-4a66-90d1-f6cfc4034425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:49.292798 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55d1896-0434-4a66-90d1-f6cfc4034425 admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:49.293080 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55d1896-0434-4a66-90d1-f6cfc4034425 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:49.293351 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55d1896-0434-4a66-90d1-f6cfc4034425 admin admin] PATH_INFO: `/v3/domains` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:49.294008 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55d1896-0434-4a66-90d1-f6cfc4034425 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:02:49.294312 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55d1896-0434-4a66-90d1-f6cfc4034425 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:49.295941 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55d1896-0434-4a66-90d1-f6cfc4034425 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:49.308967 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1026/2045] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Oct 4 12:02:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 12:02:49.316963 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55d1896-0434-4a66-90d1-f6cfc4034425 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:49.326648 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55d1896-0434-4a66-90d1-f6cfc4034425 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:49.331466 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e634b9b-e30f-470d-8e22-7e6aaf646c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:49.332038 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e634b9b-e30f-470d-8e22-7e6aaf646c72 admin admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:49.332315 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e634b9b-e30f-470d-8e22-7e6aaf646c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:49.332585 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e634b9b-e30f-470d-8e22-7e6aaf646c72 admin admin] PATH_INFO: `/v3/projects` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:49.333311 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e634b9b-e30f-470d-8e22-7e6aaf646c72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:49.334889 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-c2b43029-ab75-4828-a597-26d5272de95e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c01d9eceb7945f6a9ba6c1a2ec813ff'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:49.335283 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e634b9b-e30f-470d-8e22-7e6aaf646c72 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:49.353304 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1020/2046] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Oct 4 12:02:48 2022] DELETE /identity/v3/users/8c01d9eceb7945f6a9ba6c1a2ec813ff => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:02:49.357747 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0acf0e-f3a8-4ef3-958b-6ae5b1478a68 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:49.358040 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0acf0e-f3a8-4ef3-958b-6ae5b1478a68 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:49.358319 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0acf0e-f3a8-4ef3-958b-6ae5b1478a68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:49.378371 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-cd0acf0e-f3a8-4ef3-958b-6ae5b1478a68 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:02:49.379611 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-cd0acf0e-f3a8-4ef3-958b-6ae5b1478a68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:49.444868 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1021/2047] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:02:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 12:02:49.449023 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1027/2048] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Oct 4 12:02:49 2022] POST /identity/v3/projects => generated 391 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 12:02:49.450610 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0acf0e-f3a8-4ef3-958b-6ae5b1478a68 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:49.454541 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e634b9b-e30f-470d-8e22-7e6aaf646c72 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:49.457184 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-5e634b9b-e30f-470d-8e22-7e6aaf646c72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:49.472926 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0acf0e-f3a8-4ef3-958b-6ae5b1478a68 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:49.518935 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e634b9b-e30f-470d-8e22-7e6aaf646c72 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:49.529352 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b406512-1510-4de1-8610-10522e28ccf8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7289515c5c44914a19daa439de98cb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:49.530002 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b406512-1510-4de1-8610-10522e28ccf8 service neutron] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:49.530291 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b406512-1510-4de1-8610-10522e28ccf8 service neutron] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:49.530592 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b406512-1510-4de1-8610-10522e28ccf8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:49.535696 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254cd2a2-186e-468b-82ea-e6f3f90aae72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:49.536439 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254cd2a2-186e-468b-82ea-e6f3f90aae72 admin admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:49.536756 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254cd2a2-186e-468b-82ea-e6f3f90aae72 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:49.537032 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254cd2a2-186e-468b-82ea-e6f3f90aae72 admin admin] PATH_INFO: `/v3/users` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:49.537684 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254cd2a2-186e-468b-82ea-e6f3f90aae72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:49.539876 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254cd2a2-186e-468b-82ea-e6f3f90aae72 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:49.541876 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b406512-1510-4de1-8610-10522e28ccf8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:49.551498 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b406512-1510-4de1-8610-10522e28ccf8 service neutron] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:49.554934 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1028/2049] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:02:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 12:02:49.767854 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1022/2050] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Oct 4 12:02:49 2022] POST /identity/v3/users => generated 296 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 12:02:49.768155 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b406512-1510-4de1-8610-10522e28ccf8 service neutron] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:49.772378 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b406512-1510-4de1-8610-10522e28ccf8 service neutron] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:49.777169 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bbe1ad-f5e9-4212-ba5d-37aff65b2a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:49.777785 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bbe1ad-f5e9-4212-ba5d-37aff65b2a10 admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:49.778061 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bbe1ad-f5e9-4212-ba5d-37aff65b2a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:49.778326 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bbe1ad-f5e9-4212-ba5d-37aff65b2a10 admin admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:49.778952 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bbe1ad-f5e9-4212-ba5d-37aff65b2a10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:49.780536 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bbe1ad-f5e9-4212-ba5d-37aff65b2a10 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:49.791113 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1029/2051] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:02:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:02:49.794906 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254cd2a2-186e-468b-82ea-e6f3f90aae72 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:49.807639 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254cd2a2-186e-468b-82ea-e6f3f90aae72 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:49.812550 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff8aac6-c6b6-4593-9e60-b473879b32bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:49.826495 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff8aac6-c6b6-4593-9e60-b473879b32bc admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:49.826495 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff8aac6-c6b6-4593-9e60-b473879b32bc admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:49.826495 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff8aac6-c6b6-4593-9e60-b473879b32bc admin admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:49.826495 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff8aac6-c6b6-4593-9e60-b473879b32bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:49.826495 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff8aac6-c6b6-4593-9e60-b473879b32bc admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:49.827143 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1023/2052] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:02:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:02:49.831483 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bbe1ad-f5e9-4212-ba5d-37aff65b2a10 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:49.842105 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bbe1ad-f5e9-4212-ba5d-37aff65b2a10 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:49.846960 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4e655e-dce4-47b7-8dc5-26fd7d9bdedd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:49.847528 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4e655e-dce4-47b7-8dc5-26fd7d9bdedd admin admin] REQUEST_METHOD: `PUT` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:49.847809 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4e655e-dce4-47b7-8dc5-26fd7d9bdedd admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:49.848272 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4e655e-dce4-47b7-8dc5-26fd7d9bdedd admin admin] PATH_INFO: `/v3/projects/2fa5ef6f6e76444785a78a4a4ca138a5/users/67332065d6a44c1586f6e6517912fc21/roles/ab4307f3b7994c1c80036fa7db93b6b9` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:49.864316 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4e655e-dce4-47b7-8dc5-26fd7d9bdedd admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fa5ef6f6e76444785a78a4a4ca138a5, user_id=67332065d6a44c1586f6e6517912fc21, role_id=ab4307f3b7994c1c80036fa7db93b6b9)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:49.867053 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4e655e-dce4-47b7-8dc5-26fd7d9bdedd admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:50.038423 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1030/2053] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Oct 4 12:02:49 2022] PUT /identity/v3/projects/2fa5ef6f6e76444785a78a4a4ca138a5/users/67332065d6a44c1586f6e6517912fc21/roles/ab4307f3b7994c1c80036fa7db93b6b9 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:02:50.060462 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa0c4ff-8b9a-4034-aa8d-db7bf135ab31 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:50.060462 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa0c4ff-8b9a-4034-aa8d-db7bf135ab31 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:50.060462 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa0c4ff-8b9a-4034-aa8d-db7bf135ab31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:50.108831 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4e655e-dce4-47b7-8dc5-26fd7d9bdedd admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:50.110788 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-fc4e655e-dce4-47b7-8dc5-26fd7d9bdedd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:50.112300 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-8fa0c4ff-8b9a-4034-aa8d-db7bf135ab31 None None] MFA Rules not processed for user `67332065d6a44c1586f6e6517912fc21`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:02:50.113690 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-8fa0c4ff-8b9a-4034-aa8d-db7bf135ab31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:50.178996 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4e655e-dce4-47b7-8dc5-26fd7d9bdedd admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:50.182571 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68953ed6-3408-4f2b-9c17-518f8a9b5c01 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e2a05b782424ab2928b5864f1bfd556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:50.183279 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1024/2054] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:02:50 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 12:02:50.183408 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68953ed6-3408-4f2b-9c17-518f8a9b5c01 service cinder] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:50.183408 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68953ed6-3408-4f2b-9c17-518f8a9b5c01 service cinder] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:50.183699 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68953ed6-3408-4f2b-9c17-518f8a9b5c01 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:50.185459 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-68953ed6-3408-4f2b-9c17-518f8a9b5c01 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:50.187461 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa0c4ff-8b9a-4034-aa8d-db7bf135ab31 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:50.260521 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68953ed6-3408-4f2b-9c17-518f8a9b5c01 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:50.262028 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68953ed6-3408-4f2b-9c17-518f8a9b5c01 service cinder] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:50.268695 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa0c4ff-8b9a-4034-aa8d-db7bf135ab31 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:50.271671 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1031/2055] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:02:50 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 12:02:50.274423 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ea4dea-52ce-4d5e-b862-24671779be91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:50.275036 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ea4dea-52ce-4d5e-b862-24671779be91 admin admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:50.275323 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ea4dea-52ce-4d5e-b862-24671779be91 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:50.275603 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ea4dea-52ce-4d5e-b862-24671779be91 admin admin] PATH_INFO: `/v3/projects` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:50.276235 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ea4dea-52ce-4d5e-b862-24671779be91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:50.278160 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ea4dea-52ce-4d5e-b862-24671779be91 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:50.337484 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68953ed6-3408-4f2b-9c17-518f8a9b5c01 service cinder] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:50.339705 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-68953ed6-3408-4f2b-9c17-518f8a9b5c01 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:50.380167 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68953ed6-3408-4f2b-9c17-518f8a9b5c01 service cinder] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:50.388082 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4251c4d6-9adf-413c-b9db-7b40694c4f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:50.389068 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4251c4d6-9adf-413c-b9db-7b40694c4f69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:50.389529 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4251c4d6-9adf-413c-b9db-7b40694c4f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:50.389979 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4251c4d6-9adf-413c-b9db-7b40694c4f69 admin admin] PATH_INFO: `/v3/projects/f0ab98781d4e41a5a42d7ae255336ac5` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:50.391317 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4251c4d6-9adf-413c-b9db-7b40694c4f69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0ab98781d4e41a5a42d7ae255336ac5)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:50.394037 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4251c4d6-9adf-413c-b9db-7b40694c4f69 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:50.411261 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1025/2056] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Oct 4 12:02:50 2022] POST /identity/v3/projects => generated 393 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 12:02:50.415359 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ea4dea-52ce-4d5e-b862-24671779be91 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:50.483589 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ea4dea-52ce-4d5e-b862-24671779be91 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:50.490783 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64ca666-666d-437a-8919-cc1f01125907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:50.491403 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64ca666-666d-437a-8919-cc1f01125907 admin admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:50.493052 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64ca666-666d-437a-8919-cc1f01125907 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:50.493052 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64ca666-666d-437a-8919-cc1f01125907 admin admin] PATH_INFO: `/v3/users` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:50.493052 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64ca666-666d-437a-8919-cc1f01125907 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:50.494685 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64ca666-666d-437a-8919-cc1f01125907 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:50.599135 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-4251c4d6-9adf-413c-b9db-7b40694c4f69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0ab98781d4e41a5a42d7ae255336ac5', 'request_id': 'req-4251c4d6-9adf-413c-b9db-7b40694c4f69'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:50.611258 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1026/2057] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Oct 4 12:02:50 2022] POST /identity/v3/users => generated 303 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:02:50.615361 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64ca666-666d-437a-8919-cc1f01125907 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:50.624983 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64ca666-666d-437a-8919-cc1f01125907 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:50.682917 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c88427-d3bc-44ea-8b45-60547b759c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:50.683541 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c88427-d3bc-44ea-8b45-60547b759c2c admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:50.683820 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c88427-d3bc-44ea-8b45-60547b759c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:50.684093 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c88427-d3bc-44ea-8b45-60547b759c2c admin admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:50.684774 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c88427-d3bc-44ea-8b45-60547b759c2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:50.686371 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c88427-d3bc-44ea-8b45-60547b759c2c admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:50.696727 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1027/2058] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:02:50 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:02:50.700840 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c88427-d3bc-44ea-8b45-60547b759c2c admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:50.711722 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c88427-d3bc-44ea-8b45-60547b759c2c admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:50.716377 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7924c168-9e4e-4e52-9264-a9bb287ad416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:50.717066 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7924c168-9e4e-4e52-9264-a9bb287ad416 admin admin] REQUEST_METHOD: `PUT` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:50.717458 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7924c168-9e4e-4e52-9264-a9bb287ad416 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:50.717771 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7924c168-9e4e-4e52-9264-a9bb287ad416 admin admin] PATH_INFO: `/v3/projects/d3f9e482d2cd45b692a381c2a75c1301/users/0cdefb29128f46f881066cdb9211008f/roles/d6e7421d1ff9451c808004b818354550` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:50.744066 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-4251c4d6-9adf-413c-b9db-7b40694c4f69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0ab98781d4e41a5a42d7ae255336ac5', 'request_id': 'req-4251c4d6-9adf-413c-b9db-7b40694c4f69'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:50.744288 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7924c168-9e4e-4e52-9264-a9bb287ad416 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3f9e482d2cd45b692a381c2a75c1301, user_id=0cdefb29128f46f881066cdb9211008f, role_id=d6e7421d1ff9451c808004b818354550)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:50.747384 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7924c168-9e4e-4e52-9264-a9bb287ad416 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:50.751561 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-4251c4d6-9adf-413c-b9db-7b40694c4f69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0ab98781d4e41a5a42d7ae255336ac5', 'request_id': 'req-4251c4d6-9adf-413c-b9db-7b40694c4f69'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:50.762842 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-4251c4d6-9adf-413c-b9db-7b40694c4f69 admin admin] The token cache is being invalidate because project f0ab98781d4e41a5a42d7ae255336ac5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:02:50.763129 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-4251c4d6-9adf-413c-b9db-7b40694c4f69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:50.763795 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-4251c4d6-9adf-413c-b9db-7b40694c4f69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:50.769457 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1032/2059] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Oct 4 12:02:50 2022] DELETE /identity/v3/projects/f0ab98781d4e41a5a42d7ae255336ac5 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:02:50.770731 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7b3aa5-5781-4be1-8537-7232bdf4766c None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:50.771018 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7b3aa5-5781-4be1-8537-7232bdf4766c None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:50.771294 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7b3aa5-5781-4be1-8537-7232bdf4766c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:50.791053 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-0c7b3aa5-5781-4be1-8537-7232bdf4766c None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:02:50.792252 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-0c7b3aa5-5781-4be1-8537-7232bdf4766c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:50.802431 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1033/2060] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:02:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:02:50.810080 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c936b4-7b04-4a9f-b90c-689c9ac30820 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:50.810494 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c936b4-7b04-4a9f-b90c-689c9ac30820 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:50.810775 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c936b4-7b04-4a9f-b90c-689c9ac30820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:50.833436 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-14c936b4-7b04-4a9f-b90c-689c9ac30820 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:02:50.834637 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-14c936b4-7b04-4a9f-b90c-689c9ac30820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:50.842912 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1034/2061] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:02:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 12:02:50.847692 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c936b4-7b04-4a9f-b90c-689c9ac30820 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:50.856503 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c936b4-7b04-4a9f-b90c-689c9ac30820 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:50.861561 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516f0e39-71bb-49ae-92ad-f0b3de79ca65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:50.862202 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516f0e39-71bb-49ae-92ad-f0b3de79ca65 admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:50.862478 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516f0e39-71bb-49ae-92ad-f0b3de79ca65 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:50.862869 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516f0e39-71bb-49ae-92ad-f0b3de79ca65 admin admin] PATH_INFO: `/v3/domains` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:50.863381 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516f0e39-71bb-49ae-92ad-f0b3de79ca65 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:02:50.863737 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516f0e39-71bb-49ae-92ad-f0b3de79ca65 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:50.865478 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516f0e39-71bb-49ae-92ad-f0b3de79ca65 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:50.886355 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1035/2062] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Oct 4 12:02:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 12:02:50.892455 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516f0e39-71bb-49ae-92ad-f0b3de79ca65 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:50.904135 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516f0e39-71bb-49ae-92ad-f0b3de79ca65 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:50.912240 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83e7a5a-beba-45d0-89f9-480780bac3be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:50.912885 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83e7a5a-beba-45d0-89f9-480780bac3be admin admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:50.913315 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83e7a5a-beba-45d0-89f9-480780bac3be admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:50.914190 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83e7a5a-beba-45d0-89f9-480780bac3be admin admin] PATH_INFO: `/v3/projects` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:50.914190 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83e7a5a-beba-45d0-89f9-480780bac3be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:50.916161 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83e7a5a-beba-45d0-89f9-480780bac3be admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:50.926684 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1028/2063] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Oct 4 12:02:50 2022] PUT /identity/v3/projects/d3f9e482d2cd45b692a381c2a75c1301/users/0cdefb29128f46f881066cdb9211008f/roles/d6e7421d1ff9451c808004b818354550 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:02:50.932386 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7924c168-9e4e-4e52-9264-a9bb287ad416 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:50.935624 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-7924c168-9e4e-4e52-9264-a9bb287ad416 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:51.010327 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7924c168-9e4e-4e52-9264-a9bb287ad416 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:51.015833 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78e5ce8-702e-4c74-8b63-961a73d64428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:51.016857 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78e5ce8-702e-4c74-8b63-961a73d64428 admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:51.017293 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78e5ce8-702e-4c74-8b63-961a73d64428 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:51.017678 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78e5ce8-702e-4c74-8b63-961a73d64428 admin admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:51.018346 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78e5ce8-702e-4c74-8b63-961a73d64428 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:51.020042 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78e5ce8-702e-4c74-8b63-961a73d64428 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:51.030651 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1029/2064] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:02:50 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:02:51.035461 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78e5ce8-702e-4c74-8b63-961a73d64428 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:51.045250 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78e5ce8-702e-4c74-8b63-961a73d64428 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:51.049725 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989092d2-a08e-43f9-95c7-0e95e0577f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:51.050356 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989092d2-a08e-43f9-95c7-0e95e0577f09 admin admin] REQUEST_METHOD: `PUT` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:51.050635 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989092d2-a08e-43f9-95c7-0e95e0577f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:51.050908 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989092d2-a08e-43f9-95c7-0e95e0577f09 admin admin] PATH_INFO: `/v3/projects/d3f9e482d2cd45b692a381c2a75c1301/users/0cdefb29128f46f881066cdb9211008f/roles/d6e7421d1ff9451c808004b818354550` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:51.052816 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989092d2-a08e-43f9-95c7-0e95e0577f09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3f9e482d2cd45b692a381c2a75c1301, user_id=0cdefb29128f46f881066cdb9211008f, role_id=d6e7421d1ff9451c808004b818354550)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:51.055419 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989092d2-a08e-43f9-95c7-0e95e0577f09 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:51.066429 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1030/2065] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Oct 4 12:02:51 2022] PUT /identity/v3/projects/d3f9e482d2cd45b692a381c2a75c1301/users/0cdefb29128f46f881066cdb9211008f/roles/d6e7421d1ff9451c808004b818354550 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:02:51.076368 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db10495-1f16-4b8a-b913-39f7953cffad None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:51.076686 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db10495-1f16-4b8a-b913-39f7953cffad None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:51.076967 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db10495-1f16-4b8a-b913-39f7953cffad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:51.105900 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-4db10495-1f16-4b8a-b913-39f7953cffad None None] MFA Rules not processed for user `0cdefb29128f46f881066cdb9211008f`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:02:51.107159 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-4db10495-1f16-4b8a-b913-39f7953cffad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:51.109734 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1036/2066] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Oct 4 12:02:50 2022] POST /identity/v3/projects => generated 369 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 12:02:51.117104 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83e7a5a-beba-45d0-89f9-480780bac3be admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:51.187898 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83e7a5a-beba-45d0-89f9-480780bac3be admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:51.192121 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1031/2067] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:02:51 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 12:02:51.193839 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0d12d0-b60b-4b3a-ab65-741507ad2ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:51.194448 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0d12d0-b60b-4b3a-ab65-741507ad2ec7 admin admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:51.194730 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0d12d0-b60b-4b3a-ab65-741507ad2ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:51.195003 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0d12d0-b60b-4b3a-ab65-741507ad2ec7 admin admin] PATH_INFO: `/v3/users` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:51.195635 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0d12d0-b60b-4b3a-ab65-741507ad2ec7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:51.197703 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0d12d0-b60b-4b3a-ab65-741507ad2ec7 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:51.203628 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db10495-1f16-4b8a-b913-39f7953cffad None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:51.205126 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-4db10495-1f16-4b8a-b913-39f7953cffad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:51.263233 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db10495-1f16-4b8a-b913-39f7953cffad None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:51.266848 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979224e0-c196-4a57-b025-8e4735c23f0e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e2a05b782424ab2928b5864f1bfd556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:51.267491 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979224e0-c196-4a57-b025-8e4735c23f0e service cinder] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:51.267768 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979224e0-c196-4a57-b025-8e4735c23f0e service cinder] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:51.268149 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979224e0-c196-4a57-b025-8e4735c23f0e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:51.278104 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979224e0-c196-4a57-b025-8e4735c23f0e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:51.279519 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979224e0-c196-4a57-b025-8e4735c23f0e service cinder] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:51.289925 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1032/2068] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:02:51 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 12:02:51.341212 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979224e0-c196-4a57-b025-8e4735c23f0e service cinder] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:51.350415 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979224e0-c196-4a57-b025-8e4735c23f0e service cinder] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:51.354141 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78485eac-72ea-4b05-b19f-72b54673e778 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e2a05b782424ab2928b5864f1bfd556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:51.354732 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78485eac-72ea-4b05-b19f-72b54673e778 service cinder] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:51.355373 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78485eac-72ea-4b05-b19f-72b54673e778 service cinder] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:51.355649 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78485eac-72ea-4b05-b19f-72b54673e778 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:51.357557 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-78485eac-72ea-4b05-b19f-72b54673e778 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:51.386340 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1037/2069] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Oct 4 12:02:51 2022] POST /identity/v3/users => generated 285 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 12:02:51.390251 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0d12d0-b60b-4b3a-ab65-741507ad2ec7 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:51.400961 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0d12d0-b60b-4b3a-ab65-741507ad2ec7 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:51.406425 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36abeefb-858f-4e5d-95e4-0531ba1b4023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:51.407031 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36abeefb-858f-4e5d-95e4-0531ba1b4023 admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:51.407315 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36abeefb-858f-4e5d-95e4-0531ba1b4023 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:51.407591 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36abeefb-858f-4e5d-95e4-0531ba1b4023 admin admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:51.408236 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36abeefb-858f-4e5d-95e4-0531ba1b4023 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:51.410687 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36abeefb-858f-4e5d-95e4-0531ba1b4023 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:51.422137 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1038/2070] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:02:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 12:02:51.422302 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78485eac-72ea-4b05-b19f-72b54673e778 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:51.422507 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78485eac-72ea-4b05-b19f-72b54673e778 service cinder] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:51.428400 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36abeefb-858f-4e5d-95e4-0531ba1b4023 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:51.431872 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1033/2071] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:02:51 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 12:02:51.438275 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36abeefb-858f-4e5d-95e4-0531ba1b4023 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:51.443685 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7150fb-a84d-4dc7-98a9-3936e2e178ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:51.444288 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7150fb-a84d-4dc7-98a9-3936e2e178ee admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:51.444570 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7150fb-a84d-4dc7-98a9-3936e2e178ee admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:51.444906 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7150fb-a84d-4dc7-98a9-3936e2e178ee admin admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:51.445542 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7150fb-a84d-4dc7-98a9-3936e2e178ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:51.447129 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7150fb-a84d-4dc7-98a9-3936e2e178ee admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:51.459239 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1039/2072] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:02:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 12:02:51.468834 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78485eac-72ea-4b05-b19f-72b54673e778 service cinder] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:51.482874 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78485eac-72ea-4b05-b19f-72b54673e778 service cinder] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:51.488300 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81f23d6-4799-4d2e-afd6-40c6583cf456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:51.489006 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81f23d6-4799-4d2e-afd6-40c6583cf456 admin admin] REQUEST_METHOD: `PUT` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:51.490143 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81f23d6-4799-4d2e-afd6-40c6583cf456 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:51.490426 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81f23d6-4799-4d2e-afd6-40c6583cf456 admin admin] PATH_INFO: `/v3/projects/16d2cb08fdb645acac9fb7710b30c5a5/users/443fe822f665431fbd578804ac37b819/roles/ab4307f3b7994c1c80036fa7db93b6b9` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:51.509281 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81f23d6-4799-4d2e-afd6-40c6583cf456 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16d2cb08fdb645acac9fb7710b30c5a5, user_id=443fe822f665431fbd578804ac37b819, role_id=ab4307f3b7994c1c80036fa7db93b6b9)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:51.513418 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81f23d6-4799-4d2e-afd6-40c6583cf456 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:51.673129 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1034/2073] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Oct 4 12:02:51 2022] PUT /identity/v3/projects/16d2cb08fdb645acac9fb7710b30c5a5/users/443fe822f665431fbd578804ac37b819/roles/ab4307f3b7994c1c80036fa7db93b6b9 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:02:51.684230 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c54207-ded3-484a-8a9d-2c3bbc165cbe None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:51.684745 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c54207-ded3-484a-8a9d-2c3bbc165cbe None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:51.684936 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c54207-ded3-484a-8a9d-2c3bbc165cbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:51.713265 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-20c54207-ded3-484a-8a9d-2c3bbc165cbe None None] MFA Rules not processed for user `443fe822f665431fbd578804ac37b819`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:02:51.714495 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-20c54207-ded3-484a-8a9d-2c3bbc165cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:51.780071 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1040/2074] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:02:51 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:02:51.792754 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81f23d6-4799-4d2e-afd6-40c6583cf456 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:51.794451 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-e81f23d6-4799-4d2e-afd6-40c6583cf456 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:51.873077 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81f23d6-4799-4d2e-afd6-40c6583cf456 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:51.876756 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a5dee9-0803-46c4-8ffb-8b2a4973114b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd516d0755be84b7293156625df1b13b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:51.877358 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a5dee9-0803-46c4-8ffb-8b2a4973114b service glance] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:51.877634 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a5dee9-0803-46c4-8ffb-8b2a4973114b service glance] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:51.878547 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a5dee9-0803-46c4-8ffb-8b2a4973114b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:51.892107 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a5dee9-0803-46c4-8ffb-8b2a4973114b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:51.892107 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a5dee9-0803-46c4-8ffb-8b2a4973114b service glance] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:51.897434 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1035/2075] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:02:51 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:02:52.061267 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:02:53.509141 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c54207-ded3-484a-8a9d-2c3bbc165cbe None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:53.516082 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-20c54207-ded3-484a-8a9d-2c3bbc165cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:53.579419 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c54207-ded3-484a-8a9d-2c3bbc165cbe None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:53.584119 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0f621f-0350-4025-a506-eec8c7a5b953 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e2a05b782424ab2928b5864f1bfd556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:53.584784 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0f621f-0350-4025-a506-eec8c7a5b953 service cinder] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:53.585068 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0f621f-0350-4025-a506-eec8c7a5b953 service cinder] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:53.585349 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0f621f-0350-4025-a506-eec8c7a5b953 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:53.587174 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-af0f621f-0350-4025-a506-eec8c7a5b953 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:53.628655 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:02:53.659371 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0f621f-0350-4025-a506-eec8c7a5b953 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:53.660964 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0f621f-0350-4025-a506-eec8c7a5b953 service cinder] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:53.671334 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1041/2076] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:02:53 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:02:56.816247 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:02:58.415003 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:INSERT=2,keystone:DELETE=10,keystone:SELECT=88 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:02:58.596183 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a5dee9-0803-46c4-8ffb-8b2a4973114b service glance] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:58.663494 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a5dee9-0803-46c4-8ffb-8b2a4973114b service glance] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:58.668161 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aebed18-9a0d-4e19-8bb7-6fa0051e577e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:58.668768 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aebed18-9a0d-4e19-8bb7-6fa0051e577e admin admin] REQUEST_METHOD: `DELETE` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:58.669047 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aebed18-9a0d-4e19-8bb7-6fa0051e577e admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:58.669318 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aebed18-9a0d-4e19-8bb7-6fa0051e577e admin admin] PATH_INFO: `/v3/users/67332065d6a44c1586f6e6517912fc21` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:58.670434 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aebed18-9a0d-4e19-8bb7-6fa0051e577e admin admin] RBAC: Authorizing `identity:delete_user(user_id=67332065d6a44c1586f6e6517912fc21)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:58.672352 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aebed18-9a0d-4e19-8bb7-6fa0051e577e admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:58.989603 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-2aebed18-9a0d-4e19-8bb7-6fa0051e577e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67332065d6a44c1586f6e6517912fc21'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:58.997383 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-2aebed18-9a0d-4e19-8bb7-6fa0051e577e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67332065d6a44c1586f6e6517912fc21'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:58.998116 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-2aebed18-9a0d-4e19-8bb7-6fa0051e577e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67332065d6a44c1586f6e6517912fc21'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:58.998734 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-2aebed18-9a0d-4e19-8bb7-6fa0051e577e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67332065d6a44c1586f6e6517912fc21'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:59.123514 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-2aebed18-9a0d-4e19-8bb7-6fa0051e577e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67332065d6a44c1586f6e6517912fc21'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:59.143173 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1036/2077] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Oct 4 12:02:58 2022] DELETE /identity/v3/users/67332065d6a44c1586f6e6517912fc21 => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:02:59.147737 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c186a71f-e3ac-416b-8b24-c4f35bce102a None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:59.148033 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c186a71f-e3ac-416b-8b24-c4f35bce102a None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:59.148315 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c186a71f-e3ac-416b-8b24-c4f35bce102a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:59.168870 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-c186a71f-e3ac-416b-8b24-c4f35bce102a None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:02:59.170082 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-c186a71f-e3ac-416b-8b24-c4f35bce102a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:59.242312 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1042/2078] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:02:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:02:59.252670 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aebed18-9a0d-4e19-8bb7-6fa0051e577e admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:59.254964 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-2aebed18-9a0d-4e19-8bb7-6fa0051e577e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:59.273993 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c186a71f-e3ac-416b-8b24-c4f35bce102a None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:59.275425 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-c186a71f-e3ac-416b-8b24-c4f35bce102a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:59.288494 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c186a71f-e3ac-416b-8b24-c4f35bce102a None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:59.293800 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4cf4af-0b5b-43e6-8897-6f7f7c60da04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:59.294447 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4cf4af-0b5b-43e6-8897-6f7f7c60da04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:59.294723 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4cf4af-0b5b-43e6-8897-6f7f7c60da04 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:59.294995 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4cf4af-0b5b-43e6-8897-6f7f7c60da04 admin admin] PATH_INFO: `/v3/users/9a19e0aabf104d619d1b2671ec870481` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:59.296232 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4cf4af-0b5b-43e6-8897-6f7f7c60da04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a19e0aabf104d619d1b2671ec870481)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:59.298231 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4cf4af-0b5b-43e6-8897-6f7f7c60da04 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:59.331454 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aebed18-9a0d-4e19-8bb7-6fa0051e577e admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:59.339726 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba37190-fa79-48d0-b387-b5d0c27393df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7289515c5c44914a19daa439de98cb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:59.339726 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba37190-fa79-48d0-b387-b5d0c27393df service neutron] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:59.339726 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba37190-fa79-48d0-b387-b5d0c27393df service neutron] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:59.339726 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba37190-fa79-48d0-b387-b5d0c27393df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:59.347763 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba37190-fa79-48d0-b387-b5d0c27393df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:59.349421 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba37190-fa79-48d0-b387-b5d0c27393df service neutron] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:59.359240 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1037/2079] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:02:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:02:59.623466 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-cc4cf4af-0b5b-43e6-8897-6f7f7c60da04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a19e0aabf104d619d1b2671ec870481'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:59.631542 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-cc4cf4af-0b5b-43e6-8897-6f7f7c60da04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a19e0aabf104d619d1b2671ec870481'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:59.632260 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-cc4cf4af-0b5b-43e6-8897-6f7f7c60da04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a19e0aabf104d619d1b2671ec870481'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:59.632960 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-cc4cf4af-0b5b-43e6-8897-6f7f7c60da04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a19e0aabf104d619d1b2671ec870481'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:59.711906 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-cc4cf4af-0b5b-43e6-8897-6f7f7c60da04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a19e0aabf104d619d1b2671ec870481'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:02:59.733171 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1043/2080] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Oct 4 12:02:59 2022] DELETE /identity/v3/users/9a19e0aabf104d619d1b2671ec870481 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:02:59.734653 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df00f48e-82d1-43ef-90ad-451320f2347a None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:59.735357 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df00f48e-82d1-43ef-90ad-451320f2347a None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:59.735445 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df00f48e-82d1-43ef-90ad-451320f2347a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:59.755661 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-df00f48e-82d1-43ef-90ad-451320f2347a None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:02:59.757053 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-df00f48e-82d1-43ef-90ad-451320f2347a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:59.804775 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4cf4af-0b5b-43e6-8897-6f7f7c60da04 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:59.806461 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-cc4cf4af-0b5b-43e6-8897-6f7f7c60da04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:59.824759 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1038/2081] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:02:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:02:59.836198 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df00f48e-82d1-43ef-90ad-451320f2347a None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:59.837617 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-df00f48e-82d1-43ef-90ad-451320f2347a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:59.900250 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4cf4af-0b5b-43e6-8897-6f7f7c60da04 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:59.907137 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6065687f-f375-47ba-b0ed-53016d3594bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:59.908060 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6065687f-f375-47ba-b0ed-53016d3594bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:59.908445 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6065687f-f375-47ba-b0ed-53016d3594bb admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:59.909642 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6065687f-f375-47ba-b0ed-53016d3594bb admin admin] PATH_INFO: `/v3/users/eeb82a54892349c8ac377bcb0f8b3a70` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:59.911134 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6065687f-f375-47ba-b0ed-53016d3594bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=eeb82a54892349c8ac377bcb0f8b3a70)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:59.911387 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df00f48e-82d1-43ef-90ad-451320f2347a None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:59.917027 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3c538d-f4e0-4c57-a928-ff98a8d723d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7289515c5c44914a19daa439de98cb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:59.917812 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3c538d-f4e0-4c57-a928-ff98a8d723d9 service neutron] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:59.918224 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3c538d-f4e0-4c57-a928-ff98a8d723d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:59.918640 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3c538d-f4e0-4c57-a928-ff98a8d723d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:59.918979 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6065687f-f375-47ba-b0ed-53016d3594bb admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:59.933975 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3c538d-f4e0-4c57-a928-ff98a8d723d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:59.935611 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3c538d-f4e0-4c57-a928-ff98a8d723d9 service neutron] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:02:59.948380 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1039/2082] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:02:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 12:02:59.949397 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3c538d-f4e0-4c57-a928-ff98a8d723d9 service neutron] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:02:59.950738 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-9d3c538d-f4e0-4c57-a928-ff98a8d723d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:02:59.967532 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3c538d-f4e0-4c57-a928-ff98a8d723d9 service neutron] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:02:59.974610 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b853be-b1b2-441b-9e0f-6cb71da1e4c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:02:59.975321 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b853be-b1b2-441b-9e0f-6cb71da1e4c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:02:59.975670 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b853be-b1b2-441b-9e0f-6cb71da1e4c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:02:59.976010 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b853be-b1b2-441b-9e0f-6cb71da1e4c3 admin admin] PATH_INFO: `/v3/projects/2fa5ef6f6e76444785a78a4a4ca138a5` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:02:59.978323 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b853be-b1b2-441b-9e0f-6cb71da1e4c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fa5ef6f6e76444785a78a4a4ca138a5)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:02:59.980633 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b853be-b1b2-441b-9e0f-6cb71da1e4c3 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:00.256626 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:03:00.273750 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-6065687f-f375-47ba-b0ed-53016d3594bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eeb82a54892349c8ac377bcb0f8b3a70'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:00.280560 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-f3b853be-b1b2-441b-9e0f-6cb71da1e4c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fa5ef6f6e76444785a78a4a4ca138a5', 'request_id': 'req-f3b853be-b1b2-441b-9e0f-6cb71da1e4c3'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:00.281501 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-6065687f-f375-47ba-b0ed-53016d3594bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eeb82a54892349c8ac377bcb0f8b3a70'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:00.282280 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-6065687f-f375-47ba-b0ed-53016d3594bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eeb82a54892349c8ac377bcb0f8b3a70'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:00.282963 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-6065687f-f375-47ba-b0ed-53016d3594bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eeb82a54892349c8ac377bcb0f8b3a70'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:00.288509 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-f3b853be-b1b2-441b-9e0f-6cb71da1e4c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fa5ef6f6e76444785a78a4a4ca138a5', 'request_id': 'req-f3b853be-b1b2-441b-9e0f-6cb71da1e4c3'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:00.392212 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-6065687f-f375-47ba-b0ed-53016d3594bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eeb82a54892349c8ac377bcb0f8b3a70'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:00.410257 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1044/2083] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Oct 4 12:02:59 2022] DELETE /identity/v3/users/eeb82a54892349c8ac377bcb0f8b3a70 => generated 0 bytes in 606 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:03:00.414593 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39a4bec-13fe-4e98-a989-371016a561ee None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:00.414873 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39a4bec-13fe-4e98-a989-371016a561ee None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:00.415142 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39a4bec-13fe-4e98-a989-371016a561ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:00.435692 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-a39a4bec-13fe-4e98-a989-371016a561ee None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:03:00.436934 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-a39a4bec-13fe-4e98-a989-371016a561ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:03:00.500325 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1045/2084] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:03:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 12:03:00.513632 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39a4bec-13fe-4e98-a989-371016a561ee None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:00.515129 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-a39a4bec-13fe-4e98-a989-371016a561ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:03:00.544403 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-f3b853be-b1b2-441b-9e0f-6cb71da1e4c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fa5ef6f6e76444785a78a4a4ca138a5', 'request_id': 'req-f3b853be-b1b2-441b-9e0f-6cb71da1e4c3'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:00.562654 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-f3b853be-b1b2-441b-9e0f-6cb71da1e4c3 admin admin] The token cache is being invalidate because project 2fa5ef6f6e76444785a78a4a4ca138a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:03:00.562844 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-f3b853be-b1b2-441b-9e0f-6cb71da1e4c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:00.563614 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-f3b853be-b1b2-441b-9e0f-6cb71da1e4c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:00.567197 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1040/2085] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Oct 4 12:02:59 2022] DELETE /identity/v3/projects/2fa5ef6f6e76444785a78a4a4ca138a5 => generated 0 bytes in 618 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:03:00.568657 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b853be-b1b2-441b-9e0f-6cb71da1e4c3 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:00.570113 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-f3b853be-b1b2-441b-9e0f-6cb71da1e4c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:03:00.591712 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39a4bec-13fe-4e98-a989-371016a561ee None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:00.605842 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdf1e29-0f79-493c-a8da-18a5d18a7d72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7289515c5c44914a19daa439de98cb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:00.608009 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdf1e29-0f79-493c-a8da-18a5d18a7d72 service neutron] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:00.608528 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdf1e29-0f79-493c-a8da-18a5d18a7d72 service neutron] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:00.609306 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdf1e29-0f79-493c-a8da-18a5d18a7d72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:00.613069 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-8bdf1e29-0f79-493c-a8da-18a5d18a7d72 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:03:00.630054 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdf1e29-0f79-493c-a8da-18a5d18a7d72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:00.631500 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdf1e29-0f79-493c-a8da-18a5d18a7d72 service neutron] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:00.645350 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1046/2086] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:03:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 12:03:00.646309 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdf1e29-0f79-493c-a8da-18a5d18a7d72 service neutron] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:00.647672 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-8bdf1e29-0f79-493c-a8da-18a5d18a7d72 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:03:00.654414 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b853be-b1b2-441b-9e0f-6cb71da1e4c3 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:00.660533 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2248e1e6-0858-4d5e-b694-549218a2e564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:00.661361 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2248e1e6-0858-4d5e-b694-549218a2e564 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:00.661644 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2248e1e6-0858-4d5e-b694-549218a2e564 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:00.661995 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2248e1e6-0858-4d5e-b694-549218a2e564 admin admin] PATH_INFO: `/v3/projects/d84b0a2debf549cc87f2c8595763738c` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:00.662211 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdf1e29-0f79-493c-a8da-18a5d18a7d72 service neutron] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:00.663084 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2248e1e6-0858-4d5e-b694-549218a2e564 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d84b0a2debf549cc87f2c8595763738c)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:00.665256 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2248e1e6-0858-4d5e-b694-549218a2e564 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:00.667319 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03abe7a6-5c11-4f2f-97e1-65409a3de863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:00.668667 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03abe7a6-5c11-4f2f-97e1-65409a3de863 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:00.669016 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03abe7a6-5c11-4f2f-97e1-65409a3de863 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:00.669587 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03abe7a6-5c11-4f2f-97e1-65409a3de863 admin admin] PATH_INFO: `/v3/users/0cdefb29128f46f881066cdb9211008f` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:00.671005 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03abe7a6-5c11-4f2f-97e1-65409a3de863 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0cdefb29128f46f881066cdb9211008f)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:00.673435 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03abe7a6-5c11-4f2f-97e1-65409a3de863 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:00.941448 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-2248e1e6-0858-4d5e-b694-549218a2e564 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd84b0a2debf549cc87f2c8595763738c', 'request_id': 'req-2248e1e6-0858-4d5e-b694-549218a2e564'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:00.948864 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-2248e1e6-0858-4d5e-b694-549218a2e564 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd84b0a2debf549cc87f2c8595763738c', 'request_id': 'req-2248e1e6-0858-4d5e-b694-549218a2e564'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:01.055609 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-2248e1e6-0858-4d5e-b694-549218a2e564 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd84b0a2debf549cc87f2c8595763738c', 'request_id': 'req-2248e1e6-0858-4d5e-b694-549218a2e564'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:01.067615 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-2248e1e6-0858-4d5e-b694-549218a2e564 admin admin] The token cache is being invalidate because project d84b0a2debf549cc87f2c8595763738c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:03:01.067907 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-2248e1e6-0858-4d5e-b694-549218a2e564 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:01.068547 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-2248e1e6-0858-4d5e-b694-549218a2e564 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:01.070078 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1041/2087] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Oct 4 12:03:00 2022] DELETE /identity/v3/projects/d84b0a2debf549cc87f2c8595763738c => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:03:01.073861 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2248e1e6-0858-4d5e-b694-549218a2e564 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:01.075237 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-2248e1e6-0858-4d5e-b694-549218a2e564 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:03:01.116161 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-03abe7a6-5c11-4f2f-97e1-65409a3de863 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0cdefb29128f46f881066cdb9211008f'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:01.125167 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-03abe7a6-5c11-4f2f-97e1-65409a3de863 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0cdefb29128f46f881066cdb9211008f'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:01.125884 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-03abe7a6-5c11-4f2f-97e1-65409a3de863 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0cdefb29128f46f881066cdb9211008f'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:01.126561 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-03abe7a6-5c11-4f2f-97e1-65409a3de863 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0cdefb29128f46f881066cdb9211008f'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:01.147879 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2248e1e6-0858-4d5e-b694-549218a2e564 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:01.152463 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53cc82c-6817-4c1c-a0df-860373232ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:01.153133 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53cc82c-6817-4c1c-a0df-860373232ec4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:01.153416 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53cc82c-6817-4c1c-a0df-860373232ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:01.153696 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53cc82c-6817-4c1c-a0df-860373232ec4 admin admin] PATH_INFO: `/v3/users/c3b2aa31892b46cbbba2a511fe42d205` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:01.154866 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53cc82c-6817-4c1c-a0df-860373232ec4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3b2aa31892b46cbbba2a511fe42d205)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:01.156817 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53cc82c-6817-4c1c-a0df-860373232ec4 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:01.271242 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-03abe7a6-5c11-4f2f-97e1-65409a3de863 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0cdefb29128f46f881066cdb9211008f'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:01.291638 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1047/2088] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Oct 4 12:03:00 2022] DELETE /identity/v3/users/0cdefb29128f46f881066cdb9211008f => generated 0 bytes in 646 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:03:01.343492 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03abe7a6-5c11-4f2f-97e1-65409a3de863 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:01.344986 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-03abe7a6-5c11-4f2f-97e1-65409a3de863 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:03:01.430814 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03abe7a6-5c11-4f2f-97e1-65409a3de863 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:01.435664 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6501aa5-1570-45cb-869d-ad3fa82a6637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:01.436305 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6501aa5-1570-45cb-869d-ad3fa82a6637 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:01.436586 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6501aa5-1570-45cb-869d-ad3fa82a6637 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:01.436895 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6501aa5-1570-45cb-869d-ad3fa82a6637 admin admin] PATH_INFO: `/v3/projects/5d7f640ecda04554a0a1c2773830810e` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:01.438102 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6501aa5-1570-45cb-869d-ad3fa82a6637 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d7f640ecda04554a0a1c2773830810e)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:01.440803 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6501aa5-1570-45cb-869d-ad3fa82a6637 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:01.458690 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-c53cc82c-6817-4c1c-a0df-860373232ec4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3b2aa31892b46cbbba2a511fe42d205'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:01.467996 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-c53cc82c-6817-4c1c-a0df-860373232ec4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3b2aa31892b46cbbba2a511fe42d205'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:01.468723 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-c53cc82c-6817-4c1c-a0df-860373232ec4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3b2aa31892b46cbbba2a511fe42d205'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:01.469336 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-c53cc82c-6817-4c1c-a0df-860373232ec4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3b2aa31892b46cbbba2a511fe42d205'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:01.587139 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-c53cc82c-6817-4c1c-a0df-860373232ec4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3b2aa31892b46cbbba2a511fe42d205'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:01.607017 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1042/2089] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Oct 4 12:03:01 2022] DELETE /identity/v3/users/c3b2aa31892b46cbbba2a511fe42d205 => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:03:01.608106 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-b6501aa5-1570-45cb-869d-ad3fa82a6637 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d7f640ecda04554a0a1c2773830810e', 'request_id': 'req-b6501aa5-1570-45cb-869d-ad3fa82a6637'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:01.774912 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-b6501aa5-1570-45cb-869d-ad3fa82a6637 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d7f640ecda04554a0a1c2773830810e', 'request_id': 'req-b6501aa5-1570-45cb-869d-ad3fa82a6637'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:01.783087 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-b6501aa5-1570-45cb-869d-ad3fa82a6637 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d7f640ecda04554a0a1c2773830810e', 'request_id': 'req-b6501aa5-1570-45cb-869d-ad3fa82a6637'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:01.795801 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-b6501aa5-1570-45cb-869d-ad3fa82a6637 admin admin] The token cache is being invalidate because project 5d7f640ecda04554a0a1c2773830810e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:03:01.796400 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-b6501aa5-1570-45cb-869d-ad3fa82a6637 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:01.797212 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-b6501aa5-1570-45cb-869d-ad3fa82a6637 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:01.799086 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1048/2090] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Oct 4 12:03:01 2022] DELETE /identity/v3/projects/5d7f640ecda04554a0a1c2773830810e => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:03:01.804801 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006c922c-624d-44d2-b037-23bc6859fc51 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:01.805226 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006c922c-624d-44d2-b037-23bc6859fc51 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:01.805672 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006c922c-624d-44d2-b037-23bc6859fc51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:01.841984 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-006c922c-624d-44d2-b037-23bc6859fc51 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:03:01.843175 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-006c922c-624d-44d2-b037-23bc6859fc51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:03:01.941915 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1043/2091] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:03:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 12:03:01.951110 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd942f48-5bde-4567-ad2f-3e280892f120 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:01.953888 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd942f48-5bde-4567-ad2f-3e280892f120 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:01.953888 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd942f48-5bde-4567-ad2f-3e280892f120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:01.973640 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-cd942f48-5bde-4567-ad2f-3e280892f120 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:03:01.976750 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-cd942f48-5bde-4567-ad2f-3e280892f120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:03:02.008152 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1049/2092] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:03:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:03:02.009577 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006c922c-624d-44d2-b037-23bc6859fc51 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:02.019789 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006c922c-624d-44d2-b037-23bc6859fc51 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:02.026798 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42f0952-cdc5-4d15-94c5-e2c6cf9f9049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:02.027767 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42f0952-cdc5-4d15-94c5-e2c6cf9f9049 admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:02.028082 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42f0952-cdc5-4d15-94c5-e2c6cf9f9049 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:02.028361 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42f0952-cdc5-4d15-94c5-e2c6cf9f9049 admin admin] PATH_INFO: `/v3/domains` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:02.029063 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42f0952-cdc5-4d15-94c5-e2c6cf9f9049 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:03:02.029369 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42f0952-cdc5-4d15-94c5-e2c6cf9f9049 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:02.030972 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42f0952-cdc5-4d15-94c5-e2c6cf9f9049 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:02.059905 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1044/2093] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Oct 4 12:03:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:03:02.061267 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd942f48-5bde-4567-ad2f-3e280892f120 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:02.062798 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-cd942f48-5bde-4567-ad2f-3e280892f120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:03:02.064546 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42f0952-cdc5-4d15-94c5-e2c6cf9f9049 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:02.077417 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42f0952-cdc5-4d15-94c5-e2c6cf9f9049 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:02.081344 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd942f48-5bde-4567-ad2f-3e280892f120 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:02.089039 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa3099b-d8e0-451b-ba24-bb5e59eacd75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:02.089582 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f05be13-1daf-490c-bfa4-6aea55985ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:02.089856 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa3099b-d8e0-451b-ba24-bb5e59eacd75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:02.090196 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa3099b-d8e0-451b-ba24-bb5e59eacd75 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:02.090405 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f05be13-1daf-490c-bfa4-6aea55985ae3 admin admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:02.090582 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa3099b-d8e0-451b-ba24-bb5e59eacd75 admin admin] PATH_INFO: `/v3/projects/d3f9e482d2cd45b692a381c2a75c1301` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:02.090812 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f05be13-1daf-490c-bfa4-6aea55985ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:02.091141 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f05be13-1daf-490c-bfa4-6aea55985ae3 admin admin] PATH_INFO: `/v3/projects` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:02.092737 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f05be13-1daf-490c-bfa4-6aea55985ae3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:02.093058 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa3099b-d8e0-451b-ba24-bb5e59eacd75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3f9e482d2cd45b692a381c2a75c1301)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:02.098069 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f05be13-1daf-490c-bfa4-6aea55985ae3 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:02.111015 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa3099b-d8e0-451b-ba24-bb5e59eacd75 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:02.395092 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1045/2094] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Oct 4 12:03:02 2022] POST /identity/v3/projects => generated 367 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:03:02.399145 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f05be13-1daf-490c-bfa4-6aea55985ae3 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:02.453410 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-4fa3099b-d8e0-451b-ba24-bb5e59eacd75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3f9e482d2cd45b692a381c2a75c1301', 'request_id': 'req-4fa3099b-d8e0-451b-ba24-bb5e59eacd75'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:02.469913 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f05be13-1daf-490c-bfa4-6aea55985ae3 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:02.543025 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3113ed3-66e0-44c4-928e-a10315de73b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:02.543890 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3113ed3-66e0-44c4-928e-a10315de73b5 admin admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:02.544000 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3113ed3-66e0-44c4-928e-a10315de73b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:02.544178 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3113ed3-66e0-44c4-928e-a10315de73b5 admin admin] PATH_INFO: `/v3/users` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:02.544872 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3113ed3-66e0-44c4-928e-a10315de73b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:02.546819 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3113ed3-66e0-44c4-928e-a10315de73b5 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:02.563432 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-4fa3099b-d8e0-451b-ba24-bb5e59eacd75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3f9e482d2cd45b692a381c2a75c1301', 'request_id': 'req-4fa3099b-d8e0-451b-ba24-bb5e59eacd75'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:02.571529 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-4fa3099b-d8e0-451b-ba24-bb5e59eacd75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3f9e482d2cd45b692a381c2a75c1301', 'request_id': 'req-4fa3099b-d8e0-451b-ba24-bb5e59eacd75'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:02.584502 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-4fa3099b-d8e0-451b-ba24-bb5e59eacd75 admin admin] The token cache is being invalidate because project d3f9e482d2cd45b692a381c2a75c1301 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:03:02.584835 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-4fa3099b-d8e0-451b-ba24-bb5e59eacd75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:02.585480 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-4fa3099b-d8e0-451b-ba24-bb5e59eacd75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:02.587590 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1050/2095] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Oct 4 12:03:02 2022] DELETE /identity/v3/projects/d3f9e482d2cd45b692a381c2a75c1301 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:03:02.588564 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa3099b-d8e0-451b-ba24-bb5e59eacd75 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:02.590120 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-4fa3099b-d8e0-451b-ba24-bb5e59eacd75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:03:02.604736 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa3099b-d8e0-451b-ba24-bb5e59eacd75 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:02.609551 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a077bc46-6fbb-40bd-9b02-17610864ea5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:02.610522 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a077bc46-6fbb-40bd-9b02-17610864ea5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:02.610859 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a077bc46-6fbb-40bd-9b02-17610864ea5b admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:02.611199 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a077bc46-6fbb-40bd-9b02-17610864ea5b admin admin] PATH_INFO: `/v3/projects/f4ea5963c5e441628d3bb59c05f0314e` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:02.612668 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a077bc46-6fbb-40bd-9b02-17610864ea5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4ea5963c5e441628d3bb59c05f0314e)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:02.614643 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a077bc46-6fbb-40bd-9b02-17610864ea5b admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:02.655084 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1046/2096] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Oct 4 12:03:02 2022] POST /identity/v3/users => generated 284 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 12:03:02.656346 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63b2ed9-837b-47d5-9325-06edacef8401 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:02.656654 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63b2ed9-837b-47d5-9325-06edacef8401 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:02.656943 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63b2ed9-837b-47d5-9325-06edacef8401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:02.677967 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-f63b2ed9-837b-47d5-9325-06edacef8401 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:03:02.679178 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-f63b2ed9-837b-47d5-9325-06edacef8401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:03:02.687494 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1047/2097] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:03:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:03:02.688329 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63b2ed9-837b-47d5-9325-06edacef8401 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:02.689590 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-f63b2ed9-837b-47d5-9325-06edacef8401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:03:02.701635 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63b2ed9-837b-47d5-9325-06edacef8401 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:02.707103 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce27027-349b-4c26-b4e8-9e0009f7caf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:02.707739 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce27027-349b-4c26-b4e8-9e0009f7caf6 admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:02.708017 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce27027-349b-4c26-b4e8-9e0009f7caf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:02.708337 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce27027-349b-4c26-b4e8-9e0009f7caf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:02.708981 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce27027-349b-4c26-b4e8-9e0009f7caf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:02.710651 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce27027-349b-4c26-b4e8-9e0009f7caf6 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:02.721032 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1048/2098] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:03:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:03:02.722232 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1d9a7b-b25d-41b9-a0ba-337bc77a3d77 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:02.722520 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1d9a7b-b25d-41b9-a0ba-337bc77a3d77 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:02.722796 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1d9a7b-b25d-41b9-a0ba-337bc77a3d77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:02.742922 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-0e1d9a7b-b25d-41b9-a0ba-337bc77a3d77 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:03:02.744139 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-0e1d9a7b-b25d-41b9-a0ba-337bc77a3d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:03:02.752218 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1049/2099] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:03:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:03:02.753094 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1d9a7b-b25d-41b9-a0ba-337bc77a3d77 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:02.762489 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1d9a7b-b25d-41b9-a0ba-337bc77a3d77 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:02.767444 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0755cd43-8608-4b06-ab32-9b8abe603b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:02.768554 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0755cd43-8608-4b06-ab32-9b8abe603b4b admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:02.768860 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0755cd43-8608-4b06-ab32-9b8abe603b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:02.769129 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0755cd43-8608-4b06-ab32-9b8abe603b4b admin admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:02.769764 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0755cd43-8608-4b06-ab32-9b8abe603b4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:02.771621 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0755cd43-8608-4b06-ab32-9b8abe603b4b admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:02.781710 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1050/2100] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:03:02 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:03:02.782548 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0755cd43-8608-4b06-ab32-9b8abe603b4b admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:02.787940 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-a077bc46-6fbb-40bd-9b02-17610864ea5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4ea5963c5e441628d3bb59c05f0314e', 'request_id': 'req-a077bc46-6fbb-40bd-9b02-17610864ea5b'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:02.793105 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0755cd43-8608-4b06-ab32-9b8abe603b4b admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:02.850485 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765f71c0-4d9a-4bf6-acb7-28727708d4b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:02.851034 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765f71c0-4d9a-4bf6-acb7-28727708d4b0 admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:02.851318 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765f71c0-4d9a-4bf6-acb7-28727708d4b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:02.851592 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765f71c0-4d9a-4bf6-acb7-28727708d4b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:02.852244 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765f71c0-4d9a-4bf6-acb7-28727708d4b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:03:02.852548 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765f71c0-4d9a-4bf6-acb7-28727708d4b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:02.854231 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765f71c0-4d9a-4bf6-acb7-28727708d4b0 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:02.870616 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1051/2101] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Oct 4 12:03:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:03:02.870616 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765f71c0-4d9a-4bf6-acb7-28727708d4b0 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:02.872576 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-a077bc46-6fbb-40bd-9b02-17610864ea5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4ea5963c5e441628d3bb59c05f0314e', 'request_id': 'req-a077bc46-6fbb-40bd-9b02-17610864ea5b'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:02.881080 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765f71c0-4d9a-4bf6-acb7-28727708d4b0 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:02.881835 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-a077bc46-6fbb-40bd-9b02-17610864ea5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4ea5963c5e441628d3bb59c05f0314e', 'request_id': 'req-a077bc46-6fbb-40bd-9b02-17610864ea5b'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:02.886768 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b947dc3-a56b-4c29-8cf5-58b5a7e59ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:02.887447 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b947dc3-a56b-4c29-8cf5-58b5a7e59ce3 admin admin] REQUEST_METHOD: `PUT` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:02.887738 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b947dc3-a56b-4c29-8cf5-58b5a7e59ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:02.888013 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b947dc3-a56b-4c29-8cf5-58b5a7e59ce3 admin admin] PATH_INFO: `/v3/projects/cafd783629704825957976b268529df4/users/44ef02af6dd9490784dc1d3429493399/roles/ab4307f3b7994c1c80036fa7db93b6b9` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:02.899186 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-a077bc46-6fbb-40bd-9b02-17610864ea5b admin admin] The token cache is being invalidate because project f4ea5963c5e441628d3bb59c05f0314e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:03:02.899476 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-a077bc46-6fbb-40bd-9b02-17610864ea5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:02.900145 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-a077bc46-6fbb-40bd-9b02-17610864ea5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:02.901740 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1051/2102] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Oct 4 12:03:02 2022] DELETE /identity/v3/projects/f4ea5963c5e441628d3bb59c05f0314e => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:03:02.905074 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a077bc46-6fbb-40bd-9b02-17610864ea5b admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:02.905074 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-a077bc46-6fbb-40bd-9b02-17610864ea5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:03:02.905280 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b947dc3-a56b-4c29-8cf5-58b5a7e59ce3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cafd783629704825957976b268529df4, user_id=44ef02af6dd9490784dc1d3429493399, role_id=ab4307f3b7994c1c80036fa7db93b6b9)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:02.907858 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b947dc3-a56b-4c29-8cf5-58b5a7e59ce3 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:02.919559 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a077bc46-6fbb-40bd-9b02-17610864ea5b admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:02.925573 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd3d8bb-2718-4cc0-b08a-b7eced650a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:02.928373 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd3d8bb-2718-4cc0-b08a-b7eced650a53 admin admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:02.928373 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd3d8bb-2718-4cc0-b08a-b7eced650a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:02.928373 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd3d8bb-2718-4cc0-b08a-b7eced650a53 admin admin] PATH_INFO: `/v3/projects` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:02.928373 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd3d8bb-2718-4cc0-b08a-b7eced650a53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:02.929808 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd3d8bb-2718-4cc0-b08a-b7eced650a53 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:03.096754 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1052/2103] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Oct 4 12:03:02 2022] PUT /identity/v3/projects/cafd783629704825957976b268529df4/users/44ef02af6dd9490784dc1d3429493399/roles/ab4307f3b7994c1c80036fa7db93b6b9 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:03:03.097592 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b947dc3-a56b-4c29-8cf5-58b5a7e59ce3 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:03.099545 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-8b947dc3-a56b-4c29-8cf5-58b5a7e59ce3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:03:03.113460 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1052/2104] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Oct 4 12:03:02 2022] POST /identity/v3/projects => generated 389 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:03:03.115889 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aa4b5d-c434-4cb6-8d67-dd4cf4cea095 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:03.116335 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aa4b5d-c434-4cb6-8d67-dd4cf4cea095 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:03.116817 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aa4b5d-c434-4cb6-8d67-dd4cf4cea095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:03.175599 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-d0aa4b5d-c434-4cb6-8d67-dd4cf4cea095 None None] MFA Rules not processed for user `44ef02af6dd9490784dc1d3429493399`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:03:03.177576 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-d0aa4b5d-c434-4cb6-8d67-dd4cf4cea095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:03:03.229567 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:INSERT=5,keystone:SELECT=85,keystone:DELETE=10 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:03:03.236816 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b947dc3-a56b-4c29-8cf5-58b5a7e59ce3 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:03.262821 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:03:03.294857 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1053/2105] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:03:03 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:03:03.295692 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aa4b5d-c434-4cb6-8d67-dd4cf4cea095 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:03.318013 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a155676c-4c66-420d-b101-e9816d997444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:03.318661 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a155676c-4c66-420d-b101-e9816d997444 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:03.318945 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a155676c-4c66-420d-b101-e9816d997444 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:03.319227 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a155676c-4c66-420d-b101-e9816d997444 admin admin] PATH_INFO: `/v3/users/b4682b375c4742318bced81d396a1ce2` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:03.320385 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a155676c-4c66-420d-b101-e9816d997444 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4682b375c4742318bced81d396a1ce2)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:03.322557 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a155676c-4c66-420d-b101-e9816d997444 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:03.373533 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aa4b5d-c434-4cb6-8d67-dd4cf4cea095 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:03.378600 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fb9b7c-de8b-4550-bf3e-5bc66b91d1c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:03.379212 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fb9b7c-de8b-4550-bf3e-5bc66b91d1c2 admin admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:03.379493 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fb9b7c-de8b-4550-bf3e-5bc66b91d1c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:03.379762 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fb9b7c-de8b-4550-bf3e-5bc66b91d1c2 admin admin] PATH_INFO: `/v3/users` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:03.380402 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fb9b7c-de8b-4550-bf3e-5bc66b91d1c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:03.382377 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fb9b7c-de8b-4550-bf3e-5bc66b91d1c2 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:03.522800 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1054/2106] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Oct 4 12:03:03 2022] POST /identity/v3/users => generated 295 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:03:03.522800 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fb9b7c-de8b-4550-bf3e-5bc66b91d1c2 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:03.522800 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-21fb9b7c-de8b-4550-bf3e-5bc66b91d1c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:03:03.536676 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fb9b7c-de8b-4550-bf3e-5bc66b91d1c2 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:03.541525 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3801a681-6a82-483f-826a-03ae608b7077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:03.542122 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3801a681-6a82-483f-826a-03ae608b7077 admin admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:03.542399 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3801a681-6a82-483f-826a-03ae608b7077 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:03.542670 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3801a681-6a82-483f-826a-03ae608b7077 admin admin] PATH_INFO: `/v3/projects` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:03.543398 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3801a681-6a82-483f-826a-03ae608b7077 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:03.545420 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3801a681-6a82-483f-826a-03ae608b7077 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:03.569050 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-a155676c-4c66-420d-b101-e9816d997444 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4682b375c4742318bced81d396a1ce2'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:03.575881 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-a155676c-4c66-420d-b101-e9816d997444 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4682b375c4742318bced81d396a1ce2'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:03.576534 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-a155676c-4c66-420d-b101-e9816d997444 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4682b375c4742318bced81d396a1ce2'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:03.577171 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-a155676c-4c66-420d-b101-e9816d997444 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4682b375c4742318bced81d396a1ce2'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:03.695629 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-a155676c-4c66-420d-b101-e9816d997444 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4682b375c4742318bced81d396a1ce2'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:03.704056 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1055/2107] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Oct 4 12:03:03 2022] POST /identity/v3/projects => generated 369 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:03:03.705122 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3801a681-6a82-483f-826a-03ae608b7077 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:03.709725 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-3801a681-6a82-483f-826a-03ae608b7077 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:03:03.721891 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1053/2108] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Oct 4 12:03:03 2022] DELETE /identity/v3/users/b4682b375c4742318bced81d396a1ce2 => generated 0 bytes in 626 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:03:03.722709 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a155676c-4c66-420d-b101-e9816d997444 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:03.724017 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-a155676c-4c66-420d-b101-e9816d997444 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:03:03.801227 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a155676c-4c66-420d-b101-e9816d997444 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:03.805090 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3801a681-6a82-483f-826a-03ae608b7077 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:03.808657 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670f0610-852d-4726-b1c8-f9c83c919cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:03.809897 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670f0610-852d-4726-b1c8-f9c83c919cab admin admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:03.810528 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670f0610-852d-4726-b1c8-f9c83c919cab admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:03.811010 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670f0610-852d-4726-b1c8-f9c83c919cab admin admin] PATH_INFO: `/v3/users` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:03.811877 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670f0610-852d-4726-b1c8-f9c83c919cab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:03.812214 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34182d91-b186-4081-803a-83b0603faa81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:03.813049 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34182d91-b186-4081-803a-83b0603faa81 admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:03.813182 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34182d91-b186-4081-803a-83b0603faa81 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:03.813526 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34182d91-b186-4081-803a-83b0603faa81 admin admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:03.814432 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34182d91-b186-4081-803a-83b0603faa81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:03.816430 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34182d91-b186-4081-803a-83b0603faa81 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:03.817828 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670f0610-852d-4726-b1c8-f9c83c919cab admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:03.827111 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1056/2109] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:03:03 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:03:03.838860 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34182d91-b186-4081-803a-83b0603faa81 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:03.850004 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34182d91-b186-4081-803a-83b0603faa81 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:03.858744 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690d4c23-e8b0-4e5d-9ddc-7f29ecf2dad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:03.859452 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690d4c23-e8b0-4e5d-9ddc-7f29ecf2dad0 admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:03.859739 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690d4c23-e8b0-4e5d-9ddc-7f29ecf2dad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:03.860479 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690d4c23-e8b0-4e5d-9ddc-7f29ecf2dad0 admin admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:03.861168 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690d4c23-e8b0-4e5d-9ddc-7f29ecf2dad0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:03.863153 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690d4c23-e8b0-4e5d-9ddc-7f29ecf2dad0 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:03.874412 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1057/2110] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:03:03 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 12:03:03.879272 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690d4c23-e8b0-4e5d-9ddc-7f29ecf2dad0 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:03.891894 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690d4c23-e8b0-4e5d-9ddc-7f29ecf2dad0 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:03.898441 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beeb3cd-2102-4d00-a9ce-39b9bf41b93b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:03.899246 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beeb3cd-2102-4d00-a9ce-39b9bf41b93b admin admin] REQUEST_METHOD: `PUT` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:03.899590 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beeb3cd-2102-4d00-a9ce-39b9bf41b93b admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:03.899940 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beeb3cd-2102-4d00-a9ce-39b9bf41b93b admin admin] PATH_INFO: `/v3/projects/708a9dbf808e416ba6dd9f7a4f4cc519/users/1d9d6e71a42848d1ab82e388dc42145e/roles/ab4307f3b7994c1c80036fa7db93b6b9` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:03.937183 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1054/2111] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Oct 4 12:03:03 2022] POST /identity/v3/users => generated 291 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:03:03.941812 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670f0610-852d-4726-b1c8-f9c83c919cab admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:03.946162 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9beeb3cd-2102-4d00-a9ce-39b9bf41b93b admin admin] RBAC: Authorizing `identity:create_grant(project_id=708a9dbf808e416ba6dd9f7a4f4cc519, user_id=1d9d6e71a42848d1ab82e388dc42145e, role_id=ab4307f3b7994c1c80036fa7db93b6b9)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:03.951072 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9beeb3cd-2102-4d00-a9ce-39b9bf41b93b admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:03.954327 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670f0610-852d-4726-b1c8-f9c83c919cab admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:03.959938 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62a15f4-58ad-475d-9d2a-36834f15e1d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:03.960565 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62a15f4-58ad-475d-9d2a-36834f15e1d8 admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:03.960876 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62a15f4-58ad-475d-9d2a-36834f15e1d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:03.961151 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62a15f4-58ad-475d-9d2a-36834f15e1d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:03.961794 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62a15f4-58ad-475d-9d2a-36834f15e1d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:03.963485 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62a15f4-58ad-475d-9d2a-36834f15e1d8 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:03.974763 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1055/2112] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:03:03 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:03:03.978880 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62a15f4-58ad-475d-9d2a-36834f15e1d8 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:03.989609 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62a15f4-58ad-475d-9d2a-36834f15e1d8 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:03.994699 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7625b17-a22b-42b3-96af-eb3059622fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:03.996891 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7625b17-a22b-42b3-96af-eb3059622fe4 admin admin] REQUEST_METHOD: `PUT` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:03.996891 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7625b17-a22b-42b3-96af-eb3059622fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:03.996891 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7625b17-a22b-42b3-96af-eb3059622fe4 admin admin] PATH_INFO: `/v3/projects/3fd1c6772cf845369379cd2d367c9f46/users/4934007ea91a4379bb5ed961830076d6/roles/d6e7421d1ff9451c808004b818354550` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:04.014199 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7625b17-a22b-42b3-96af-eb3059622fe4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fd1c6772cf845369379cd2d367c9f46, user_id=4934007ea91a4379bb5ed961830076d6, role_id=d6e7421d1ff9451c808004b818354550)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:04.016890 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7625b17-a22b-42b3-96af-eb3059622fe4 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:04.106805 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1058/2113] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Oct 4 12:03:03 2022] PUT /identity/v3/projects/708a9dbf808e416ba6dd9f7a4f4cc519/users/1d9d6e71a42848d1ab82e388dc42145e/roles/ab4307f3b7994c1c80036fa7db93b6b9 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:03:04.129785 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dbfb0f-c003-492d-93cd-854d660570b9 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:04.130473 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dbfb0f-c003-492d-93cd-854d660570b9 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:04.130473 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dbfb0f-c003-492d-93cd-854d660570b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:04.167509 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-43dbfb0f-c003-492d-93cd-854d660570b9 None None] MFA Rules not processed for user `1d9d6e71a42848d1ab82e388dc42145e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:03:04.168707 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-43dbfb0f-c003-492d-93cd-854d660570b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:03:04.248574 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1059/2114] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:03:04 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:03:04.254016 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dbfb0f-c003-492d-93cd-854d660570b9 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:04.286473 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1056/2115] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Oct 4 12:03:03 2022] PUT /identity/v3/projects/3fd1c6772cf845369379cd2d367c9f46/users/4934007ea91a4379bb5ed961830076d6/roles/d6e7421d1ff9451c808004b818354550 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:03:04.293527 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7625b17-a22b-42b3-96af-eb3059622fe4 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:04.345362 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dbfb0f-c003-492d-93cd-854d660570b9 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:04.392614 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7625b17-a22b-42b3-96af-eb3059622fe4 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:04.399324 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d30237a-bfa0-4786-89da-44d3f6e6afee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:04.400737 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d30237a-bfa0-4786-89da-44d3f6e6afee admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:04.401170 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d30237a-bfa0-4786-89da-44d3f6e6afee admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:04.401544 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d30237a-bfa0-4786-89da-44d3f6e6afee admin admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:04.402426 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d30237a-bfa0-4786-89da-44d3f6e6afee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:04.405251 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d30237a-bfa0-4786-89da-44d3f6e6afee admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:04.427003 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1057/2116] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:03:04 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:03:04.429351 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d30237a-bfa0-4786-89da-44d3f6e6afee admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:04.442680 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-7d30237a-bfa0-4786-89da-44d3f6e6afee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:03:04.456010 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d30237a-bfa0-4786-89da-44d3f6e6afee admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:04.457803 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16cfdcd-2fe4-4fe9-aa10-02e7d8f956a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:04.458424 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16cfdcd-2fe4-4fe9-aa10-02e7d8f956a3 admin admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:04.458704 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16cfdcd-2fe4-4fe9-aa10-02e7d8f956a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:04.459105 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16cfdcd-2fe4-4fe9-aa10-02e7d8f956a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:04.459749 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16cfdcd-2fe4-4fe9-aa10-02e7d8f956a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:04.461074 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408038d2-9581-4ee9-b01a-5f458dfb2014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:04.461701 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16cfdcd-2fe4-4fe9-aa10-02e7d8f956a3 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:04.461836 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408038d2-9581-4ee9-b01a-5f458dfb2014 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:04.462151 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408038d2-9581-4ee9-b01a-5f458dfb2014 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:04.462492 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408038d2-9581-4ee9-b01a-5f458dfb2014 admin admin] PATH_INFO: `/v3/projects/e441796f96954755b4d32bca3fa543c3` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:04.463674 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408038d2-9581-4ee9-b01a-5f458dfb2014 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e441796f96954755b4d32bca3fa543c3)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:04.465692 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408038d2-9581-4ee9-b01a-5f458dfb2014 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:04.629259 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1060/2117] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Oct 4 12:03:04 2022] POST /identity/v3/projects => generated 389 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:03:04.633405 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16cfdcd-2fe4-4fe9-aa10-02e7d8f956a3 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:04.645115 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-408038d2-9581-4ee9-b01a-5f458dfb2014 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e441796f96954755b4d32bca3fa543c3', 'request_id': 'req-408038d2-9581-4ee9-b01a-5f458dfb2014'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:04.652160 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-408038d2-9581-4ee9-b01a-5f458dfb2014 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e441796f96954755b4d32bca3fa543c3', 'request_id': 'req-408038d2-9581-4ee9-b01a-5f458dfb2014'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:04.696461 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16cfdcd-2fe4-4fe9-aa10-02e7d8f956a3 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:04.701446 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659421c0-b2f7-470f-898d-51ff105bc5ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:04.702107 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659421c0-b2f7-470f-898d-51ff105bc5ef admin admin] REQUEST_METHOD: `PUT` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:04.702383 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659421c0-b2f7-470f-898d-51ff105bc5ef admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:04.702651 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659421c0-b2f7-470f-898d-51ff105bc5ef admin admin] PATH_INFO: `/v3/projects/3fd1c6772cf845369379cd2d367c9f46/users/4934007ea91a4379bb5ed961830076d6/roles/d6e7421d1ff9451c808004b818354550` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:04.704717 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659421c0-b2f7-470f-898d-51ff105bc5ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fd1c6772cf845369379cd2d367c9f46, user_id=4934007ea91a4379bb5ed961830076d6, role_id=d6e7421d1ff9451c808004b818354550)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:04.707724 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659421c0-b2f7-470f-898d-51ff105bc5ef admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:04.718430 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1061/2118] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Oct 4 12:03:04 2022] PUT /identity/v3/projects/3fd1c6772cf845369379cd2d367c9f46/users/4934007ea91a4379bb5ed961830076d6/roles/d6e7421d1ff9451c808004b818354550 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:03:04.719354 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659421c0-b2f7-470f-898d-51ff105bc5ef admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:04.758332 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-408038d2-9581-4ee9-b01a-5f458dfb2014 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e441796f96954755b4d32bca3fa543c3', 'request_id': 'req-408038d2-9581-4ee9-b01a-5f458dfb2014'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:04.776727 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-408038d2-9581-4ee9-b01a-5f458dfb2014 admin admin] The token cache is being invalidate because project e441796f96954755b4d32bca3fa543c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:03:04.777133 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-408038d2-9581-4ee9-b01a-5f458dfb2014 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:04.777931 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-408038d2-9581-4ee9-b01a-5f458dfb2014 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:04.779680 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1058/2119] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Oct 4 12:03:04 2022] DELETE /identity/v3/projects/e441796f96954755b4d32bca3fa543c3 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:03:04.780985 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441aaba6-7d83-4960-b351-5dc3af2d1b1e None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:04.781269 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441aaba6-7d83-4960-b351-5dc3af2d1b1e None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:04.781641 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441aaba6-7d83-4960-b351-5dc3af2d1b1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:04.789217 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659421c0-b2f7-470f-898d-51ff105bc5ef admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:04.794005 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9cf53e-27ab-471d-99ae-533ef8be8c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:04.794619 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9cf53e-27ab-471d-99ae-533ef8be8c88 admin admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:04.794895 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9cf53e-27ab-471d-99ae-533ef8be8c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:04.795166 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9cf53e-27ab-471d-99ae-533ef8be8c88 admin admin] PATH_INFO: `/v3/users` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:04.795799 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9cf53e-27ab-471d-99ae-533ef8be8c88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:04.797740 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9cf53e-27ab-471d-99ae-533ef8be8c88 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:04.811404 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-441aaba6-7d83-4960-b351-5dc3af2d1b1e None None] MFA Rules not processed for user `4934007ea91a4379bb5ed961830076d6`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:03:04.812664 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-441aaba6-7d83-4960-b351-5dc3af2d1b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:03:04.884007 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1059/2120] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:03:04 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:03:04.885307 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d88165-ad0b-45d5-92bf-9ae1fb5a3017 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:04.885595 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d88165-ad0b-45d5-92bf-9ae1fb5a3017 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:04.885871 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d88165-ad0b-45d5-92bf-9ae1fb5a3017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:04.920789 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-30d88165-ad0b-45d5-92bf-9ae1fb5a3017 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:03:04.920789 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-30d88165-ad0b-45d5-92bf-9ae1fb5a3017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:03:04.921371 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1060/2121] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:03:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:03:04.922347 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d88165-ad0b-45d5-92bf-9ae1fb5a3017 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:04.923600 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-30d88165-ad0b-45d5-92bf-9ae1fb5a3017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:03:04.976883 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1062/2122] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Oct 4 12:03:04 2022] POST /identity/v3/users => generated 301 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:03:04.978772 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b918653-92b2-4e56-b84b-783c0e77cbf5 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:04.979241 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b918653-92b2-4e56-b84b-783c0e77cbf5 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:04.979523 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b918653-92b2-4e56-b84b-783c0e77cbf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:04.991220 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d88165-ad0b-45d5-92bf-9ae1fb5a3017 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:04.995173 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e83e60b-2ef9-4205-b151-ecedc99d4c5f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e2a05b782424ab2928b5864f1bfd556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:04.995791 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e83e60b-2ef9-4205-b151-ecedc99d4c5f service cinder] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:04.996066 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e83e60b-2ef9-4205-b151-ecedc99d4c5f service cinder] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:04.996349 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e83e60b-2ef9-4205-b151-ecedc99d4c5f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:05.006308 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e83e60b-2ef9-4205-b151-ecedc99d4c5f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:05.007952 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e83e60b-2ef9-4205-b151-ecedc99d4c5f service cinder] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:05.018807 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1061/2123] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:03:04 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:03:05.019970 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e83e60b-2ef9-4205-b151-ecedc99d4c5f service cinder] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:05.021227 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-1e83e60b-2ef9-4205-b151-ecedc99d4c5f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:03:05.026470 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-7b918653-92b2-4e56-b84b-783c0e77cbf5 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:03:05.027822 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-7b918653-92b2-4e56-b84b-783c0e77cbf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:03:05.042361 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e83e60b-2ef9-4205-b151-ecedc99d4c5f service cinder] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:05.043794 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1063/2124] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:03:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:03:05.048380 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b918653-92b2-4e56-b84b-783c0e77cbf5 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:05.055345 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f85bc9b-6ac3-4adf-9b94-d99b6074a459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:05.055847 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f85bc9b-6ac3-4adf-9b94-d99b6074a459 admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:05.056537 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f85bc9b-6ac3-4adf-9b94-d99b6074a459 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:05.056851 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f85bc9b-6ac3-4adf-9b94-d99b6074a459 admin admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:05.057509 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f85bc9b-6ac3-4adf-9b94-d99b6074a459 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:05.059908 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b918653-92b2-4e56-b84b-783c0e77cbf5 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:05.060304 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f85bc9b-6ac3-4adf-9b94-d99b6074a459 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:05.069792 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f423af-4def-4cf8-9f07-492798c510bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:05.070613 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f423af-4def-4cf8-9f07-492798c510bf admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:05.071042 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f423af-4def-4cf8-9f07-492798c510bf admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:05.071500 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f423af-4def-4cf8-9f07-492798c510bf admin admin] PATH_INFO: `/v3/domains` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:05.072289 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f423af-4def-4cf8-9f07-492798c510bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:03:05.072488 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1062/2125] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:03:05 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:03:05.072934 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f423af-4def-4cf8-9f07-492798c510bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:05.074538 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f423af-4def-4cf8-9f07-492798c510bf admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:05.076949 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f85bc9b-6ac3-4adf-9b94-d99b6074a459 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:05.088507 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f85bc9b-6ac3-4adf-9b94-d99b6074a459 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:05.090616 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1064/2126] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Oct 4 12:03:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:03:05.096464 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7072cd43-fb6e-4537-b1c0-06a238660546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:05.096464 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7072cd43-fb6e-4537-b1c0-06a238660546 admin admin] REQUEST_METHOD: `PUT` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:05.096464 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7072cd43-fb6e-4537-b1c0-06a238660546 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:05.096464 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7072cd43-fb6e-4537-b1c0-06a238660546 admin admin] PATH_INFO: `/v3/projects/dd0b53cd16f04d3cb86f1a79535b8072/users/8811d787ca2e4adfb08da0cdd268e401/roles/d6e7421d1ff9451c808004b818354550` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:05.101627 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f423af-4def-4cf8-9f07-492798c510bf admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:05.114609 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f423af-4def-4cf8-9f07-492798c510bf admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:05.116387 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7072cd43-fb6e-4537-b1c0-06a238660546 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd0b53cd16f04d3cb86f1a79535b8072, user_id=8811d787ca2e4adfb08da0cdd268e401, role_id=d6e7421d1ff9451c808004b818354550)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:05.119446 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7072cd43-fb6e-4537-b1c0-06a238660546 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:05.119598 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240eb6f0-0468-4b0d-b004-bf1038631ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:05.120166 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240eb6f0-0468-4b0d-b004-bf1038631ac8 admin admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:05.120454 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240eb6f0-0468-4b0d-b004-bf1038631ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:05.120775 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240eb6f0-0468-4b0d-b004-bf1038631ac8 admin admin] PATH_INFO: `/v3/projects` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:05.121408 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240eb6f0-0468-4b0d-b004-bf1038631ac8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:05.123521 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240eb6f0-0468-4b0d-b004-bf1038631ac8 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:05.210038 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1063/2127] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Oct 4 12:03:05 2022] PUT /identity/v3/projects/dd0b53cd16f04d3cb86f1a79535b8072/users/8811d787ca2e4adfb08da0cdd268e401/roles/d6e7421d1ff9451c808004b818354550 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:03:05.210899 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7072cd43-fb6e-4537-b1c0-06a238660546 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:05.212628 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-7072cd43-fb6e-4537-b1c0-06a238660546 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:03:05.282934 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7072cd43-fb6e-4537-b1c0-06a238660546 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:05.287407 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df9c9d3-9d6b-4e6a-81e5-e06f0ca043a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e2a05b782424ab2928b5864f1bfd556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:05.288019 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df9c9d3-9d6b-4e6a-81e5-e06f0ca043a7 service cinder] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:05.288295 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df9c9d3-9d6b-4e6a-81e5-e06f0ca043a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:05.288564 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df9c9d3-9d6b-4e6a-81e5-e06f0ca043a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:05.290357 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-5df9c9d3-9d6b-4e6a-81e5-e06f0ca043a7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:03:05.353601 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df9c9d3-9d6b-4e6a-81e5-e06f0ca043a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:05.355364 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df9c9d3-9d6b-4e6a-81e5-e06f0ca043a7 service cinder] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:05.356168 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1065/2128] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Oct 4 12:03:05 2022] POST /identity/v3/projects => generated 371 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:03:05.360389 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240eb6f0-0468-4b0d-b004-bf1038631ac8 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:05.368627 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1064/2129] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:03:05 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:03:05.369737 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df9c9d3-9d6b-4e6a-81e5-e06f0ca043a7 service cinder] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:05.486211 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240eb6f0-0468-4b0d-b004-bf1038631ac8 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:05.486388 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df9c9d3-9d6b-4e6a-81e5-e06f0ca043a7 service cinder] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:05.494810 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920c6e8a-96af-402c-914d-a4f5a07783f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:05.496582 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920c6e8a-96af-402c-914d-a4f5a07783f0 admin admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:05.497049 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920c6e8a-96af-402c-914d-a4f5a07783f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:05.498222 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920c6e8a-96af-402c-914d-a4f5a07783f0 admin admin] PATH_INFO: `/v3/users` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:05.499740 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920c6e8a-96af-402c-914d-a4f5a07783f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:05.500454 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0475119f-b2c4-4399-80f7-5b32c18edfd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:05.502633 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920c6e8a-96af-402c-914d-a4f5a07783f0 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:05.506439 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0475119f-b2c4-4399-80f7-5b32c18edfd6 admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:05.506439 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0475119f-b2c4-4399-80f7-5b32c18edfd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:05.506439 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0475119f-b2c4-4399-80f7-5b32c18edfd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:05.506439 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0475119f-b2c4-4399-80f7-5b32c18edfd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:05.509731 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0475119f-b2c4-4399-80f7-5b32c18edfd6 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:05.541394 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1066/2130] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:03:05 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:03:05.545681 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0475119f-b2c4-4399-80f7-5b32c18edfd6 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:05.560340 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0475119f-b2c4-4399-80f7-5b32c18edfd6 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:05.573933 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1d8992-69ce-4de2-a526-4be484824717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:05.575129 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1d8992-69ce-4de2-a526-4be484824717 admin admin] REQUEST_METHOD: `PUT` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:05.578496 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1d8992-69ce-4de2-a526-4be484824717 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:05.578496 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1d8992-69ce-4de2-a526-4be484824717 admin admin] PATH_INFO: `/v3/projects/dd0b53cd16f04d3cb86f1a79535b8072/users/8811d787ca2e4adfb08da0cdd268e401/roles/d6e7421d1ff9451c808004b818354550` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:05.582354 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1d8992-69ce-4de2-a526-4be484824717 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd0b53cd16f04d3cb86f1a79535b8072, user_id=8811d787ca2e4adfb08da0cdd268e401, role_id=d6e7421d1ff9451c808004b818354550)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:05.588756 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1d8992-69ce-4de2-a526-4be484824717 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:05.619361 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1067/2131] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Oct 4 12:03:05 2022] PUT /identity/v3/projects/dd0b53cd16f04d3cb86f1a79535b8072/users/8811d787ca2e4adfb08da0cdd268e401/roles/d6e7421d1ff9451c808004b818354550 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:03:05.639064 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e530246-88b2-4444-94df-ed040e0c9b45 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:05.639386 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e530246-88b2-4444-94df-ed040e0c9b45 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:05.639666 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e530246-88b2-4444-94df-ed040e0c9b45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:05.669217 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-7e530246-88b2-4444-94df-ed040e0c9b45 None None] MFA Rules not processed for user `8811d787ca2e4adfb08da0cdd268e401`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:03:05.670434 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-7e530246-88b2-4444-94df-ed040e0c9b45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:03:05.699284 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1065/2132] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Oct 4 12:03:05 2022] POST /identity/v3/users => generated 286 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:03:05.700363 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920c6e8a-96af-402c-914d-a4f5a07783f0 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:05.710683 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920c6e8a-96af-402c-914d-a4f5a07783f0 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:05.753457 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1068/2133] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:03:05 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 12:03:05.764293 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e530246-88b2-4444-94df-ed040e0c9b45 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:05.777332 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f7ccbf-156b-4166-9ff9-d8a4a793966d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:05.778195 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f7ccbf-156b-4166-9ff9-d8a4a793966d admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:05.778713 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f7ccbf-156b-4166-9ff9-d8a4a793966d admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:05.781561 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f7ccbf-156b-4166-9ff9-d8a4a793966d admin admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:05.781561 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f7ccbf-156b-4166-9ff9-d8a4a793966d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:05.781880 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f7ccbf-156b-4166-9ff9-d8a4a793966d admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:05.793025 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1066/2134] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:03:05 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:03:05.796629 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f7ccbf-156b-4166-9ff9-d8a4a793966d admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:05.809720 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f7ccbf-156b-4166-9ff9-d8a4a793966d admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:05.817794 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69b7072-f054-4f58-a39c-97d417bd7db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:05.818412 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69b7072-f054-4f58-a39c-97d417bd7db2 admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:05.818744 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69b7072-f054-4f58-a39c-97d417bd7db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:05.819017 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69b7072-f054-4f58-a39c-97d417bd7db2 admin admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:05.819710 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69b7072-f054-4f58-a39c-97d417bd7db2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:05.821540 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69b7072-f054-4f58-a39c-97d417bd7db2 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:05.826305 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e530246-88b2-4444-94df-ed040e0c9b45 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:05.830478 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d273191f-b7d5-452c-b68a-cc2ec926ddc8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e2a05b782424ab2928b5864f1bfd556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:05.831077 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d273191f-b7d5-452c-b68a-cc2ec926ddc8 service cinder] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:05.831350 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d273191f-b7d5-452c-b68a-cc2ec926ddc8 service cinder] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:05.831617 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d273191f-b7d5-452c-b68a-cc2ec926ddc8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:05.836919 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1067/2135] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:03:05 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 12:03:05.837735 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69b7072-f054-4f58-a39c-97d417bd7db2 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:05.841445 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d273191f-b7d5-452c-b68a-cc2ec926ddc8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:05.843065 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d273191f-b7d5-452c-b68a-cc2ec926ddc8 service cinder] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:05.851857 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69b7072-f054-4f58-a39c-97d417bd7db2 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:05.853928 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1069/2136] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:03:05 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:03:05.857007 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d42bbf-2eab-401d-bacd-e7a9e0fbddc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:05.857672 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d42bbf-2eab-401d-bacd-e7a9e0fbddc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:05.857953 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d42bbf-2eab-401d-bacd-e7a9e0fbddc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:05.858230 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d42bbf-2eab-401d-bacd-e7a9e0fbddc2 admin admin] PATH_INFO: `/v3/projects/d2c2d1b48c3c4556a3a876837b36d1dc/users/d10032bc71e64ffdb16753c659b98a3c/roles/ab4307f3b7994c1c80036fa7db93b6b9` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:05.874718 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d42bbf-2eab-401d-bacd-e7a9e0fbddc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2c2d1b48c3c4556a3a876837b36d1dc, user_id=d10032bc71e64ffdb16753c659b98a3c, role_id=ab4307f3b7994c1c80036fa7db93b6b9)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:05.878005 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d42bbf-2eab-401d-bacd-e7a9e0fbddc2 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:05.998358 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:03:06.012224 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1068/2137] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Oct 4 12:03:05 2022] PUT /identity/v3/projects/d2c2d1b48c3c4556a3a876837b36d1dc/users/d10032bc71e64ffdb16753c659b98a3c/roles/ab4307f3b7994c1c80036fa7db93b6b9 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:03:06.018618 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d42bbf-2eab-401d-bacd-e7a9e0fbddc2 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:06.019225 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e790e2-6c31-4876-9184-618c196889f6 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:06.019225 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e790e2-6c31-4876-9184-618c196889f6 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:06.019989 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e790e2-6c31-4876-9184-618c196889f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:06.041286 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-88e790e2-6c31-4876-9184-618c196889f6 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:03:06.043069 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-88e790e2-6c31-4876-9184-618c196889f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:03:06.129643 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1070/2138] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:03:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 12:03:06.140249 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e790e2-6c31-4876-9184-618c196889f6 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:06.141909 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-88e790e2-6c31-4876-9184-618c196889f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:03:06.151420 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d42bbf-2eab-401d-bacd-e7a9e0fbddc2 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:06.156333 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3394768a-4755-4e5b-ae72-56c8acb8412a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:06.157160 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3394768a-4755-4e5b-ae72-56c8acb8412a admin admin] REQUEST_METHOD: `DELETE` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:06.157542 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3394768a-4755-4e5b-ae72-56c8acb8412a admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:06.157905 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3394768a-4755-4e5b-ae72-56c8acb8412a admin admin] PATH_INFO: `/v3/users/1d9d6e71a42848d1ab82e388dc42145e` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:06.165447 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3394768a-4755-4e5b-ae72-56c8acb8412a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d9d6e71a42848d1ab82e388dc42145e)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:06.167496 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3394768a-4755-4e5b-ae72-56c8acb8412a admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:06.241536 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e790e2-6c31-4876-9184-618c196889f6 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:06.242858 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af82a225-3eca-49c6-b287-0df37f66e6b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7289515c5c44914a19daa439de98cb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:06.243537 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af82a225-3eca-49c6-b287-0df37f66e6b2 service neutron] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:06.244542 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af82a225-3eca-49c6-b287-0df37f66e6b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:06.244903 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af82a225-3eca-49c6-b287-0df37f66e6b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:06.255793 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af82a225-3eca-49c6-b287-0df37f66e6b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:06.257335 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af82a225-3eca-49c6-b287-0df37f66e6b2 service neutron] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:06.267286 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1071/2139] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:03:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:03:06.569441 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-3394768a-4755-4e5b-ae72-56c8acb8412a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d9d6e71a42848d1ab82e388dc42145e'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:06.579334 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-3394768a-4755-4e5b-ae72-56c8acb8412a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d9d6e71a42848d1ab82e388dc42145e'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:06.580158 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-3394768a-4755-4e5b-ae72-56c8acb8412a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d9d6e71a42848d1ab82e388dc42145e'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:06.581734 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-3394768a-4755-4e5b-ae72-56c8acb8412a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d9d6e71a42848d1ab82e388dc42145e'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:06.722052 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-3394768a-4755-4e5b-ae72-56c8acb8412a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d9d6e71a42848d1ab82e388dc42145e'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:06.776579 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1069/2140] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Oct 4 12:03:06 2022] DELETE /identity/v3/users/1d9d6e71a42848d1ab82e388dc42145e => generated 0 bytes in 759 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:03:06.781686 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb810ded-4400-4fe5-abd1-c0fb8c58fc24 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:06.782201 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb810ded-4400-4fe5-abd1-c0fb8c58fc24 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:06.782630 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb810ded-4400-4fe5-abd1-c0fb8c58fc24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:06.812994 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-fb810ded-4400-4fe5-abd1-c0fb8c58fc24 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:03:06.815240 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-fb810ded-4400-4fe5-abd1-c0fb8c58fc24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:03:06.889794 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1072/2141] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:03:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:03:06.901014 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3394768a-4755-4e5b-ae72-56c8acb8412a admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:06.902471 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-3394768a-4755-4e5b-ae72-56c8acb8412a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:03:06.964670 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3394768a-4755-4e5b-ae72-56c8acb8412a admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:06.968482 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b093d1-bc4d-4996-999d-6e6ee9854cd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7289515c5c44914a19daa439de98cb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:06.969190 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b093d1-bc4d-4996-999d-6e6ee9854cd6 service neutron] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:06.969455 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b093d1-bc4d-4996-999d-6e6ee9854cd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:06.969727 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b093d1-bc4d-4996-999d-6e6ee9854cd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:06.980351 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b093d1-bc4d-4996-999d-6e6ee9854cd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:06.982014 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b093d1-bc4d-4996-999d-6e6ee9854cd6 service neutron] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:06.993746 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1070/2142] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:03:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:03:07.586807 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:03:07.592575 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb810ded-4400-4fe5-abd1-c0fb8c58fc24 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:07.594108 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-fb810ded-4400-4fe5-abd1-c0fb8c58fc24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:03:07.662910 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb810ded-4400-4fe5-abd1-c0fb8c58fc24 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:07.689033 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53464443-bd4a-4c51-94af-68d28aa53fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:07.690557 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53464443-bd4a-4c51-94af-68d28aa53fe9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:07.690987 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53464443-bd4a-4c51-94af-68d28aa53fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:07.691479 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53464443-bd4a-4c51-94af-68d28aa53fe9 admin admin] PATH_INFO: `/v3/projects/708a9dbf808e416ba6dd9f7a4f4cc519` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:07.695457 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53464443-bd4a-4c51-94af-68d28aa53fe9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=708a9dbf808e416ba6dd9f7a4f4cc519)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:07.706124 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53464443-bd4a-4c51-94af-68d28aa53fe9 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:07.961457 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-53464443-bd4a-4c51-94af-68d28aa53fe9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '708a9dbf808e416ba6dd9f7a4f4cc519', 'request_id': 'req-53464443-bd4a-4c51-94af-68d28aa53fe9'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:08.056402 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-53464443-bd4a-4c51-94af-68d28aa53fe9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '708a9dbf808e416ba6dd9f7a4f4cc519', 'request_id': 'req-53464443-bd4a-4c51-94af-68d28aa53fe9'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:08.066552 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-53464443-bd4a-4c51-94af-68d28aa53fe9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '708a9dbf808e416ba6dd9f7a4f4cc519', 'request_id': 'req-53464443-bd4a-4c51-94af-68d28aa53fe9'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:08.095712 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-53464443-bd4a-4c51-94af-68d28aa53fe9 admin admin] The token cache is being invalidate because project 708a9dbf808e416ba6dd9f7a4f4cc519 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:03:08.096323 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-53464443-bd4a-4c51-94af-68d28aa53fe9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:08.097480 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-53464443-bd4a-4c51-94af-68d28aa53fe9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:08.102505 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1073/2143] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Oct 4 12:03:07 2022] DELETE /identity/v3/projects/708a9dbf808e416ba6dd9f7a4f4cc519 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:03:08.104052 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b093d1-bc4d-4996-999d-6e6ee9854cd6 service neutron] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:08.121565 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b093d1-bc4d-4996-999d-6e6ee9854cd6 service neutron] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:08.189193 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d87d18-22ed-4cd4-9296-a5b54302ff93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:08.190114 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d87d18-22ed-4cd4-9296-a5b54302ff93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:08.190471 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d87d18-22ed-4cd4-9296-a5b54302ff93 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:08.191008 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d87d18-22ed-4cd4-9296-a5b54302ff93 admin admin] PATH_INFO: `/v3/users/8811d787ca2e4adfb08da0cdd268e401` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:08.192613 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d87d18-22ed-4cd4-9296-a5b54302ff93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8811d787ca2e4adfb08da0cdd268e401)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:08.194972 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d87d18-22ed-4cd4-9296-a5b54302ff93 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:08.657546 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6df13a9-e4e6-4087-931a-90845199c03d None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:08.658167 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6df13a9-e4e6-4087-931a-90845199c03d None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:08.658167 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6df13a9-e4e6-4087-931a-90845199c03d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:08.671622 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-75d87d18-22ed-4cd4-9296-a5b54302ff93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8811d787ca2e4adfb08da0cdd268e401'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:08.680409 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-75d87d18-22ed-4cd4-9296-a5b54302ff93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8811d787ca2e4adfb08da0cdd268e401'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:08.681311 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-75d87d18-22ed-4cd4-9296-a5b54302ff93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8811d787ca2e4adfb08da0cdd268e401'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:08.682349 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-75d87d18-22ed-4cd4-9296-a5b54302ff93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8811d787ca2e4adfb08da0cdd268e401'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:08.708939 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-a6df13a9-e4e6-4087-931a-90845199c03d None None] MFA Rules not processed for user `d10032bc71e64ffdb16753c659b98a3c`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:03:08.710007 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-a6df13a9-e4e6-4087-931a-90845199c03d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:03:08.815905 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1074/2144] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:03:08 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:03:08.843184 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-75d87d18-22ed-4cd4-9296-a5b54302ff93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8811d787ca2e4adfb08da0cdd268e401'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:08.866713 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1071/2145] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Oct 4 12:03:08 2022] DELETE /identity/v3/users/8811d787ca2e4adfb08da0cdd268e401 => generated 0 bytes in 763 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:03:09.507109 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:03:09.514885 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6df13a9-e4e6-4087-931a-90845199c03d None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:09.516379 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-a6df13a9-e4e6-4087-931a-90845199c03d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:03:09.546841 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d87d18-22ed-4cd4-9296-a5b54302ff93 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:09.549559 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-75d87d18-22ed-4cd4-9296-a5b54302ff93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:03:09.592120 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6df13a9-e4e6-4087-931a-90845199c03d None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:09.650176 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d87d18-22ed-4cd4-9296-a5b54302ff93 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:09.653247 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3817b2-f20d-40f2-a18d-cbed0a7c047f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e2a05b782424ab2928b5864f1bfd556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:09.653875 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3817b2-f20d-40f2-a18d-cbed0a7c047f service cinder] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:09.654193 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3817b2-f20d-40f2-a18d-cbed0a7c047f service cinder] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:09.654421 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3817b2-f20d-40f2-a18d-cbed0a7c047f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:09.655434 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d8f50b-b7e1-4f1e-ac60-33b912b6ecd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:09.656087 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d8f50b-b7e1-4f1e-ac60-33b912b6ecd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:09.656374 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d8f50b-b7e1-4f1e-ac60-33b912b6ecd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:09.656674 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d8f50b-b7e1-4f1e-ac60-33b912b6ecd3 admin admin] PATH_INFO: `/v3/projects/dd0b53cd16f04d3cb86f1a79535b8072` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:09.657807 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d8f50b-b7e1-4f1e-ac60-33b912b6ecd3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd0b53cd16f04d3cb86f1a79535b8072)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:09.660106 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d8f50b-b7e1-4f1e-ac60-33b912b6ecd3 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:09.730730 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3817b2-f20d-40f2-a18d-cbed0a7c047f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:09.732205 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3817b2-f20d-40f2-a18d-cbed0a7c047f service cinder] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:09.742164 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1075/2146] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:03:09 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:03:09.905969 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-11d8f50b-b7e1-4f1e-ac60-33b912b6ecd3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd0b53cd16f04d3cb86f1a79535b8072', 'request_id': 'req-11d8f50b-b7e1-4f1e-ac60-33b912b6ecd3'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:09.925278 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-11d8f50b-b7e1-4f1e-ac60-33b912b6ecd3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd0b53cd16f04d3cb86f1a79535b8072', 'request_id': 'req-11d8f50b-b7e1-4f1e-ac60-33b912b6ecd3'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:10.066875 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-11d8f50b-b7e1-4f1e-ac60-33b912b6ecd3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd0b53cd16f04d3cb86f1a79535b8072', 'request_id': 'req-11d8f50b-b7e1-4f1e-ac60-33b912b6ecd3'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:10.079827 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-11d8f50b-b7e1-4f1e-ac60-33b912b6ecd3 admin admin] The token cache is being invalidate because project dd0b53cd16f04d3cb86f1a79535b8072 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:03:10.081062 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-11d8f50b-b7e1-4f1e-ac60-33b912b6ecd3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:10.082477 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-11d8f50b-b7e1-4f1e-ac60-33b912b6ecd3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:10.084699 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1072/2147] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Oct 4 12:03:09 2022] DELETE /identity/v3/projects/dd0b53cd16f04d3cb86f1a79535b8072 => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:03:10.089755 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3241e2-4f3b-47c2-b763-2a96648d9008 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:10.090246 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3241e2-4f3b-47c2-b763-2a96648d9008 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:10.090666 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3241e2-4f3b-47c2-b763-2a96648d9008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:10.112982 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-dc3241e2-4f3b-47c2-b763-2a96648d9008 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:03:10.114201 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-dc3241e2-4f3b-47c2-b763-2a96648d9008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:03:10.183245 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1076/2148] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:03:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 12:03:10.196242 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffef85e6-22a1-4404-8daa-96d1388bde32 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:10.196531 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffef85e6-22a1-4404-8daa-96d1388bde32 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:10.196842 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffef85e6-22a1-4404-8daa-96d1388bde32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:10.223152 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-ffef85e6-22a1-4404-8daa-96d1388bde32 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:03:10.226115 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-ffef85e6-22a1-4404-8daa-96d1388bde32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:03:10.238124 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1073/2149] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:03:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:03:10.239448 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3241e2-4f3b-47c2-b763-2a96648d9008 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:10.253275 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3241e2-4f3b-47c2-b763-2a96648d9008 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:10.258290 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01175fe-c29b-49af-bd96-779153905bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:10.259222 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01175fe-c29b-49af-bd96-779153905bca admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:10.270272 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01175fe-c29b-49af-bd96-779153905bca admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:10.270608 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01175fe-c29b-49af-bd96-779153905bca admin admin] PATH_INFO: `/v3/domains` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:10.271438 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01175fe-c29b-49af-bd96-779153905bca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:03:10.281512 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01175fe-c29b-49af-bd96-779153905bca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:10.283300 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01175fe-c29b-49af-bd96-779153905bca admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:10.297347 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1077/2150] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Oct 4 12:03:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:03:10.302455 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffef85e6-22a1-4404-8daa-96d1388bde32 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:10.311782 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffef85e6-22a1-4404-8daa-96d1388bde32 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:10.316786 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460ccbe0-0e9e-4a3a-9b57-9e1cc70d632f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:10.317543 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460ccbe0-0e9e-4a3a-9b57-9e1cc70d632f admin admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:10.317827 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460ccbe0-0e9e-4a3a-9b57-9e1cc70d632f admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:10.318101 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460ccbe0-0e9e-4a3a-9b57-9e1cc70d632f admin admin] PATH_INFO: `/v3/projects` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:10.318747 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460ccbe0-0e9e-4a3a-9b57-9e1cc70d632f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:10.320654 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460ccbe0-0e9e-4a3a-9b57-9e1cc70d632f admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:10.498940 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1074/2151] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Oct 4 12:03:10 2022] POST /identity/v3/projects => generated 367 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:03:10.503719 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01175fe-c29b-49af-bd96-779153905bca admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:10.514289 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01175fe-c29b-49af-bd96-779153905bca admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:10.582068 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e1180f-86dd-404a-b976-f057836bd103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:10.582684 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e1180f-86dd-404a-b976-f057836bd103 admin admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:10.582966 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e1180f-86dd-404a-b976-f057836bd103 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:10.583240 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e1180f-86dd-404a-b976-f057836bd103 admin admin] PATH_INFO: `/v3/users` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:10.583870 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e1180f-86dd-404a-b976-f057836bd103 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:10.585834 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e1180f-86dd-404a-b976-f057836bd103 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:10.789683 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1078/2152] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Oct 4 12:03:10 2022] POST /identity/v3/users => generated 284 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:03:10.790904 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460ccbe0-0e9e-4a3a-9b57-9e1cc70d632f admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:10.802287 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460ccbe0-0e9e-4a3a-9b57-9e1cc70d632f admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:10.806876 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db2d3e9-92bd-43ce-b7de-9498489df005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:10.807471 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db2d3e9-92bd-43ce-b7de-9498489df005 admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:10.807752 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db2d3e9-92bd-43ce-b7de-9498489df005 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:10.808032 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db2d3e9-92bd-43ce-b7de-9498489df005 admin admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:10.808708 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db2d3e9-92bd-43ce-b7de-9498489df005 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:10.810299 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db2d3e9-92bd-43ce-b7de-9498489df005 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:10.821336 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1075/2153] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:03:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:03:10.825465 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e1180f-86dd-404a-b976-f057836bd103 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:10.835998 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e1180f-86dd-404a-b976-f057836bd103 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:10.840691 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6d2d56-1988-428b-a3e1-5a05a4d82b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:10.840963 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6d2d56-1988-428b-a3e1-5a05a4d82b82 admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:10.841243 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6d2d56-1988-428b-a3e1-5a05a4d82b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:10.841516 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6d2d56-1988-428b-a3e1-5a05a4d82b82 admin admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:10.842154 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6d2d56-1988-428b-a3e1-5a05a4d82b82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:10.844360 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6d2d56-1988-428b-a3e1-5a05a4d82b82 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:10.864988 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1079/2154] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:03:10 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:03:10.868474 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db2d3e9-92bd-43ce-b7de-9498489df005 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:10.879487 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db2d3e9-92bd-43ce-b7de-9498489df005 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:10.884248 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fdb22f-9958-454c-a648-d10df1798bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:10.884992 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fdb22f-9958-454c-a648-d10df1798bb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:10.885270 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fdb22f-9958-454c-a648-d10df1798bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:10.885539 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fdb22f-9958-454c-a648-d10df1798bb6 admin admin] PATH_INFO: `/v3/projects/93db7cfa3ec84ce98c8413131e15cdd9/users/9c45d668058247d6861a1d5b9989cc16/roles/ab4307f3b7994c1c80036fa7db93b6b9` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:10.909132 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fdb22f-9958-454c-a648-d10df1798bb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93db7cfa3ec84ce98c8413131e15cdd9, user_id=9c45d668058247d6861a1d5b9989cc16, role_id=ab4307f3b7994c1c80036fa7db93b6b9)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:10.911971 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fdb22f-9958-454c-a648-d10df1798bb6 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:11.105799 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1076/2155] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Oct 4 12:03:10 2022] PUT /identity/v3/projects/93db7cfa3ec84ce98c8413131e15cdd9/users/9c45d668058247d6861a1d5b9989cc16/roles/ab4307f3b7994c1c80036fa7db93b6b9 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:03:11.116672 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce061fef-a410-479f-84e2-8f818e780ba1 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:11.116970 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce061fef-a410-479f-84e2-8f818e780ba1 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:11.117240 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce061fef-a410-479f-84e2-8f818e780ba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:11.137017 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:03:11.148983 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-ce061fef-a410-479f-84e2-8f818e780ba1 None None] MFA Rules not processed for user `9c45d668058247d6861a1d5b9989cc16`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:03:11.150253 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-ce061fef-a410-479f-84e2-8f818e780ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:03:11.227882 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1080/2156] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:03:11 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:03:11.232269 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fdb22f-9958-454c-a648-d10df1798bb6 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:11.307033 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fdb22f-9958-454c-a648-d10df1798bb6 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:11.312389 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a80f38-33f9-49af-83c7-8d6895a53676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:11.313036 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a80f38-33f9-49af-83c7-8d6895a53676 admin admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:11.313319 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a80f38-33f9-49af-83c7-8d6895a53676 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:11.313594 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a80f38-33f9-49af-83c7-8d6895a53676 admin admin] PATH_INFO: `/v3/projects` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:11.314237 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a80f38-33f9-49af-83c7-8d6895a53676 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:11.316827 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a80f38-33f9-49af-83c7-8d6895a53676 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:11.571133 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1077/2157] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Oct 4 12:03:11 2022] POST /identity/v3/projects => generated 367 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:03:11.574990 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce061fef-a410-479f-84e2-8f818e780ba1 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:11.585918 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce061fef-a410-479f-84e2-8f818e780ba1 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:11.641798 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06063681-55f6-4725-924c-88a2fd85aa8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:11.642442 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06063681-55f6-4725-924c-88a2fd85aa8b admin admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:11.642752 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06063681-55f6-4725-924c-88a2fd85aa8b admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:11.643071 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06063681-55f6-4725-924c-88a2fd85aa8b admin admin] PATH_INFO: `/v3/users` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:11.643826 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06063681-55f6-4725-924c-88a2fd85aa8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:11.645913 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06063681-55f6-4725-924c-88a2fd85aa8b admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:11.862190 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1081/2158] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Oct 4 12:03:11 2022] POST /identity/v3/users => generated 290 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:03:11.865550 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a80f38-33f9-49af-83c7-8d6895a53676 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:11.875874 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a80f38-33f9-49af-83c7-8d6895a53676 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:11.881775 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc2feb5-447f-4412-b441-c3ff256aa300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:11.882369 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc2feb5-447f-4412-b441-c3ff256aa300 admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:11.882758 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc2feb5-447f-4412-b441-c3ff256aa300 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:11.883060 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc2feb5-447f-4412-b441-c3ff256aa300 admin admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:11.883700 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc2feb5-447f-4412-b441-c3ff256aa300 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:11.885343 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc2feb5-447f-4412-b441-c3ff256aa300 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:11.897504 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1078/2159] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:03:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:03:11.901619 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06063681-55f6-4725-924c-88a2fd85aa8b admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:11.912352 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06063681-55f6-4725-924c-88a2fd85aa8b admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:11.917167 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a5be05-9a5a-47c4-9213-f26c713bf635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:11.917822 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a5be05-9a5a-47c4-9213-f26c713bf635 admin admin] REQUEST_METHOD: `PUT` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:11.918104 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a5be05-9a5a-47c4-9213-f26c713bf635 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:11.918377 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a5be05-9a5a-47c4-9213-f26c713bf635 admin admin] PATH_INFO: `/v3/projects/87cb2182f64648baba7793c2c9743b3c/users/4d635c57b7204b538dccea6e6cc776ee/roles/d6e7421d1ff9451c808004b818354550` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:11.934893 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a5be05-9a5a-47c4-9213-f26c713bf635 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87cb2182f64648baba7793c2c9743b3c, user_id=4d635c57b7204b538dccea6e6cc776ee, role_id=d6e7421d1ff9451c808004b818354550)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:11.937851 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a5be05-9a5a-47c4-9213-f26c713bf635 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:12.067950 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1082/2160] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Oct 4 12:03:11 2022] PUT /identity/v3/projects/87cb2182f64648baba7793c2c9743b3c/users/4d635c57b7204b538dccea6e6cc776ee/roles/d6e7421d1ff9451c808004b818354550 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:03:12.089493 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc2feb5-447f-4412-b441-c3ff256aa300 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:12.099921 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc2feb5-447f-4412-b441-c3ff256aa300 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:12.163619 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ad9b60-73ad-4f3d-8671-f6b1d8220b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:12.164401 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ad9b60-73ad-4f3d-8671-f6b1d8220b92 admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:12.164715 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ad9b60-73ad-4f3d-8671-f6b1d8220b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:12.165056 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ad9b60-73ad-4f3d-8671-f6b1d8220b92 admin admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:12.165811 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ad9b60-73ad-4f3d-8671-f6b1d8220b92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:12.167988 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ad9b60-73ad-4f3d-8671-f6b1d8220b92 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:12.184796 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1079/2161] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:03:12 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:03:12.194572 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a5be05-9a5a-47c4-9213-f26c713bf635 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:12.206332 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a5be05-9a5a-47c4-9213-f26c713bf635 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:12.212375 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e04356-f22d-41de-8582-be5ddf2fef97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:12.213080 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e04356-f22d-41de-8582-be5ddf2fef97 admin admin] REQUEST_METHOD: `PUT` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:12.213355 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e04356-f22d-41de-8582-be5ddf2fef97 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:12.213626 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e04356-f22d-41de-8582-be5ddf2fef97 admin admin] PATH_INFO: `/v3/projects/87cb2182f64648baba7793c2c9743b3c/users/4d635c57b7204b538dccea6e6cc776ee/roles/d6e7421d1ff9451c808004b818354550` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:12.215982 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c8374c-c4fc-4cd9-96b0-e7be1897df6c None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:12.216117 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e04356-f22d-41de-8582-be5ddf2fef97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87cb2182f64648baba7793c2c9743b3c, user_id=4d635c57b7204b538dccea6e6cc776ee, role_id=d6e7421d1ff9451c808004b818354550)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:12.216266 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c8374c-c4fc-4cd9-96b0-e7be1897df6c None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:12.216546 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c8374c-c4fc-4cd9-96b0-e7be1897df6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:12.218694 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e04356-f22d-41de-8582-be5ddf2fef97 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:12.235474 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1083/2162] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Oct 4 12:03:12 2022] PUT /identity/v3/projects/87cb2182f64648baba7793c2c9743b3c/users/4d635c57b7204b538dccea6e6cc776ee/roles/d6e7421d1ff9451c808004b818354550 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:03:12.248274 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c94415-b0e0-49dc-91e4-cff87f4c3981 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:12.248742 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c94415-b0e0-49dc-91e4-cff87f4c3981 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:12.249119 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c94415-b0e0-49dc-91e4-cff87f4c3981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:12.256286 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-16c8374c-c4fc-4cd9-96b0-e7be1897df6c None None] MFA Rules not processed for user `d10032bc71e64ffdb16753c659b98a3c`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:03:12.256286 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-16c8374c-c4fc-4cd9-96b0-e7be1897df6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:03:12.281504 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-43c94415-b0e0-49dc-91e4-cff87f4c3981 None None] MFA Rules not processed for user `4d635c57b7204b538dccea6e6cc776ee`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:03:12.282651 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-43c94415-b0e0-49dc-91e4-cff87f4c3981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:03:12.324642 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1080/2163] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:03:12 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 12:03:12.360554 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1084/2164] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:03:12 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:03:12.378197 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c8374c-c4fc-4cd9-96b0-e7be1897df6c None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:12.380202 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-16c8374c-c4fc-4cd9-96b0-e7be1897df6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:03:12.445870 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c8374c-c4fc-4cd9-96b0-e7be1897df6c None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:12.450028 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c070e9-ffff-46b6-84fa-2085418f454b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e2a05b782424ab2928b5864f1bfd556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:12.453091 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c070e9-ffff-46b6-84fa-2085418f454b service cinder] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:12.453091 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c070e9-ffff-46b6-84fa-2085418f454b service cinder] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:12.453091 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c070e9-ffff-46b6-84fa-2085418f454b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:12.462475 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c070e9-ffff-46b6-84fa-2085418f454b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:12.465592 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c070e9-ffff-46b6-84fa-2085418f454b service cinder] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:12.477480 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1081/2165] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:03:12 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:03:12.807577 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c94415-b0e0-49dc-91e4-cff87f4c3981 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:12.838639 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c94415-b0e0-49dc-91e4-cff87f4c3981 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:12.844858 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da56a86-3537-4e28-8d38-aeb3b99edc64 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e2a05b782424ab2928b5864f1bfd556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:12.846871 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da56a86-3537-4e28-8d38-aeb3b99edc64 service cinder] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:12.847851 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da56a86-3537-4e28-8d38-aeb3b99edc64 service cinder] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:12.848739 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da56a86-3537-4e28-8d38-aeb3b99edc64 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:12.901987 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c070e9-ffff-46b6-84fa-2085418f454b service cinder] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:12.924536 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-00c070e9-ffff-46b6-84fa-2085418f454b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:03:12.928984 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da56a86-3537-4e28-8d38-aeb3b99edc64 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:12.930468 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da56a86-3537-4e28-8d38-aeb3b99edc64 service cinder] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:12.942856 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:03:12.945013 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1085/2166] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:03:12 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:03:13.043224 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c070e9-ffff-46b6-84fa-2085418f454b service cinder] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:13.049623 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cffc471-b307-4073-a3ad-d86060bf5502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:13.052663 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cffc471-b307-4073-a3ad-d86060bf5502 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:13.053534 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cffc471-b307-4073-a3ad-d86060bf5502 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:13.054111 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cffc471-b307-4073-a3ad-d86060bf5502 admin admin] PATH_INFO: `/v3/users/44ef02af6dd9490784dc1d3429493399` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:13.055702 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cffc471-b307-4073-a3ad-d86060bf5502 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44ef02af6dd9490784dc1d3429493399)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:13.057983 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cffc471-b307-4073-a3ad-d86060bf5502 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:13.454759 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-0cffc471-b307-4073-a3ad-d86060bf5502 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44ef02af6dd9490784dc1d3429493399'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:13.463575 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-0cffc471-b307-4073-a3ad-d86060bf5502 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44ef02af6dd9490784dc1d3429493399'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:13.464672 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-0cffc471-b307-4073-a3ad-d86060bf5502 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44ef02af6dd9490784dc1d3429493399'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:13.465766 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-0cffc471-b307-4073-a3ad-d86060bf5502 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44ef02af6dd9490784dc1d3429493399'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:13.620209 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-0cffc471-b307-4073-a3ad-d86060bf5502 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44ef02af6dd9490784dc1d3429493399'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:13.645773 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1082/2167] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Oct 4 12:03:12 2022] DELETE /identity/v3/users/44ef02af6dd9490784dc1d3429493399 => generated 0 bytes in 745 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:03:13.651446 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272b0e4a-ceb2-40eb-a845-10a1e6ac8f41 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:13.651738 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272b0e4a-ceb2-40eb-a845-10a1e6ac8f41 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:13.652217 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272b0e4a-ceb2-40eb-a845-10a1e6ac8f41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:13.672886 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-272b0e4a-ceb2-40eb-a845-10a1e6ac8f41 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:03:13.674148 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-272b0e4a-ceb2-40eb-a845-10a1e6ac8f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:03:13.738131 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1086/2168] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:03:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:03:13.752901 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cffc471-b307-4073-a3ad-d86060bf5502 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:13.754377 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-0cffc471-b307-4073-a3ad-d86060bf5502 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:03:13.823868 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cffc471-b307-4073-a3ad-d86060bf5502 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:13.827971 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bb7b9c-0de4-4dcb-ba38-ed0ef11d0e6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7289515c5c44914a19daa439de98cb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:13.828624 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bb7b9c-0de4-4dcb-ba38-ed0ef11d0e6b service neutron] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:13.829063 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bb7b9c-0de4-4dcb-ba38-ed0ef11d0e6b service neutron] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:13.829371 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bb7b9c-0de4-4dcb-ba38-ed0ef11d0e6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:13.841273 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bb7b9c-0de4-4dcb-ba38-ed0ef11d0e6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:13.842739 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bb7b9c-0de4-4dcb-ba38-ed0ef11d0e6b service neutron] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:13.854545 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1083/2169] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:03:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:03:14.730465 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272b0e4a-ceb2-40eb-a845-10a1e6ac8f41 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:14.730465 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-272b0e4a-ceb2-40eb-a845-10a1e6ac8f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:03:14.745015 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272b0e4a-ceb2-40eb-a845-10a1e6ac8f41 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:14.749897 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afcae2a-2c05-47a2-961d-3d7f429075da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:14.750541 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afcae2a-2c05-47a2-961d-3d7f429075da admin admin] REQUEST_METHOD: `DELETE` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:14.751874 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afcae2a-2c05-47a2-961d-3d7f429075da admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:14.752110 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afcae2a-2c05-47a2-961d-3d7f429075da admin admin] PATH_INFO: `/v3/projects/cafd783629704825957976b268529df4` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:14.754000 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afcae2a-2c05-47a2-961d-3d7f429075da admin admin] RBAC: Authorizing `identity:delete_project(project_id=cafd783629704825957976b268529df4)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:14.756262 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afcae2a-2c05-47a2-961d-3d7f429075da admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:14.958613 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-8afcae2a-2c05-47a2-961d-3d7f429075da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cafd783629704825957976b268529df4', 'request_id': 'req-8afcae2a-2c05-47a2-961d-3d7f429075da'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:15.062075 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-8afcae2a-2c05-47a2-961d-3d7f429075da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cafd783629704825957976b268529df4', 'request_id': 'req-8afcae2a-2c05-47a2-961d-3d7f429075da'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:15.081794 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-8afcae2a-2c05-47a2-961d-3d7f429075da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cafd783629704825957976b268529df4', 'request_id': 'req-8afcae2a-2c05-47a2-961d-3d7f429075da'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:15.082929 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-8afcae2a-2c05-47a2-961d-3d7f429075da admin admin] The token cache is being invalidate because project cafd783629704825957976b268529df4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:03:15.082929 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-8afcae2a-2c05-47a2-961d-3d7f429075da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:15.083548 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-8afcae2a-2c05-47a2-961d-3d7f429075da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:15.085481 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1087/2170] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Oct 4 12:03:14 2022] DELETE /identity/v3/projects/cafd783629704825957976b268529df4 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:03:15.089519 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bb7b9c-0de4-4dcb-ba38-ed0ef11d0e6b service neutron] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:15.101583 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bb7b9c-0de4-4dcb-ba38-ed0ef11d0e6b service neutron] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:15.166523 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5919d61b-0abe-4b65-a18a-0658694c3f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:15.167208 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5919d61b-0abe-4b65-a18a-0658694c3f38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:15.167489 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5919d61b-0abe-4b65-a18a-0658694c3f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:15.167761 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5919d61b-0abe-4b65-a18a-0658694c3f38 admin admin] PATH_INFO: `/v3/users/4934007ea91a4379bb5ed961830076d6` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:15.169837 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5919d61b-0abe-4b65-a18a-0658694c3f38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4934007ea91a4379bb5ed961830076d6)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:15.172668 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5919d61b-0abe-4b65-a18a-0658694c3f38 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:15.533994 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-5919d61b-0abe-4b65-a18a-0658694c3f38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4934007ea91a4379bb5ed961830076d6'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:15.540834 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-5919d61b-0abe-4b65-a18a-0658694c3f38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4934007ea91a4379bb5ed961830076d6'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:15.541503 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-5919d61b-0abe-4b65-a18a-0658694c3f38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4934007ea91a4379bb5ed961830076d6'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:15.542104 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-5919d61b-0abe-4b65-a18a-0658694c3f38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4934007ea91a4379bb5ed961830076d6'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:15.678885 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:03:15.680255 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-5919d61b-0abe-4b65-a18a-0658694c3f38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4934007ea91a4379bb5ed961830076d6'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:15.706253 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1084/2171] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Oct 4 12:03:15 2022] DELETE /identity/v3/users/4934007ea91a4379bb5ed961830076d6 => generated 0 bytes in 617 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:03:16.246087 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565c527e-886b-474d-9612-fdef49f684eb None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:16.246579 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565c527e-886b-474d-9612-fdef49f684eb None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:16.246672 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565c527e-886b-474d-9612-fdef49f684eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:16.266391 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-565c527e-886b-474d-9612-fdef49f684eb None None] MFA Rules not processed for user `74861e3dd6e14d999aeae1f057b24582`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:03:16.267810 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-565c527e-886b-474d-9612-fdef49f684eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:03:16.287277 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5919d61b-0abe-4b65-a18a-0658694c3f38 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:16.289715 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-5919d61b-0abe-4b65-a18a-0658694c3f38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:03:16.398308 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1088/2172] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:03:16 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:03:16.405955 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5919d61b-0abe-4b65-a18a-0658694c3f38 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:16.423272 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cd4c32-40ee-4d0e-9ce7-32bcad552526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:16.424858 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cd4c32-40ee-4d0e-9ce7-32bcad552526 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:16.424858 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cd4c32-40ee-4d0e-9ce7-32bcad552526 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:16.424858 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cd4c32-40ee-4d0e-9ce7-32bcad552526 admin admin] PATH_INFO: `/v3/projects/3fd1c6772cf845369379cd2d367c9f46` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:16.427003 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cd4c32-40ee-4d0e-9ce7-32bcad552526 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fd1c6772cf845369379cd2d367c9f46)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:16.429027 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cd4c32-40ee-4d0e-9ce7-32bcad552526 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:16.604485 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-87cd4c32-40ee-4d0e-9ce7-32bcad552526 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fd1c6772cf845369379cd2d367c9f46', 'request_id': 'req-87cd4c32-40ee-4d0e-9ce7-32bcad552526'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:16.613772 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-87cd4c32-40ee-4d0e-9ce7-32bcad552526 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fd1c6772cf845369379cd2d367c9f46', 'request_id': 'req-87cd4c32-40ee-4d0e-9ce7-32bcad552526'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:16.763558 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-87cd4c32-40ee-4d0e-9ce7-32bcad552526 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fd1c6772cf845369379cd2d367c9f46', 'request_id': 'req-87cd4c32-40ee-4d0e-9ce7-32bcad552526'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:16.807122 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-87cd4c32-40ee-4d0e-9ce7-32bcad552526 admin admin] The token cache is being invalidate because project 3fd1c6772cf845369379cd2d367c9f46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:03:16.807539 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-87cd4c32-40ee-4d0e-9ce7-32bcad552526 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:16.808634 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-87cd4c32-40ee-4d0e-9ce7-32bcad552526 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:16.810345 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1085/2173] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Oct 4 12:03:16 2022] DELETE /identity/v3/projects/3fd1c6772cf845369379cd2d367c9f46 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:03:16.815517 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71a0211-e683-471c-9471-8d4441d1ab16 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:16.816122 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71a0211-e683-471c-9471-8d4441d1ab16 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:16.816547 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71a0211-e683-471c-9471-8d4441d1ab16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:16.837553 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-f71a0211-e683-471c-9471-8d4441d1ab16 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:03:16.842700 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-f71a0211-e683-471c-9471-8d4441d1ab16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:03:16.938433 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1089/2174] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:03:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 12:03:16.952517 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12431001-3129-4e45-8f76-bfe56a5160ec None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:16.952829 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12431001-3129-4e45-8f76-bfe56a5160ec None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:16.953107 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12431001-3129-4e45-8f76-bfe56a5160ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:16.996425 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-12431001-3129-4e45-8f76-bfe56a5160ec None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:03:17.000012 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-12431001-3129-4e45-8f76-bfe56a5160ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:03:17.021159 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1086/2175] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:03:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:03:17.022417 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71a0211-e683-471c-9471-8d4441d1ab16 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:17.039452 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71a0211-e683-471c-9471-8d4441d1ab16 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:17.045003 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b979a672-5ec5-4211-8275-fc59b4ce0321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:17.045952 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b979a672-5ec5-4211-8275-fc59b4ce0321 admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:17.046460 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b979a672-5ec5-4211-8275-fc59b4ce0321 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:17.046882 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b979a672-5ec5-4211-8275-fc59b4ce0321 admin admin] PATH_INFO: `/v3/domains` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:17.047926 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b979a672-5ec5-4211-8275-fc59b4ce0321 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:03:17.048554 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b979a672-5ec5-4211-8275-fc59b4ce0321 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:17.050607 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b979a672-5ec5-4211-8275-fc59b4ce0321 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:17.068812 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1090/2176] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Oct 4 12:03:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 12:03:17.073352 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12431001-3129-4e45-8f76-bfe56a5160ec None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:17.093333 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12431001-3129-4e45-8f76-bfe56a5160ec None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:17.102548 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74717987-7f6d-4bf7-a187-155b67863ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:17.103428 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74717987-7f6d-4bf7-a187-155b67863ebb admin admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:17.103813 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74717987-7f6d-4bf7-a187-155b67863ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:17.104187 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74717987-7f6d-4bf7-a187-155b67863ebb admin admin] PATH_INFO: `/v3/projects` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:17.105197 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74717987-7f6d-4bf7-a187-155b67863ebb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:17.107225 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74717987-7f6d-4bf7-a187-155b67863ebb admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:17.270767 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1087/2177] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Oct 4 12:03:17 2022] POST /identity/v3/projects => generated 409 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:03:17.278679 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b979a672-5ec5-4211-8275-fc59b4ce0321 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:17.289350 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b979a672-5ec5-4211-8275-fc59b4ce0321 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:17.428126 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce2a94f-bd32-4086-8ce6-f2ab74b72ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:17.428126 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce2a94f-bd32-4086-8ce6-f2ab74b72ff3 admin admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:17.428126 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce2a94f-bd32-4086-8ce6-f2ab74b72ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:17.428126 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce2a94f-bd32-4086-8ce6-f2ab74b72ff3 admin admin] PATH_INFO: `/v3/users` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:17.428479 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce2a94f-bd32-4086-8ce6-f2ab74b72ff3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:17.428479 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce2a94f-bd32-4086-8ce6-f2ab74b72ff3 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:17.641650 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1091/2178] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Oct 4 12:03:17 2022] POST /identity/v3/users => generated 305 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:03:17.646465 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74717987-7f6d-4bf7-a187-155b67863ebb admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:17.660785 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74717987-7f6d-4bf7-a187-155b67863ebb admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:17.663194 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50c7dd4-2aa8-4b60-b01a-97394ebeb302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:17.664394 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50c7dd4-2aa8-4b60-b01a-97394ebeb302 admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:17.664886 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50c7dd4-2aa8-4b60-b01a-97394ebeb302 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:17.665337 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50c7dd4-2aa8-4b60-b01a-97394ebeb302 admin admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:17.666399 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50c7dd4-2aa8-4b60-b01a-97394ebeb302 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:17.668052 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50c7dd4-2aa8-4b60-b01a-97394ebeb302 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:17.681179 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1088/2179] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:03:17 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:03:17.690649 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce2a94f-bd32-4086-8ce6-f2ab74b72ff3 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:17.704301 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce2a94f-bd32-4086-8ce6-f2ab74b72ff3 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:17.710281 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27167944-c831-42f0-9b57-3f575e1274c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:17.710903 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27167944-c831-42f0-9b57-3f575e1274c1 admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:17.711189 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27167944-c831-42f0-9b57-3f575e1274c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:17.711619 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27167944-c831-42f0-9b57-3f575e1274c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:17.712430 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27167944-c831-42f0-9b57-3f575e1274c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:17.714412 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27167944-c831-42f0-9b57-3f575e1274c1 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:17.727207 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1092/2180] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:03:17 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:03:17.731752 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50c7dd4-2aa8-4b60-b01a-97394ebeb302 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:17.742834 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50c7dd4-2aa8-4b60-b01a-97394ebeb302 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:17.747456 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60891c7-3e92-41e1-8c1f-a6363c792bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:17.748104 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60891c7-3e92-41e1-8c1f-a6363c792bc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:17.748387 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60891c7-3e92-41e1-8c1f-a6363c792bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:17.748694 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60891c7-3e92-41e1-8c1f-a6363c792bc0 admin admin] PATH_INFO: `/v3/projects/8a9e51f7ae284e6cb6f5dd453a42f6a4/users/35b665990dad46919b8f2c2966c4df24/roles/ab4307f3b7994c1c80036fa7db93b6b9` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:17.764505 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60891c7-3e92-41e1-8c1f-a6363c792bc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a9e51f7ae284e6cb6f5dd453a42f6a4, user_id=35b665990dad46919b8f2c2966c4df24, role_id=ab4307f3b7994c1c80036fa7db93b6b9)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:17.767145 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60891c7-3e92-41e1-8c1f-a6363c792bc0 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:17.865443 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=90,keystone:INSERT=4,keystone:DELETE=6 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:03:17.963332 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1089/2181] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Oct 4 12:03:17 2022] PUT /identity/v3/projects/8a9e51f7ae284e6cb6f5dd453a42f6a4/users/35b665990dad46919b8f2c2966c4df24/roles/ab4307f3b7994c1c80036fa7db93b6b9 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:03:17.975037 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b73697e-77ad-409d-981e-9293040cb71b None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:17.975385 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b73697e-77ad-409d-981e-9293040cb71b None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:17.975657 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b73697e-77ad-409d-981e-9293040cb71b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:18.005114 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-1b73697e-77ad-409d-981e-9293040cb71b None None] MFA Rules not processed for user `35b665990dad46919b8f2c2966c4df24`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:03:18.006427 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-1b73697e-77ad-409d-981e-9293040cb71b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:03:18.107509 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1093/2182] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:03:17 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 12:03:18.112770 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60891c7-3e92-41e1-8c1f-a6363c792bc0 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:18.175831 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60891c7-3e92-41e1-8c1f-a6363c792bc0 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:18.180450 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fb80ca-b5b9-4083-b6e2-e5a365855403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:18.181095 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fb80ca-b5b9-4083-b6e2-e5a365855403 admin admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:18.181380 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fb80ca-b5b9-4083-b6e2-e5a365855403 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:18.181662 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fb80ca-b5b9-4083-b6e2-e5a365855403 admin admin] PATH_INFO: `/v3/projects` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:18.182295 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fb80ca-b5b9-4083-b6e2-e5a365855403 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:18.184252 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fb80ca-b5b9-4083-b6e2-e5a365855403 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:18.363130 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1090/2183] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Oct 4 12:03:18 2022] POST /identity/v3/projects => generated 407 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:03:18.363906 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b73697e-77ad-409d-981e-9293040cb71b None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:18.380954 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b73697e-77ad-409d-981e-9293040cb71b None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:18.540569 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7316c5e-d941-49b5-8147-51c26b44eb26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:18.541267 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7316c5e-d941-49b5-8147-51c26b44eb26 admin admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:18.541943 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7316c5e-d941-49b5-8147-51c26b44eb26 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:18.541943 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7316c5e-d941-49b5-8147-51c26b44eb26 admin admin] PATH_INFO: `/v3/users` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:18.547721 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7316c5e-d941-49b5-8147-51c26b44eb26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:18.551550 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7316c5e-d941-49b5-8147-51c26b44eb26 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:18.685704 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1094/2184] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Oct 4 12:03:18 2022] POST /identity/v3/users => generated 310 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:03:18.690775 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fb80ca-b5b9-4083-b6e2-e5a365855403 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:18.724999 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fb80ca-b5b9-4083-b6e2-e5a365855403 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:18.730037 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fec081-9101-47f3-9085-a98f3c0e12a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:18.730678 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fec081-9101-47f3-9085-a98f3c0e12a1 admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:18.730962 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fec081-9101-47f3-9085-a98f3c0e12a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:18.731393 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fec081-9101-47f3-9085-a98f3c0e12a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:18.732038 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fec081-9101-47f3-9085-a98f3c0e12a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:18.733871 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fec081-9101-47f3-9085-a98f3c0e12a1 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:18.745975 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1091/2185] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:03:18 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:03:18.750202 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7316c5e-d941-49b5-8147-51c26b44eb26 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:18.760779 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7316c5e-d941-49b5-8147-51c26b44eb26 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:18.765515 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a763d22e-ceeb-49c1-a778-0c9d694743a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:18.766175 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a763d22e-ceeb-49c1-a778-0c9d694743a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:18.766457 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a763d22e-ceeb-49c1-a778-0c9d694743a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:18.766734 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a763d22e-ceeb-49c1-a778-0c9d694743a2 admin admin] PATH_INFO: `/v3/projects/e44ea79d6873438ab35ffea2f2976130/users/7aa9351556874d1f981cbdeb0cbb9e93/roles/d6e7421d1ff9451c808004b818354550` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:18.782778 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a763d22e-ceeb-49c1-a778-0c9d694743a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e44ea79d6873438ab35ffea2f2976130, user_id=7aa9351556874d1f981cbdeb0cbb9e93, role_id=d6e7421d1ff9451c808004b818354550)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:18.791541 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a763d22e-ceeb-49c1-a778-0c9d694743a2 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:18.903095 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1095/2186] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Oct 4 12:03:18 2022] PUT /identity/v3/projects/e44ea79d6873438ab35ffea2f2976130/users/7aa9351556874d1f981cbdeb0cbb9e93/roles/d6e7421d1ff9451c808004b818354550 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:03:18.911483 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fec081-9101-47f3-9085-a98f3c0e12a1 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:18.921513 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fec081-9101-47f3-9085-a98f3c0e12a1 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:18.992869 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fb83d5-4134-42c1-81e4-51eb152a95ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:18.992869 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fb83d5-4134-42c1-81e4-51eb152a95ad admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:18.992869 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fb83d5-4134-42c1-81e4-51eb152a95ad admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:18.992869 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fb83d5-4134-42c1-81e4-51eb152a95ad admin admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:18.993431 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fb83d5-4134-42c1-81e4-51eb152a95ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:18.993808 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fb83d5-4134-42c1-81e4-51eb152a95ad admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:19.005677 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1092/2187] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:03:18 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:03:19.010245 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a763d22e-ceeb-49c1-a778-0c9d694743a2 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:19.021173 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a763d22e-ceeb-49c1-a778-0c9d694743a2 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:19.026263 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3c1835-2005-483c-a834-502afbf375ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:19.026921 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3c1835-2005-483c-a834-502afbf375ea admin admin] REQUEST_METHOD: `PUT` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:19.027203 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3c1835-2005-483c-a834-502afbf375ea admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:19.027478 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3c1835-2005-483c-a834-502afbf375ea admin admin] PATH_INFO: `/v3/projects/e44ea79d6873438ab35ffea2f2976130/users/7aa9351556874d1f981cbdeb0cbb9e93/roles/d6e7421d1ff9451c808004b818354550` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:19.029427 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3c1835-2005-483c-a834-502afbf375ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=e44ea79d6873438ab35ffea2f2976130, user_id=7aa9351556874d1f981cbdeb0cbb9e93, role_id=d6e7421d1ff9451c808004b818354550)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:19.032091 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3c1835-2005-483c-a834-502afbf375ea admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:19.043886 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1096/2188] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Oct 4 12:03:19 2022] PUT /identity/v3/projects/e44ea79d6873438ab35ffea2f2976130/users/7aa9351556874d1f981cbdeb0cbb9e93/roles/d6e7421d1ff9451c808004b818354550 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:03:19.054824 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c84510c-ab6e-40d4-9da7-b5a34c6da84f None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:19.055108 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c84510c-ab6e-40d4-9da7-b5a34c6da84f None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:19.055383 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c84510c-ab6e-40d4-9da7-b5a34c6da84f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:19.085618 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-2c84510c-ab6e-40d4-9da7-b5a34c6da84f None None] MFA Rules not processed for user `7aa9351556874d1f981cbdeb0cbb9e93`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:03:19.086814 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-2c84510c-ab6e-40d4-9da7-b5a34c6da84f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:03:19.188700 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1093/2189] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:03:19 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:03:19.203713 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3c1835-2005-483c-a834-502afbf375ea admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:19.207046 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-2e3c1835-2005-483c-a834-502afbf375ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:03:19.277491 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3c1835-2005-483c-a834-502afbf375ea admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:19.283858 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0260acd2-0fb7-423b-99ef-7c2c318587b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e2a05b782424ab2928b5864f1bfd556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:19.284542 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0260acd2-0fb7-423b-99ef-7c2c318587b9 service cinder] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:19.284916 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0260acd2-0fb7-423b-99ef-7c2c318587b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:19.285256 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0260acd2-0fb7-423b-99ef-7c2c318587b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:19.300569 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0260acd2-0fb7-423b-99ef-7c2c318587b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:19.302972 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0260acd2-0fb7-423b-99ef-7c2c318587b9 service cinder] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:19.319293 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1097/2190] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:03:19 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:03:20.437263 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c84510c-ab6e-40d4-9da7-b5a34c6da84f None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:20.438915 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-2c84510c-ab6e-40d4-9da7-b5a34c6da84f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:03:20.500586 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c84510c-ab6e-40d4-9da7-b5a34c6da84f None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:20.505139 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afacb6f4-2e7d-46b2-9367-994277a948ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7289515c5c44914a19daa439de98cb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:20.505753 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afacb6f4-2e7d-46b2-9367-994277a948ac service neutron] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:20.506025 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afacb6f4-2e7d-46b2-9367-994277a948ac service neutron] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:20.506300 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afacb6f4-2e7d-46b2-9367-994277a948ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:20.508429 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-afacb6f4-2e7d-46b2-9367-994277a948ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:03:20.538038 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0260acd2-0fb7-423b-99ef-7c2c318587b9 service cinder] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:20.549153 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0260acd2-0fb7-423b-99ef-7c2c318587b9 service cinder] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:20.556629 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73abeb4b-0490-486a-a0e7-0905fe651219 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e2a05b782424ab2928b5864f1bfd556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:20.557242 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73abeb4b-0490-486a-a0e7-0905fe651219 service cinder] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:20.557512 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73abeb4b-0490-486a-a0e7-0905fe651219 service cinder] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:20.557775 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73abeb4b-0490-486a-a0e7-0905fe651219 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:20.606257 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afacb6f4-2e7d-46b2-9367-994277a948ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:20.607889 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afacb6f4-2e7d-46b2-9367-994277a948ac service neutron] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:20.626721 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1094/2191] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:03:20 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:03:20.626891 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73abeb4b-0490-486a-a0e7-0905fe651219 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:20.626891 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73abeb4b-0490-486a-a0e7-0905fe651219 service cinder] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:20.632358 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1098/2192] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:03:20 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:03:21.849805 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:03:22.525854 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afacb6f4-2e7d-46b2-9367-994277a948ac service neutron] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:22.528068 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-afacb6f4-2e7d-46b2-9367-994277a948ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:03:22.601619 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afacb6f4-2e7d-46b2-9367-994277a948ac service neutron] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:22.607639 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746eb833-9df4-41c4-ab30-eb65766b95de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:22.608289 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746eb833-9df4-41c4-ab30-eb65766b95de admin admin] REQUEST_METHOD: `DELETE` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:22.608571 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746eb833-9df4-41c4-ab30-eb65766b95de admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:22.609038 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746eb833-9df4-41c4-ab30-eb65766b95de admin admin] PATH_INFO: `/v3/users/9c45d668058247d6861a1d5b9989cc16` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:22.610448 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746eb833-9df4-41c4-ab30-eb65766b95de admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c45d668058247d6861a1d5b9989cc16)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:22.612443 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746eb833-9df4-41c4-ab30-eb65766b95de admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:22.920493 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-746eb833-9df4-41c4-ab30-eb65766b95de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c45d668058247d6861a1d5b9989cc16'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:22.928389 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-746eb833-9df4-41c4-ab30-eb65766b95de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c45d668058247d6861a1d5b9989cc16'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:22.929190 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-746eb833-9df4-41c4-ab30-eb65766b95de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c45d668058247d6861a1d5b9989cc16'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:22.930097 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-746eb833-9df4-41c4-ab30-eb65766b95de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c45d668058247d6861a1d5b9989cc16'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:23.077602 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-746eb833-9df4-41c4-ab30-eb65766b95de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c45d668058247d6861a1d5b9989cc16'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:23.106709 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1095/2193] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Oct 4 12:03:22 2022] DELETE /identity/v3/users/9c45d668058247d6861a1d5b9989cc16 => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:03:23.112341 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0560f854-fb08-4120-9a29-e8bcc1b0cc57 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:23.112843 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0560f854-fb08-4120-9a29-e8bcc1b0cc57 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:23.112843 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0560f854-fb08-4120-9a29-e8bcc1b0cc57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:23.133421 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-0560f854-fb08-4120-9a29-e8bcc1b0cc57 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:03:23.134717 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-0560f854-fb08-4120-9a29-e8bcc1b0cc57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:03:23.216764 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1099/2194] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:03:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:03:23.225364 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746eb833-9df4-41c4-ab30-eb65766b95de admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:23.227185 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-746eb833-9df4-41c4-ab30-eb65766b95de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:03:23.305070 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746eb833-9df4-41c4-ab30-eb65766b95de admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:23.309482 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e8d8b0-b1ec-4e72-b684-d8bcdd63389a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7289515c5c44914a19daa439de98cb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:23.310154 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e8d8b0-b1ec-4e72-b684-d8bcdd63389a service neutron] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:23.310450 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e8d8b0-b1ec-4e72-b684-d8bcdd63389a service neutron] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:23.310728 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e8d8b0-b1ec-4e72-b684-d8bcdd63389a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:23.330429 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e8d8b0-b1ec-4e72-b684-d8bcdd63389a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:23.330429 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e8d8b0-b1ec-4e72-b684-d8bcdd63389a service neutron] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:23.344875 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1096/2195] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:03:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 12:03:23.900640 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:03:24.242160 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0560f854-fb08-4120-9a29-e8bcc1b0cc57 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:24.244410 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-0560f854-fb08-4120-9a29-e8bcc1b0cc57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:03:24.263047 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0560f854-fb08-4120-9a29-e8bcc1b0cc57 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:24.277907 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25872d22-36f4-44ec-842a-733f707b514c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:24.283752 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25872d22-36f4-44ec-842a-733f707b514c admin admin] REQUEST_METHOD: `DELETE` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:24.284876 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25872d22-36f4-44ec-842a-733f707b514c admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:24.285258 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25872d22-36f4-44ec-842a-733f707b514c admin admin] PATH_INFO: `/v3/projects/93db7cfa3ec84ce98c8413131e15cdd9` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:24.286580 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25872d22-36f4-44ec-842a-733f707b514c admin admin] RBAC: Authorizing `identity:delete_project(project_id=93db7cfa3ec84ce98c8413131e15cdd9)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:24.289164 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25872d22-36f4-44ec-842a-733f707b514c admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:24.586784 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-25872d22-36f4-44ec-842a-733f707b514c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93db7cfa3ec84ce98c8413131e15cdd9', 'request_id': 'req-25872d22-36f4-44ec-842a-733f707b514c'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:24.683854 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-25872d22-36f4-44ec-842a-733f707b514c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93db7cfa3ec84ce98c8413131e15cdd9', 'request_id': 'req-25872d22-36f4-44ec-842a-733f707b514c'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:24.695797 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-25872d22-36f4-44ec-842a-733f707b514c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93db7cfa3ec84ce98c8413131e15cdd9', 'request_id': 'req-25872d22-36f4-44ec-842a-733f707b514c'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:24.709720 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-25872d22-36f4-44ec-842a-733f707b514c admin admin] The token cache is being invalidate because project 93db7cfa3ec84ce98c8413131e15cdd9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:03:24.710078 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-25872d22-36f4-44ec-842a-733f707b514c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:24.710807 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-25872d22-36f4-44ec-842a-733f707b514c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:24.713149 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1100/2196] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Oct 4 12:03:24 2022] DELETE /identity/v3/projects/93db7cfa3ec84ce98c8413131e15cdd9 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:03:24.717785 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e8d8b0-b1ec-4e72-b684-d8bcdd63389a service neutron] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:24.729400 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e8d8b0-b1ec-4e72-b684-d8bcdd63389a service neutron] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:24.796529 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40be45f0-02bc-43b7-aaff-bb5835d8db21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:24.797561 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40be45f0-02bc-43b7-aaff-bb5835d8db21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:24.797990 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40be45f0-02bc-43b7-aaff-bb5835d8db21 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:24.798344 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40be45f0-02bc-43b7-aaff-bb5835d8db21 admin admin] PATH_INFO: `/v3/users/4d635c57b7204b538dccea6e6cc776ee` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:24.799744 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40be45f0-02bc-43b7-aaff-bb5835d8db21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d635c57b7204b538dccea6e6cc776ee)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:24.801730 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40be45f0-02bc-43b7-aaff-bb5835d8db21 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:25.371898 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-40be45f0-02bc-43b7-aaff-bb5835d8db21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d635c57b7204b538dccea6e6cc776ee'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:25.408774 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-40be45f0-02bc-43b7-aaff-bb5835d8db21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d635c57b7204b538dccea6e6cc776ee'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:25.408774 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-40be45f0-02bc-43b7-aaff-bb5835d8db21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d635c57b7204b538dccea6e6cc776ee'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:25.408774 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-40be45f0-02bc-43b7-aaff-bb5835d8db21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d635c57b7204b538dccea6e6cc776ee'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:25.546548 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-40be45f0-02bc-43b7-aaff-bb5835d8db21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d635c57b7204b538dccea6e6cc776ee'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:25.571725 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1097/2197] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Oct 4 12:03:24 2022] DELETE /identity/v3/users/4d635c57b7204b538dccea6e6cc776ee => generated 0 bytes in 855 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:03:26.480062 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25872d22-36f4-44ec-842a-733f707b514c admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:26.481581 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-25872d22-36f4-44ec-842a-733f707b514c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:03:26.495690 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25872d22-36f4-44ec-842a-733f707b514c admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:26.583577 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d639f088-1c03-48fc-aaac-a328b02dc16b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:26.584330 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d639f088-1c03-48fc-aaac-a328b02dc16b admin admin] REQUEST_METHOD: `DELETE` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:26.584637 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d639f088-1c03-48fc-aaac-a328b02dc16b admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:26.585002 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d639f088-1c03-48fc-aaac-a328b02dc16b admin admin] PATH_INFO: `/v3/projects/87cb2182f64648baba7793c2c9743b3c` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:26.596971 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d639f088-1c03-48fc-aaac-a328b02dc16b admin admin] RBAC: Authorizing `identity:delete_project(project_id=87cb2182f64648baba7793c2c9743b3c)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:26.596971 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d639f088-1c03-48fc-aaac-a328b02dc16b admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:26.794865 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-d639f088-1c03-48fc-aaac-a328b02dc16b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87cb2182f64648baba7793c2c9743b3c', 'request_id': 'req-d639f088-1c03-48fc-aaac-a328b02dc16b'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:26.878485 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-d639f088-1c03-48fc-aaac-a328b02dc16b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87cb2182f64648baba7793c2c9743b3c', 'request_id': 'req-d639f088-1c03-48fc-aaac-a328b02dc16b'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:26.889940 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-d639f088-1c03-48fc-aaac-a328b02dc16b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87cb2182f64648baba7793c2c9743b3c', 'request_id': 'req-d639f088-1c03-48fc-aaac-a328b02dc16b'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:26.929965 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-d639f088-1c03-48fc-aaac-a328b02dc16b admin admin] The token cache is being invalidate because project 87cb2182f64648baba7793c2c9743b3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:03:26.930253 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-d639f088-1c03-48fc-aaac-a328b02dc16b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:26.931081 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-d639f088-1c03-48fc-aaac-a328b02dc16b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:26.932655 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1101/2198] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Oct 4 12:03:26 2022] DELETE /identity/v3/projects/87cb2182f64648baba7793c2c9743b3c => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:03:26.941665 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6737cae-2600-43fc-8d04-490f83acb72c None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:26.942185 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6737cae-2600-43fc-8d04-490f83acb72c None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:26.942475 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6737cae-2600-43fc-8d04-490f83acb72c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:26.966950 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-e6737cae-2600-43fc-8d04-490f83acb72c None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:03:26.968669 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-e6737cae-2600-43fc-8d04-490f83acb72c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:03:27.076347 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1098/2199] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:03:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:03:27.085045 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bc8075-cfb1-4ff6-b863-d55cdc80c682 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:27.087367 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bc8075-cfb1-4ff6-b863-d55cdc80c682 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:27.087367 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bc8075-cfb1-4ff6-b863-d55cdc80c682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:27.111940 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-66bc8075-cfb1-4ff6-b863-d55cdc80c682 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:03:27.113201 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-66bc8075-cfb1-4ff6-b863-d55cdc80c682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:03:27.135105 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1102/2200] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:03:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:03:27.135248 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6737cae-2600-43fc-8d04-490f83acb72c None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:27.137675 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6737cae-2600-43fc-8d04-490f83acb72c None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:27.143094 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390181b1-d8d5-4342-bd1a-da94f5c533a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:27.143704 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390181b1-d8d5-4342-bd1a-da94f5c533a5 admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:27.143989 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390181b1-d8d5-4342-bd1a-da94f5c533a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:27.144261 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390181b1-d8d5-4342-bd1a-da94f5c533a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:27.144936 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390181b1-d8d5-4342-bd1a-da94f5c533a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:03:27.145239 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390181b1-d8d5-4342-bd1a-da94f5c533a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:27.146846 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390181b1-d8d5-4342-bd1a-da94f5c533a5 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:27.160635 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1099/2201] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Oct 4 12:03:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:03:27.164268 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bc8075-cfb1-4ff6-b863-d55cdc80c682 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:27.173348 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bc8075-cfb1-4ff6-b863-d55cdc80c682 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:27.177936 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e752a0ec-c55f-4dca-8e80-dd1b8c60462c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:27.178528 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e752a0ec-c55f-4dca-8e80-dd1b8c60462c admin admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:27.178808 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e752a0ec-c55f-4dca-8e80-dd1b8c60462c admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:27.179077 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e752a0ec-c55f-4dca-8e80-dd1b8c60462c admin admin] PATH_INFO: `/v3/projects` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:27.179713 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e752a0ec-c55f-4dca-8e80-dd1b8c60462c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:27.181688 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e752a0ec-c55f-4dca-8e80-dd1b8c60462c admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:27.364780 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1103/2202] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Oct 4 12:03:27 2022] POST /identity/v3/projects => generated 361 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:03:27.365367 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390181b1-d8d5-4342-bd1a-da94f5c533a5 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:27.376505 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390181b1-d8d5-4342-bd1a-da94f5c533a5 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:27.447034 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367a4b62-8a5d-4451-9307-48fb9ff2f8af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:27.447652 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367a4b62-8a5d-4451-9307-48fb9ff2f8af admin admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:27.447933 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367a4b62-8a5d-4451-9307-48fb9ff2f8af admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:27.448204 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367a4b62-8a5d-4451-9307-48fb9ff2f8af admin admin] PATH_INFO: `/v3/users` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:27.448884 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367a4b62-8a5d-4451-9307-48fb9ff2f8af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:27.450835 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367a4b62-8a5d-4451-9307-48fb9ff2f8af admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:27.568505 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1100/2203] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Oct 4 12:03:27 2022] POST /identity/v3/users => generated 281 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 12:03:27.569142 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e752a0ec-c55f-4dca-8e80-dd1b8c60462c admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:27.576046 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e752a0ec-c55f-4dca-8e80-dd1b8c60462c admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:27.593308 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464e5094-8f71-46ea-af6c-b4c72d968f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:27.593877 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464e5094-8f71-46ea-af6c-b4c72d968f58 admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:27.594160 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464e5094-8f71-46ea-af6c-b4c72d968f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:27.594424 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464e5094-8f71-46ea-af6c-b4c72d968f58 admin admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:27.596036 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464e5094-8f71-46ea-af6c-b4c72d968f58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:27.599361 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464e5094-8f71-46ea-af6c-b4c72d968f58 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:27.610159 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1104/2204] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:03:27 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 12:03:27.614473 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367a4b62-8a5d-4451-9307-48fb9ff2f8af admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:27.625304 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367a4b62-8a5d-4451-9307-48fb9ff2f8af admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:27.630383 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e995d1f-c663-41fb-963e-07498f94bd31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:27.630982 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e995d1f-c663-41fb-963e-07498f94bd31 admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:27.631257 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e995d1f-c663-41fb-963e-07498f94bd31 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:27.631527 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e995d1f-c663-41fb-963e-07498f94bd31 admin admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:27.632190 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e995d1f-c663-41fb-963e-07498f94bd31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:27.633794 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e995d1f-c663-41fb-963e-07498f94bd31 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:27.645422 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1101/2205] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:03:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 12:03:27.657149 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464e5094-8f71-46ea-af6c-b4c72d968f58 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:27.669152 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464e5094-8f71-46ea-af6c-b4c72d968f58 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:27.677963 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3930e349-db5d-4908-af03-551b81afdbf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:27.679024 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3930e349-db5d-4908-af03-551b81afdbf7 admin admin] REQUEST_METHOD: `PUT` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:27.679359 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3930e349-db5d-4908-af03-551b81afdbf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:27.679690 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3930e349-db5d-4908-af03-551b81afdbf7 admin admin] PATH_INFO: `/v3/projects/b5773ff445894cbcb6836c964662eb96/users/115f57eb5e1e4328a811d7ead7017d7e/roles/ab4307f3b7994c1c80036fa7db93b6b9` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:27.703725 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3930e349-db5d-4908-af03-551b81afdbf7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5773ff445894cbcb6836c964662eb96, user_id=115f57eb5e1e4328a811d7ead7017d7e, role_id=ab4307f3b7994c1c80036fa7db93b6b9)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:27.711507 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3930e349-db5d-4908-af03-551b81afdbf7 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:27.859359 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1105/2206] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Oct 4 12:03:27 2022] PUT /identity/v3/projects/b5773ff445894cbcb6836c964662eb96/users/115f57eb5e1e4328a811d7ead7017d7e/roles/ab4307f3b7994c1c80036fa7db93b6b9 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:03:27.872188 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235639ae-dad3-496a-836f-452fe182b24d None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:27.872482 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235639ae-dad3-496a-836f-452fe182b24d None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:27.872789 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235639ae-dad3-496a-836f-452fe182b24d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:27.901772 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-235639ae-dad3-496a-836f-452fe182b24d None None] MFA Rules not processed for user `115f57eb5e1e4328a811d7ead7017d7e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:03:27.902981 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-235639ae-dad3-496a-836f-452fe182b24d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:03:27.967849 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1102/2207] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:03:27 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:03:28.003855 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3930e349-db5d-4908-af03-551b81afdbf7 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:28.005844 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-3930e349-db5d-4908-af03-551b81afdbf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:03:28.015499 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:03:28.080064 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3930e349-db5d-4908-af03-551b81afdbf7 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:28.083919 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5cc2b4-661a-4d56-95bb-873091f3d7c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e2a05b782424ab2928b5864f1bfd556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:28.084528 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5cc2b4-661a-4d56-95bb-873091f3d7c0 service cinder] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:28.084838 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5cc2b4-661a-4d56-95bb-873091f3d7c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:28.085111 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5cc2b4-661a-4d56-95bb-873091f3d7c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:28.093170 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5cc2b4-661a-4d56-95bb-873091f3d7c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:28.094639 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5cc2b4-661a-4d56-95bb-873091f3d7c0 service cinder] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:28.103871 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1106/2208] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:03:28 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:03:28.124400 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235639ae-dad3-496a-836f-452fe182b24d None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:28.199177 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235639ae-dad3-496a-836f-452fe182b24d None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:28.203850 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce2d80f-f39f-4f3c-a294-9dccc0e80879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:28.204908 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce2d80f-f39f-4f3c-a294-9dccc0e80879 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:28.205033 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce2d80f-f39f-4f3c-a294-9dccc0e80879 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:28.205463 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce2d80f-f39f-4f3c-a294-9dccc0e80879 admin admin] PATH_INFO: `/v3/users/115f57eb5e1e4328a811d7ead7017d7e` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:28.206625 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce2d80f-f39f-4f3c-a294-9dccc0e80879 admin admin] RBAC: Authorizing `identity:delete_user(user_id=115f57eb5e1e4328a811d7ead7017d7e)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:28.208556 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce2d80f-f39f-4f3c-a294-9dccc0e80879 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:28.577781 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-8ce2d80f-f39f-4f3c-a294-9dccc0e80879 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '115f57eb5e1e4328a811d7ead7017d7e'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:28.588973 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-8ce2d80f-f39f-4f3c-a294-9dccc0e80879 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '115f57eb5e1e4328a811d7ead7017d7e'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:28.589691 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-8ce2d80f-f39f-4f3c-a294-9dccc0e80879 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '115f57eb5e1e4328a811d7ead7017d7e'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:28.591142 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-8ce2d80f-f39f-4f3c-a294-9dccc0e80879 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '115f57eb5e1e4328a811d7ead7017d7e'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:28.740369 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-8ce2d80f-f39f-4f3c-a294-9dccc0e80879 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '115f57eb5e1e4328a811d7ead7017d7e'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:28.759761 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1103/2209] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Oct 4 12:03:28 2022] DELETE /identity/v3/users/115f57eb5e1e4328a811d7ead7017d7e => generated 0 bytes in 636 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:03:28.764256 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1711ae8-a4d2-433f-9db4-d337e4e4a2ac None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:28.764798 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1711ae8-a4d2-433f-9db4-d337e4e4a2ac None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:28.765043 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1711ae8-a4d2-433f-9db4-d337e4e4a2ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:28.788799 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-d1711ae8-a4d2-433f-9db4-d337e4e4a2ac None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:03:28.791184 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-d1711ae8-a4d2-433f-9db4-d337e4e4a2ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:03:28.864642 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1107/2210] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:03:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:03:28.871989 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce2d80f-f39f-4f3c-a294-9dccc0e80879 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:28.873723 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-8ce2d80f-f39f-4f3c-a294-9dccc0e80879 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:03:28.943040 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce2d80f-f39f-4f3c-a294-9dccc0e80879 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:28.947248 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e60e4d-e2bb-4252-9757-836241fd4cc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7289515c5c44914a19daa439de98cb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:28.948342 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e60e4d-e2bb-4252-9757-836241fd4cc6 service neutron] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:28.948928 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e60e4d-e2bb-4252-9757-836241fd4cc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:28.949335 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e60e4d-e2bb-4252-9757-836241fd4cc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:28.973418 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e60e4d-e2bb-4252-9757-836241fd4cc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:28.975246 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e60e4d-e2bb-4252-9757-836241fd4cc6 service neutron] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:28.994172 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1104/2211] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:03:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 12:03:29.778688 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1711ae8-a4d2-433f-9db4-d337e4e4a2ac None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:29.778688 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-d1711ae8-a4d2-433f-9db4-d337e4e4a2ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:03:29.792402 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1711ae8-a4d2-433f-9db4-d337e4e4a2ac None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:29.797207 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69058a4b-e4af-47ac-8c72-4ca5287f6ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:29.797847 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69058a4b-e4af-47ac-8c72-4ca5287f6ed3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:29.798602 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69058a4b-e4af-47ac-8c72-4ca5287f6ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:29.799064 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69058a4b-e4af-47ac-8c72-4ca5287f6ed3 admin admin] PATH_INFO: `/v3/projects/b5773ff445894cbcb6836c964662eb96` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:29.800352 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69058a4b-e4af-47ac-8c72-4ca5287f6ed3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5773ff445894cbcb6836c964662eb96)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:29.802314 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69058a4b-e4af-47ac-8c72-4ca5287f6ed3 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:29.969122 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b722cd-7e98-4db5-8362-ecf189670975 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:29.969766 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b722cd-7e98-4db5-8362-ecf189670975 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:29.970106 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-69058a4b-e4af-47ac-8c72-4ca5287f6ed3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5773ff445894cbcb6836c964662eb96', 'request_id': 'req-69058a4b-e4af-47ac-8c72-4ca5287f6ed3'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:29.970520 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b722cd-7e98-4db5-8362-ecf189670975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:29.991916 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-34b722cd-7e98-4db5-8362-ecf189670975 None None] MFA Rules not processed for user `39a8f928f83449d08a766f9c5303b31b`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:03:29.993820 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-34b722cd-7e98-4db5-8362-ecf189670975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:03:30.043532 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-69058a4b-e4af-47ac-8c72-4ca5287f6ed3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5773ff445894cbcb6836c964662eb96', 'request_id': 'req-69058a4b-e4af-47ac-8c72-4ca5287f6ed3'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:30.051148 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-69058a4b-e4af-47ac-8c72-4ca5287f6ed3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5773ff445894cbcb6836c964662eb96', 'request_id': 'req-69058a4b-e4af-47ac-8c72-4ca5287f6ed3'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:30.057164 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1105/2212] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:03:29 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 12:03:30.064750 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b722cd-7e98-4db5-8362-ecf189670975 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:30.064750 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-34b722cd-7e98-4db5-8362-ecf189670975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:03:30.069177 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-69058a4b-e4af-47ac-8c72-4ca5287f6ed3 admin admin] The token cache is being invalidate because project b5773ff445894cbcb6836c964662eb96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:03:30.069678 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-69058a4b-e4af-47ac-8c72-4ca5287f6ed3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:30.070905 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-69058a4b-e4af-47ac-8c72-4ca5287f6ed3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:30.072400 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1108/2213] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Oct 4 12:03:29 2022] DELETE /identity/v3/projects/b5773ff445894cbcb6836c964662eb96 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:03:30.104454 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69058a4b-e4af-47ac-8c72-4ca5287f6ed3 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:30.110959 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-69058a4b-e4af-47ac-8c72-4ca5287f6ed3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:03:30.170700 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b722cd-7e98-4db5-8362-ecf189670975 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:30.181387 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b19dc99-7b96-4c42-9ff2-fbc98bba5103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:30.187361 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b19dc99-7b96-4c42-9ff2-fbc98bba5103 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:30.187361 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b19dc99-7b96-4c42-9ff2-fbc98bba5103 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:30.187361 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b19dc99-7b96-4c42-9ff2-fbc98bba5103 admin admin] PATH_INFO: `/v3/users/35b665990dad46919b8f2c2966c4df24` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:30.187361 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b19dc99-7b96-4c42-9ff2-fbc98bba5103 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35b665990dad46919b8f2c2966c4df24)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:30.188053 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b19dc99-7b96-4c42-9ff2-fbc98bba5103 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:30.286185 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69058a4b-e4af-47ac-8c72-4ca5287f6ed3 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:30.292369 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adecc149-9c79-437b-aba9-ae17c350bbd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:30.293615 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adecc149-9c79-437b-aba9-ae17c350bbd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:30.294114 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adecc149-9c79-437b-aba9-ae17c350bbd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:30.294664 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adecc149-9c79-437b-aba9-ae17c350bbd4 admin admin] PATH_INFO: `/v3/users/443fe822f665431fbd578804ac37b819` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:30.296406 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adecc149-9c79-437b-aba9-ae17c350bbd4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=443fe822f665431fbd578804ac37b819)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:30.299458 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adecc149-9c79-437b-aba9-ae17c350bbd4 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:30.543342 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-9b19dc99-7b96-4c42-9ff2-fbc98bba5103 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35b665990dad46919b8f2c2966c4df24'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:30.557307 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-9b19dc99-7b96-4c42-9ff2-fbc98bba5103 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35b665990dad46919b8f2c2966c4df24'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:30.558630 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-9b19dc99-7b96-4c42-9ff2-fbc98bba5103 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35b665990dad46919b8f2c2966c4df24'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:30.559626 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-9b19dc99-7b96-4c42-9ff2-fbc98bba5103 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35b665990dad46919b8f2c2966c4df24'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:30.622025 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-adecc149-9c79-437b-aba9-ae17c350bbd4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '443fe822f665431fbd578804ac37b819'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:30.632226 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:03:30.633507 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-adecc149-9c79-437b-aba9-ae17c350bbd4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '443fe822f665431fbd578804ac37b819'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:30.634254 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-adecc149-9c79-437b-aba9-ae17c350bbd4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '443fe822f665431fbd578804ac37b819'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:30.634985 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-adecc149-9c79-437b-aba9-ae17c350bbd4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '443fe822f665431fbd578804ac37b819'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:30.659983 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-9b19dc99-7b96-4c42-9ff2-fbc98bba5103 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35b665990dad46919b8f2c2966c4df24'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:30.680251 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1106/2214] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Oct 4 12:03:30 2022] DELETE /identity/v3/users/35b665990dad46919b8f2c2966c4df24 => generated 0 bytes in 622 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:03:30.684949 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9baa0d-a657-4dee-9a81-48430d0a1c01 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:30.685243 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9baa0d-a657-4dee-9a81-48430d0a1c01 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:30.685521 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9baa0d-a657-4dee-9a81-48430d0a1c01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:30.706345 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-8d9baa0d-a657-4dee-9a81-48430d0a1c01 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:03:30.707563 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-8d9baa0d-a657-4dee-9a81-48430d0a1c01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:03:30.773751 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1107/2215] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:03:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:03:30.784258 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9baa0d-a657-4dee-9a81-48430d0a1c01 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:30.784690 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-adecc149-9c79-437b-aba9-ae17c350bbd4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '443fe822f665431fbd578804ac37b819'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:30.786502 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-8d9baa0d-a657-4dee-9a81-48430d0a1c01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:03:30.808261 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1109/2216] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Oct 4 12:03:30 2022] DELETE /identity/v3/users/443fe822f665431fbd578804ac37b819 => generated 0 bytes in 704 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:03:30.815364 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b401ec0-3bbd-4e93-ab17-8ab134fadf29 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:30.815863 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b401ec0-3bbd-4e93-ab17-8ab134fadf29 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:30.816348 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b401ec0-3bbd-4e93-ab17-8ab134fadf29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:30.845637 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-1b401ec0-3bbd-4e93-ab17-8ab134fadf29 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:03:30.846841 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-1b401ec0-3bbd-4e93-ab17-8ab134fadf29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:03:30.853882 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9baa0d-a657-4dee-9a81-48430d0a1c01 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:30.906422 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b66778c-5157-481a-a46d-4858183fbecc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7289515c5c44914a19daa439de98cb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:30.907133 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b66778c-5157-481a-a46d-4858183fbecc service neutron] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:30.910569 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b66778c-5157-481a-a46d-4858183fbecc service neutron] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:30.910569 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b66778c-5157-481a-a46d-4858183fbecc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:30.915694 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1110/2217] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:03:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 12:03:30.919164 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b66778c-5157-481a-a46d-4858183fbecc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:30.921118 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b66778c-5157-481a-a46d-4858183fbecc service neutron] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:30.931058 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b401ec0-3bbd-4e93-ab17-8ab134fadf29 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:30.944956 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1108/2218] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:03:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:03:30.953095 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b401ec0-3bbd-4e93-ab17-8ab134fadf29 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:30.960522 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8068eb42-d923-4cd7-84ba-733bd244107c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7289515c5c44914a19daa439de98cb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:30.961413 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8068eb42-d923-4cd7-84ba-733bd244107c service neutron] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:30.961780 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8068eb42-d923-4cd7-84ba-733bd244107c service neutron] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:30.962108 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8068eb42-d923-4cd7-84ba-733bd244107c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:30.974564 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8068eb42-d923-4cd7-84ba-733bd244107c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:30.976099 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8068eb42-d923-4cd7-84ba-733bd244107c service neutron] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:30.989264 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1111/2219] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:03:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:03:31.631133 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b66778c-5157-481a-a46d-4858183fbecc service neutron] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:31.632898 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-6b66778c-5157-481a-a46d-4858183fbecc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:03:31.647203 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b66778c-5157-481a-a46d-4858183fbecc service neutron] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:31.658190 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8068eb42-d923-4cd7-84ba-733bd244107c service neutron] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:31.660234 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-8068eb42-d923-4cd7-84ba-733bd244107c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:03:31.664586 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a968ece-0c4a-4365-b57d-7f8414828971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:31.665759 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a968ece-0c4a-4365-b57d-7f8414828971 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:31.666146 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a968ece-0c4a-4365-b57d-7f8414828971 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:31.666516 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a968ece-0c4a-4365-b57d-7f8414828971 admin admin] PATH_INFO: `/v3/projects/8a9e51f7ae284e6cb6f5dd453a42f6a4` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:31.667824 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a968ece-0c4a-4365-b57d-7f8414828971 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a9e51f7ae284e6cb6f5dd453a42f6a4)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:31.669795 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a968ece-0c4a-4365-b57d-7f8414828971 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:31.691761 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8068eb42-d923-4cd7-84ba-733bd244107c service neutron] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:31.703331 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44ade92-bbe0-4242-b580-9668bc71ae26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:31.703331 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44ade92-bbe0-4242-b580-9668bc71ae26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:31.703331 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44ade92-bbe0-4242-b580-9668bc71ae26 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:31.703331 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44ade92-bbe0-4242-b580-9668bc71ae26 admin admin] PATH_INFO: `/v3/projects/16d2cb08fdb645acac9fb7710b30c5a5` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:31.704010 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44ade92-bbe0-4242-b580-9668bc71ae26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16d2cb08fdb645acac9fb7710b30c5a5)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:31.704010 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44ade92-bbe0-4242-b580-9668bc71ae26 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:31.841284 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-5a968ece-0c4a-4365-b57d-7f8414828971 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a9e51f7ae284e6cb6f5dd453a42f6a4', 'request_id': 'req-5a968ece-0c4a-4365-b57d-7f8414828971'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:31.847694 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-5a968ece-0c4a-4365-b57d-7f8414828971 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a9e51f7ae284e6cb6f5dd453a42f6a4', 'request_id': 'req-5a968ece-0c4a-4365-b57d-7f8414828971'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:31.900237 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-a44ade92-bbe0-4242-b580-9668bc71ae26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16d2cb08fdb645acac9fb7710b30c5a5', 'request_id': 'req-a44ade92-bbe0-4242-b580-9668bc71ae26'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:31.980568 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-5a968ece-0c4a-4365-b57d-7f8414828971 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a9e51f7ae284e6cb6f5dd453a42f6a4', 'request_id': 'req-5a968ece-0c4a-4365-b57d-7f8414828971'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:31.992031 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-5a968ece-0c4a-4365-b57d-7f8414828971 admin admin] The token cache is being invalidate because project 8a9e51f7ae284e6cb6f5dd453a42f6a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:03:31.992315 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-5a968ece-0c4a-4365-b57d-7f8414828971 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:31.992950 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-5a968ece-0c4a-4365-b57d-7f8414828971 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:31.994452 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1109/2220] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Oct 4 12:03:31 2022] DELETE /identity/v3/projects/8a9e51f7ae284e6cb6f5dd453a42f6a4 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:03:31.998364 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a968ece-0c4a-4365-b57d-7f8414828971 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:31.999627 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-5a968ece-0c4a-4365-b57d-7f8414828971 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:03:32.065441 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a968ece-0c4a-4365-b57d-7f8414828971 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:32.071296 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-a44ade92-bbe0-4242-b580-9668bc71ae26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16d2cb08fdb645acac9fb7710b30c5a5', 'request_id': 'req-a44ade92-bbe0-4242-b580-9668bc71ae26'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:32.078111 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-a44ade92-bbe0-4242-b580-9668bc71ae26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16d2cb08fdb645acac9fb7710b30c5a5', 'request_id': 'req-a44ade92-bbe0-4242-b580-9668bc71ae26'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:32.090475 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-a44ade92-bbe0-4242-b580-9668bc71ae26 admin admin] The token cache is being invalidate because project 16d2cb08fdb645acac9fb7710b30c5a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:03:32.090768 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-a44ade92-bbe0-4242-b580-9668bc71ae26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:32.091539 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-a44ade92-bbe0-4242-b580-9668bc71ae26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:32.093061 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1112/2221] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Oct 4 12:03:31 2022] DELETE /identity/v3/projects/16d2cb08fdb645acac9fb7710b30c5a5 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:03:32.097755 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a945664-247b-4c72-925c-015a03195d88 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:32.098042 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a945664-247b-4c72-925c-015a03195d88 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:32.098316 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a945664-247b-4c72-925c-015a03195d88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:32.120037 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-0a945664-247b-4c72-925c-015a03195d88 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:03:32.122835 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-0a945664-247b-4c72-925c-015a03195d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:03:32.138558 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf512f36-3582-45cc-a5e1-42d2ef6e63e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:32.139233 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf512f36-3582-45cc-a5e1-42d2ef6e63e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:32.145282 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf512f36-3582-45cc-a5e1-42d2ef6e63e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:32.145645 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf512f36-3582-45cc-a5e1-42d2ef6e63e4 admin admin] PATH_INFO: `/v3/users/7aa9351556874d1f981cbdeb0cbb9e93` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:32.165532 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf512f36-3582-45cc-a5e1-42d2ef6e63e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7aa9351556874d1f981cbdeb0cbb9e93)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:32.169775 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf512f36-3582-45cc-a5e1-42d2ef6e63e4 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:32.193294 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1113/2222] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:03:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:03:32.201071 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a41ec9c-56cc-4e13-9c6f-45eb551f3430 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:32.201649 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a41ec9c-56cc-4e13-9c6f-45eb551f3430 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:32.202330 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a41ec9c-56cc-4e13-9c6f-45eb551f3430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:32.224564 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-3a41ec9c-56cc-4e13-9c6f-45eb551f3430 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:03:32.225879 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-3a41ec9c-56cc-4e13-9c6f-45eb551f3430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:03:32.239490 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1114/2223] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:03:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:03:32.240496 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a41ec9c-56cc-4e13-9c6f-45eb551f3430 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:32.252872 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a41ec9c-56cc-4e13-9c6f-45eb551f3430 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:32.258270 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46457f66-b5fa-4f03-9105-124c2e5ac3b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:32.258878 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46457f66-b5fa-4f03-9105-124c2e5ac3b1 admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:32.259155 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46457f66-b5fa-4f03-9105-124c2e5ac3b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:32.259425 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46457f66-b5fa-4f03-9105-124c2e5ac3b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:32.260081 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46457f66-b5fa-4f03-9105-124c2e5ac3b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:03:32.260380 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46457f66-b5fa-4f03-9105-124c2e5ac3b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:32.262612 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46457f66-b5fa-4f03-9105-124c2e5ac3b1 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:32.274785 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1115/2224] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Oct 4 12:03:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 12:03:32.279162 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46457f66-b5fa-4f03-9105-124c2e5ac3b1 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:32.290406 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46457f66-b5fa-4f03-9105-124c2e5ac3b1 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:32.295352 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e1e7bf-372c-4dda-bfe9-6d71166ab643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:32.295958 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e1e7bf-372c-4dda-bfe9-6d71166ab643 admin admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:32.296233 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e1e7bf-372c-4dda-bfe9-6d71166ab643 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:32.296507 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e1e7bf-372c-4dda-bfe9-6d71166ab643 admin admin] PATH_INFO: `/v3/projects` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:32.297159 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e1e7bf-372c-4dda-bfe9-6d71166ab643 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:32.299547 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e1e7bf-372c-4dda-bfe9-6d71166ab643 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:32.474184 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1116/2225] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Oct 4 12:03:32 2022] POST /identity/v3/projects => generated 363 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 12:03:32.475229 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e1e7bf-372c-4dda-bfe9-6d71166ab643 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:32.552774 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-bf512f36-3582-45cc-a5e1-42d2ef6e63e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7aa9351556874d1f981cbdeb0cbb9e93'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:32.556743 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e1e7bf-372c-4dda-bfe9-6d71166ab643 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:32.562472 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-bf512f36-3582-45cc-a5e1-42d2ef6e63e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7aa9351556874d1f981cbdeb0cbb9e93'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:32.563191 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-bf512f36-3582-45cc-a5e1-42d2ef6e63e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7aa9351556874d1f981cbdeb0cbb9e93'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:32.563848 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd49e8b4-5b1d-4b27-a652-e000b9e21ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:32.564059 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-bf512f36-3582-45cc-a5e1-42d2ef6e63e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7aa9351556874d1f981cbdeb0cbb9e93'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:32.564693 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd49e8b4-5b1d-4b27-a652-e000b9e21ba7 admin admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:32.565030 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd49e8b4-5b1d-4b27-a652-e000b9e21ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:32.565305 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd49e8b4-5b1d-4b27-a652-e000b9e21ba7 admin admin] PATH_INFO: `/v3/users` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:32.566503 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd49e8b4-5b1d-4b27-a652-e000b9e21ba7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:32.569982 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd49e8b4-5b1d-4b27-a652-e000b9e21ba7 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:32.646565 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:03:32.694409 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-bf512f36-3582-45cc-a5e1-42d2ef6e63e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7aa9351556874d1f981cbdeb0cbb9e93'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:32.701164 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1117/2226] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Oct 4 12:03:32 2022] POST /identity/v3/users => generated 282 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:03:32.711405 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd49e8b4-5b1d-4b27-a652-e000b9e21ba7 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:32.714069 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-cd49e8b4-5b1d-4b27-a652-e000b9e21ba7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:03:32.716300 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1110/2227] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Oct 4 12:03:31 2022] DELETE /identity/v3/users/7aa9351556874d1f981cbdeb0cbb9e93 => generated 0 bytes in 718 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:03:32.728664 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd49e8b4-5b1d-4b27-a652-e000b9e21ba7 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:32.795464 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a49607-1dd9-4cb9-b2c4-95790b43cd79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:32.796089 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a49607-1dd9-4cb9-b2c4-95790b43cd79 admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:32.796373 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a49607-1dd9-4cb9-b2c4-95790b43cd79 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:32.796696 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a49607-1dd9-4cb9-b2c4-95790b43cd79 admin admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:32.797344 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a49607-1dd9-4cb9-b2c4-95790b43cd79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:32.799283 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a49607-1dd9-4cb9-b2c4-95790b43cd79 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:32.809702 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1118/2228] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:03:32 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:03:32.813966 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf512f36-3582-45cc-a5e1-42d2ef6e63e4 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:32.825567 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf512f36-3582-45cc-a5e1-42d2ef6e63e4 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:32.831524 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47a290e-9298-4237-8e7c-beae1e5a0916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:32.832526 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47a290e-9298-4237-8e7c-beae1e5a0916 admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:32.832908 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47a290e-9298-4237-8e7c-beae1e5a0916 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:32.833186 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47a290e-9298-4237-8e7c-beae1e5a0916 admin admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:32.833831 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47a290e-9298-4237-8e7c-beae1e5a0916 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:32.835419 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47a290e-9298-4237-8e7c-beae1e5a0916 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:32.849873 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1111/2229] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:03:32 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:03:32.853917 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a49607-1dd9-4cb9-b2c4-95790b43cd79 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:32.864866 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a49607-1dd9-4cb9-b2c4-95790b43cd79 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:32.869612 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76af0fbc-c01e-4945-8529-4d1d9088ff50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:32.870323 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76af0fbc-c01e-4945-8529-4d1d9088ff50 admin admin] REQUEST_METHOD: `PUT` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:32.870608 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76af0fbc-c01e-4945-8529-4d1d9088ff50 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:32.870885 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76af0fbc-c01e-4945-8529-4d1d9088ff50 admin admin] PATH_INFO: `/v3/projects/f69230efd4f542a1ad224e398281099c/users/1bcacf5a31a34dc7a0a9ee97c5692cfd/roles/ab4307f3b7994c1c80036fa7db93b6b9` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:32.889364 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76af0fbc-c01e-4945-8529-4d1d9088ff50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f69230efd4f542a1ad224e398281099c, user_id=1bcacf5a31a34dc7a0a9ee97c5692cfd, role_id=ab4307f3b7994c1c80036fa7db93b6b9)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:32.893429 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76af0fbc-c01e-4945-8529-4d1d9088ff50 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:33.024881 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1119/2230] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Oct 4 12:03:32 2022] PUT /identity/v3/projects/f69230efd4f542a1ad224e398281099c/users/1bcacf5a31a34dc7a0a9ee97c5692cfd/roles/ab4307f3b7994c1c80036fa7db93b6b9 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:03:33.036115 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44923030-ae0f-4a00-8279-4c494d7e0c16 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:33.036769 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44923030-ae0f-4a00-8279-4c494d7e0c16 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:33.037047 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44923030-ae0f-4a00-8279-4c494d7e0c16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:33.079075 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-44923030-ae0f-4a00-8279-4c494d7e0c16 None None] MFA Rules not processed for user `1bcacf5a31a34dc7a0a9ee97c5692cfd`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:03:33.081111 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-44923030-ae0f-4a00-8279-4c494d7e0c16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:03:33.148046 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1112/2231] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:03:33 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 12:03:33.159824 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76af0fbc-c01e-4945-8529-4d1d9088ff50 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:33.161561 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-76af0fbc-c01e-4945-8529-4d1d9088ff50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:03:33.228280 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76af0fbc-c01e-4945-8529-4d1d9088ff50 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:33.232091 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c283a2-2706-4030-9e48-95f4d700f0a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e2a05b782424ab2928b5864f1bfd556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:33.232738 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c283a2-2706-4030-9e48-95f4d700f0a3 service cinder] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:33.233223 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c283a2-2706-4030-9e48-95f4d700f0a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:33.233765 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c283a2-2706-4030-9e48-95f4d700f0a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:33.250957 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c283a2-2706-4030-9e48-95f4d700f0a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:33.250957 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c283a2-2706-4030-9e48-95f4d700f0a3 service cinder] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:33.256769 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1120/2232] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:03:33 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:03:33.339789 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44923030-ae0f-4a00-8279-4c494d7e0c16 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:33.341741 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-44923030-ae0f-4a00-8279-4c494d7e0c16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:03:33.418901 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44923030-ae0f-4a00-8279-4c494d7e0c16 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:33.424272 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61b5bd8-a10b-444c-b48d-a483d8448961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:33.425007 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61b5bd8-a10b-444c-b48d-a483d8448961 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:33.425284 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61b5bd8-a10b-444c-b48d-a483d8448961 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:33.425553 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61b5bd8-a10b-444c-b48d-a483d8448961 admin admin] PATH_INFO: `/v3/projects/e44ea79d6873438ab35ffea2f2976130` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:33.426690 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61b5bd8-a10b-444c-b48d-a483d8448961 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e44ea79d6873438ab35ffea2f2976130)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:33.428628 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61b5bd8-a10b-444c-b48d-a483d8448961 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:33.599730 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-d61b5bd8-a10b-444c-b48d-a483d8448961 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e44ea79d6873438ab35ffea2f2976130', 'request_id': 'req-d61b5bd8-a10b-444c-b48d-a483d8448961'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:33.605988 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-d61b5bd8-a10b-444c-b48d-a483d8448961 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e44ea79d6873438ab35ffea2f2976130', 'request_id': 'req-d61b5bd8-a10b-444c-b48d-a483d8448961'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:33.755362 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-d61b5bd8-a10b-444c-b48d-a483d8448961 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e44ea79d6873438ab35ffea2f2976130', 'request_id': 'req-d61b5bd8-a10b-444c-b48d-a483d8448961'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:33.771624 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-d61b5bd8-a10b-444c-b48d-a483d8448961 admin admin] The token cache is being invalidate because project e44ea79d6873438ab35ffea2f2976130 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:03:33.771928 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-d61b5bd8-a10b-444c-b48d-a483d8448961 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:33.772711 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-d61b5bd8-a10b-444c-b48d-a483d8448961 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:33.774239 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1113/2233] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Oct 4 12:03:33 2022] DELETE /identity/v3/projects/e44ea79d6873438ab35ffea2f2976130 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:03:33.779495 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f9fd9a-bb4b-4ef9-bc4a-84a6efef31fe None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:33.779725 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f9fd9a-bb4b-4ef9-bc4a-84a6efef31fe None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:33.780002 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f9fd9a-bb4b-4ef9-bc4a-84a6efef31fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:33.799675 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-05f9fd9a-bb4b-4ef9-bc4a-84a6efef31fe None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:03:33.801495 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-05f9fd9a-bb4b-4ef9-bc4a-84a6efef31fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:03:33.866379 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1121/2234] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:03:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:03:33.874391 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b27a92-0778-4247-b80d-3956be214ccd None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:33.874683 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b27a92-0778-4247-b80d-3956be214ccd None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:33.874956 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b27a92-0778-4247-b80d-3956be214ccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:33.896224 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-74b27a92-0778-4247-b80d-3956be214ccd None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:03:33.897578 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-74b27a92-0778-4247-b80d-3956be214ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:03:33.905945 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1114/2235] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:03:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:03:33.910723 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f9fd9a-bb4b-4ef9-bc4a-84a6efef31fe None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:33.920031 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f9fd9a-bb4b-4ef9-bc4a-84a6efef31fe None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:33.924740 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff520f25-b798-47db-bbb5-2df3d47a003c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:33.925350 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff520f25-b798-47db-bbb5-2df3d47a003c admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:33.925625 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff520f25-b798-47db-bbb5-2df3d47a003c admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:33.925891 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff520f25-b798-47db-bbb5-2df3d47a003c admin admin] PATH_INFO: `/v3/domains` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:33.926525 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff520f25-b798-47db-bbb5-2df3d47a003c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:03:33.926821 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff520f25-b798-47db-bbb5-2df3d47a003c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:33.928410 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff520f25-b798-47db-bbb5-2df3d47a003c admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:33.950114 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1122/2236] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Oct 4 12:03:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:03:33.955116 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b27a92-0778-4247-b80d-3956be214ccd None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:33.964513 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b27a92-0778-4247-b80d-3956be214ccd None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:33.969544 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d3e70a-93ec-4231-a324-11df0cf209d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:33.970864 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d3e70a-93ec-4231-a324-11df0cf209d7 admin admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:33.971143 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d3e70a-93ec-4231-a324-11df0cf209d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:33.973833 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d3e70a-93ec-4231-a324-11df0cf209d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:33.973833 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d3e70a-93ec-4231-a324-11df0cf209d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:33.974143 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d3e70a-93ec-4231-a324-11df0cf209d7 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:34.168184 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1115/2237] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Oct 4 12:03:33 2022] POST /identity/v3/projects => generated 377 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:03:34.169355 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff520f25-b798-47db-bbb5-2df3d47a003c admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:34.180246 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff520f25-b798-47db-bbb5-2df3d47a003c admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:34.272005 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e27fe03-0077-4305-9341-492c0b82a8c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:34.272670 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e27fe03-0077-4305-9341-492c0b82a8c1 admin admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:34.272929 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e27fe03-0077-4305-9341-492c0b82a8c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:34.273257 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e27fe03-0077-4305-9341-492c0b82a8c1 admin admin] PATH_INFO: `/v3/users` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:34.273898 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e27fe03-0077-4305-9341-492c0b82a8c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:34.275819 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e27fe03-0077-4305-9341-492c0b82a8c1 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:34.405582 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1123/2238] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Oct 4 12:03:34 2022] POST /identity/v3/users => generated 289 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:03:34.413585 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d3e70a-93ec-4231-a324-11df0cf209d7 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:34.441864 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d3e70a-93ec-4231-a324-11df0cf209d7 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:34.446851 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0616cd7f-5ea1-4d18-a5af-96df004f6428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:34.447643 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0616cd7f-5ea1-4d18-a5af-96df004f6428 admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:34.447984 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0616cd7f-5ea1-4d18-a5af-96df004f6428 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:34.448418 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0616cd7f-5ea1-4d18-a5af-96df004f6428 admin admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:34.449206 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0616cd7f-5ea1-4d18-a5af-96df004f6428 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:34.450857 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0616cd7f-5ea1-4d18-a5af-96df004f6428 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:34.462547 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1116/2239] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:03:34 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:03:34.467240 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e27fe03-0077-4305-9341-492c0b82a8c1 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:34.479496 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e27fe03-0077-4305-9341-492c0b82a8c1 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:34.484475 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe65d30d-c614-42f7-8110-0a13a21ac43d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:34.485180 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe65d30d-c614-42f7-8110-0a13a21ac43d admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:34.485841 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe65d30d-c614-42f7-8110-0a13a21ac43d admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:34.486476 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe65d30d-c614-42f7-8110-0a13a21ac43d admin admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:34.487244 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe65d30d-c614-42f7-8110-0a13a21ac43d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:34.488958 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe65d30d-c614-42f7-8110-0a13a21ac43d admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:34.502455 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1124/2240] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:03:34 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:03:34.507129 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0616cd7f-5ea1-4d18-a5af-96df004f6428 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:34.517390 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0616cd7f-5ea1-4d18-a5af-96df004f6428 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:34.526783 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31803e75-df6c-4a57-a5f3-ddc00efa730c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:34.527541 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31803e75-df6c-4a57-a5f3-ddc00efa730c admin admin] REQUEST_METHOD: `PUT` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:34.528417 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31803e75-df6c-4a57-a5f3-ddc00efa730c admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:34.528417 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31803e75-df6c-4a57-a5f3-ddc00efa730c admin admin] PATH_INFO: `/v3/projects/cd145b6efbf24ce49771c14c04c07075/users/dd52b0ba48f242a19b98d4c630446d59/roles/ab4307f3b7994c1c80036fa7db93b6b9` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:34.544521 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31803e75-df6c-4a57-a5f3-ddc00efa730c admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd145b6efbf24ce49771c14c04c07075, user_id=dd52b0ba48f242a19b98d4c630446d59, role_id=ab4307f3b7994c1c80036fa7db93b6b9)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:34.547235 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31803e75-df6c-4a57-a5f3-ddc00efa730c admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:34.677512 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1117/2241] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Oct 4 12:03:34 2022] PUT /identity/v3/projects/cd145b6efbf24ce49771c14c04c07075/users/dd52b0ba48f242a19b98d4c630446d59/roles/ab4307f3b7994c1c80036fa7db93b6b9 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:03:34.687989 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1273b12-070a-47dc-8fb9-e3a5842b42f5 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:34.688279 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1273b12-070a-47dc-8fb9-e3a5842b42f5 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:34.689133 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1273b12-070a-47dc-8fb9-e3a5842b42f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:34.718373 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-a1273b12-070a-47dc-8fb9-e3a5842b42f5 None None] MFA Rules not processed for user `dd52b0ba48f242a19b98d4c630446d59`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:03:34.719707 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-a1273b12-070a-47dc-8fb9-e3a5842b42f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:03:34.787159 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1125/2242] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:03:34 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:03:34.791557 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31803e75-df6c-4a57-a5f3-ddc00efa730c admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:34.851472 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:03:34.855140 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31803e75-df6c-4a57-a5f3-ddc00efa730c admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:34.859728 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24efca58-cc16-455b-9e1a-a267634405a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:34.860573 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24efca58-cc16-455b-9e1a-a267634405a6 admin admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:34.861383 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24efca58-cc16-455b-9e1a-a267634405a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:34.861653 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24efca58-cc16-455b-9e1a-a267634405a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:34.862285 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24efca58-cc16-455b-9e1a-a267634405a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:34.864188 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24efca58-cc16-455b-9e1a-a267634405a6 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:35.026632 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1118/2243] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Oct 4 12:03:34 2022] POST /identity/v3/projects => generated 377 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:03:35.030735 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1273b12-070a-47dc-8fb9-e3a5842b42f5 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:35.041576 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1273b12-070a-47dc-8fb9-e3a5842b42f5 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:35.095995 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39dd53e-21ab-4e68-96bd-ed34f5711237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:35.096593 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39dd53e-21ab-4e68-96bd-ed34f5711237 admin admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:35.096895 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39dd53e-21ab-4e68-96bd-ed34f5711237 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:35.097196 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39dd53e-21ab-4e68-96bd-ed34f5711237 admin admin] PATH_INFO: `/v3/users` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:35.097827 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39dd53e-21ab-4e68-96bd-ed34f5711237 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:35.099767 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39dd53e-21ab-4e68-96bd-ed34f5711237 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:35.326233 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1126/2244] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Oct 4 12:03:35 2022] POST /identity/v3/users => generated 289 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:03:35.327564 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24efca58-cc16-455b-9e1a-a267634405a6 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:35.338436 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24efca58-cc16-455b-9e1a-a267634405a6 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:35.349534 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3c4534-0fae-4370-9a6d-56d844b2b3e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:35.350161 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3c4534-0fae-4370-9a6d-56d844b2b3e8 admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:35.350903 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3c4534-0fae-4370-9a6d-56d844b2b3e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:35.350903 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3c4534-0fae-4370-9a6d-56d844b2b3e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:35.351385 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3c4534-0fae-4370-9a6d-56d844b2b3e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:35.353410 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3c4534-0fae-4370-9a6d-56d844b2b3e8 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:35.368867 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1119/2245] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:03:35 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:03:35.369866 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39dd53e-21ab-4e68-96bd-ed34f5711237 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:35.393949 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39dd53e-21ab-4e68-96bd-ed34f5711237 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:35.398204 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847ce141-7810-4269-9ae8-57e886d0affd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:35.398847 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847ce141-7810-4269-9ae8-57e886d0affd admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:35.399142 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847ce141-7810-4269-9ae8-57e886d0affd admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:35.399576 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847ce141-7810-4269-9ae8-57e886d0affd admin admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:35.400528 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847ce141-7810-4269-9ae8-57e886d0affd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:35.402332 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847ce141-7810-4269-9ae8-57e886d0affd admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:35.418046 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1127/2246] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:03:35 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:03:35.422295 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3c4534-0fae-4370-9a6d-56d844b2b3e8 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:35.434773 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3c4534-0fae-4370-9a6d-56d844b2b3e8 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:35.442275 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4ae035-2680-4495-8b67-80e6e9fcc303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:35.442946 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ae035-2680-4495-8b67-80e6e9fcc303 admin admin] REQUEST_METHOD: `PUT` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:35.443222 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ae035-2680-4495-8b67-80e6e9fcc303 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:35.443493 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ae035-2680-4495-8b67-80e6e9fcc303 admin admin] PATH_INFO: `/v3/projects/cdade62f641f434896ff9ca8bacb6e3f/users/7862fd3a67b2422c80fa7594d3ee430c/roles/ab4307f3b7994c1c80036fa7db93b6b9` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:35.463511 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4ae035-2680-4495-8b67-80e6e9fcc303 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdade62f641f434896ff9ca8bacb6e3f, user_id=7862fd3a67b2422c80fa7594d3ee430c, role_id=ab4307f3b7994c1c80036fa7db93b6b9)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:35.467664 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4ae035-2680-4495-8b67-80e6e9fcc303 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:35.560770 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1120/2247] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Oct 4 12:03:35 2022] PUT /identity/v3/projects/cdade62f641f434896ff9ca8bacb6e3f/users/7862fd3a67b2422c80fa7594d3ee430c/roles/ab4307f3b7994c1c80036fa7db93b6b9 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:03:35.572302 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d425f9-ccb2-4ae3-8da5-248490807259 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:35.572627 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d425f9-ccb2-4ae3-8da5-248490807259 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:35.572908 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d425f9-ccb2-4ae3-8da5-248490807259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:35.612589 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-67d425f9-ccb2-4ae3-8da5-248490807259 None None] MFA Rules not processed for user `7862fd3a67b2422c80fa7594d3ee430c`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:03:35.612589 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-67d425f9-ccb2-4ae3-8da5-248490807259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:03:35.683294 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1128/2248] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:03:35 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:03:35.687813 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4ae035-2680-4495-8b67-80e6e9fcc303 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:35.756329 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4ae035-2680-4495-8b67-80e6e9fcc303 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:35.771707 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740d4863-e11f-4043-89ce-c706321c802b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:35.771943 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740d4863-e11f-4043-89ce-c706321c802b admin admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:35.772257 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740d4863-e11f-4043-89ce-c706321c802b admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:35.772530 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740d4863-e11f-4043-89ce-c706321c802b admin admin] PATH_INFO: `/v3/projects` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:35.775939 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740d4863-e11f-4043-89ce-c706321c802b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:35.780317 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740d4863-e11f-4043-89ce-c706321c802b admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:36.017816 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1121/2249] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Oct 4 12:03:35 2022] POST /identity/v3/projects => generated 379 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:03:36.021605 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d425f9-ccb2-4ae3-8da5-248490807259 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:36.047733 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d425f9-ccb2-4ae3-8da5-248490807259 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:36.136857 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa8f330-4ffe-4983-b86d-38863e64d360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:36.137483 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa8f330-4ffe-4983-b86d-38863e64d360 admin admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:36.137767 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa8f330-4ffe-4983-b86d-38863e64d360 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:36.138040 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa8f330-4ffe-4983-b86d-38863e64d360 admin admin] PATH_INFO: `/v3/users` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:36.138767 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa8f330-4ffe-4983-b86d-38863e64d360 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:36.140802 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa8f330-4ffe-4983-b86d-38863e64d360 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:36.339957 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1129/2250] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Oct 4 12:03:36 2022] POST /identity/v3/users => generated 296 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 12:03:36.341542 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740d4863-e11f-4043-89ce-c706321c802b admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:36.352330 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740d4863-e11f-4043-89ce-c706321c802b admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:36.356928 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5e50ef-1900-42eb-b876-5c00716cbb2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:36.357526 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5e50ef-1900-42eb-b876-5c00716cbb2c admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:36.359789 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5e50ef-1900-42eb-b876-5c00716cbb2c admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:36.359789 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5e50ef-1900-42eb-b876-5c00716cbb2c admin admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:36.359789 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5e50ef-1900-42eb-b876-5c00716cbb2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:36.361188 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5e50ef-1900-42eb-b876-5c00716cbb2c admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:36.371798 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1122/2251] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:03:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 12:03:36.376180 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa8f330-4ffe-4983-b86d-38863e64d360 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:36.389173 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa8f330-4ffe-4983-b86d-38863e64d360 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:36.394629 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccfc931-96af-4fb5-8a35-9c38b7c85d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:36.396946 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccfc931-96af-4fb5-8a35-9c38b7c85d2d admin admin] REQUEST_METHOD: `PUT` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:36.396946 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccfc931-96af-4fb5-8a35-9c38b7c85d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:36.396946 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccfc931-96af-4fb5-8a35-9c38b7c85d2d admin admin] PATH_INFO: `/v3/projects/62582557d5f341e995de32dcecd4ae67/users/bb5cec2c2a90484d93ef22ebd8d9c9ca/roles/d6e7421d1ff9451c808004b818354550` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:36.411882 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccfc931-96af-4fb5-8a35-9c38b7c85d2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=62582557d5f341e995de32dcecd4ae67, user_id=bb5cec2c2a90484d93ef22ebd8d9c9ca, role_id=d6e7421d1ff9451c808004b818354550)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:36.414599 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccfc931-96af-4fb5-8a35-9c38b7c85d2d admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:36.530349 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1130/2252] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Oct 4 12:03:36 2022] PUT /identity/v3/projects/62582557d5f341e995de32dcecd4ae67/users/bb5cec2c2a90484d93ef22ebd8d9c9ca/roles/d6e7421d1ff9451c808004b818354550 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:03:36.531402 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5e50ef-1900-42eb-b876-5c00716cbb2c admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:36.541505 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5e50ef-1900-42eb-b876-5c00716cbb2c admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:36.609658 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dd5b9b-f864-4e3c-a08e-c494afb80a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:36.611725 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dd5b9b-f864-4e3c-a08e-c494afb80a32 admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:36.612130 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dd5b9b-f864-4e3c-a08e-c494afb80a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:36.612418 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dd5b9b-f864-4e3c-a08e-c494afb80a32 admin admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:36.613247 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dd5b9b-f864-4e3c-a08e-c494afb80a32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:36.615123 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dd5b9b-f864-4e3c-a08e-c494afb80a32 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:36.631022 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1123/2253] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:03:36 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:03:36.632298 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccfc931-96af-4fb5-8a35-9c38b7c85d2d admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:36.646715 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccfc931-96af-4fb5-8a35-9c38b7c85d2d admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:36.653157 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba747c6-dad2-462c-a9ec-f43fc3f5ae66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:36.654882 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba747c6-dad2-462c-a9ec-f43fc3f5ae66 admin admin] REQUEST_METHOD: `PUT` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:36.655235 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba747c6-dad2-462c-a9ec-f43fc3f5ae66 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:36.655583 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba747c6-dad2-462c-a9ec-f43fc3f5ae66 admin admin] PATH_INFO: `/v3/projects/62582557d5f341e995de32dcecd4ae67/users/bb5cec2c2a90484d93ef22ebd8d9c9ca/roles/d6e7421d1ff9451c808004b818354550` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:36.659726 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba747c6-dad2-462c-a9ec-f43fc3f5ae66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62582557d5f341e995de32dcecd4ae67, user_id=bb5cec2c2a90484d93ef22ebd8d9c9ca, role_id=d6e7421d1ff9451c808004b818354550)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:36.662587 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba747c6-dad2-462c-a9ec-f43fc3f5ae66 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:36.687520 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8cbab7-bb53-4de8-8e4b-c6cc74e2bdea None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:36.687901 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8cbab7-bb53-4de8-8e4b-c6cc74e2bdea None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:36.688929 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8cbab7-bb53-4de8-8e4b-c6cc74e2bdea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:36.699051 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1131/2254] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Oct 4 12:03:36 2022] PUT /identity/v3/projects/62582557d5f341e995de32dcecd4ae67/users/bb5cec2c2a90484d93ef22ebd8d9c9ca/roles/d6e7421d1ff9451c808004b818354550 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:03:36.749275 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-7f8cbab7-bb53-4de8-8e4b-c6cc74e2bdea None None] MFA Rules not processed for user `bb5cec2c2a90484d93ef22ebd8d9c9ca`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:03:36.750798 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-7f8cbab7-bb53-4de8-8e4b-c6cc74e2bdea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:03:36.896387 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:03:36.909518 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1124/2255] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:03:36 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:03:36.921536 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba747c6-dad2-462c-a9ec-f43fc3f5ae66 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:36.923561 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-fba747c6-dad2-462c-a9ec-f43fc3f5ae66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:03:37.009743 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba747c6-dad2-462c-a9ec-f43fc3f5ae66 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:37.013421 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e65d7f-265a-4df5-8b68-8edfb0dc582e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e2a05b782424ab2928b5864f1bfd556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:37.014066 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e65d7f-265a-4df5-8b68-8edfb0dc582e service cinder] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:37.014395 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e65d7f-265a-4df5-8b68-8edfb0dc582e service cinder] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:37.014574 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e65d7f-265a-4df5-8b68-8edfb0dc582e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:37.027828 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e65d7f-265a-4df5-8b68-8edfb0dc582e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:37.029665 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e65d7f-265a-4df5-8b68-8edfb0dc582e service cinder] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:37.044893 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1132/2256] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:03:36 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:03:37.205790 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8cbab7-bb53-4de8-8e4b-c6cc74e2bdea None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:37.207368 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-7f8cbab7-bb53-4de8-8e4b-c6cc74e2bdea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:03:37.234419 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8cbab7-bb53-4de8-8e4b-c6cc74e2bdea None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:37.241912 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98214bb0-2b3b-45db-9d7d-466304546b2c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e2a05b782424ab2928b5864f1bfd556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:37.243166 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98214bb0-2b3b-45db-9d7d-466304546b2c service cinder] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:37.243460 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98214bb0-2b3b-45db-9d7d-466304546b2c service cinder] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:37.243778 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98214bb0-2b3b-45db-9d7d-466304546b2c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:37.323390 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98214bb0-2b3b-45db-9d7d-466304546b2c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:37.325102 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98214bb0-2b3b-45db-9d7d-466304546b2c service cinder] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:37.335313 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1125/2257] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:03:37 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:03:38.381023 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:03:40.031717 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:03:40.229486 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95153f4d-6d07-438c-9a53-1efa1c004b9f None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:40.230825 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95153f4d-6d07-438c-9a53-1efa1c004b9f None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:40.231111 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95153f4d-6d07-438c-9a53-1efa1c004b9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:40.255718 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-95153f4d-6d07-438c-9a53-1efa1c004b9f None None] MFA Rules not processed for user `06d1850ea27c483780eed67ede9cc1e3`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:03:40.257319 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-95153f4d-6d07-438c-9a53-1efa1c004b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:03:40.344376 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1133/2258] 10.222.0.59 () {58 vars in 1009 bytes} [Tue Oct 4 12:03:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:03:40.420037 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98214bb0-2b3b-45db-9d7d-466304546b2c service cinder] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:40.422425 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-98214bb0-2b3b-45db-9d7d-466304546b2c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:03:40.500523 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c872a78-9b44-4758-a5b0-d04c95872063 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:40.501468 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c872a78-9b44-4758-a5b0-d04c95872063 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:40.501790 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c872a78-9b44-4758-a5b0-d04c95872063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:40.539427 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98214bb0-2b3b-45db-9d7d-466304546b2c service cinder] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:40.544323 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-8c872a78-9b44-4758-a5b0-d04c95872063 None None] MFA Rules not processed for user `d10032bc71e64ffdb16753c659b98a3c`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:03:40.545563 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-8c872a78-9b44-4758-a5b0-d04c95872063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:03:40.552436 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d46423-6d88-4864-a87b-01bab15b4a39 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1605c3e03b7a4bcba4e19f0d92c671bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:40.553294 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d46423-6d88-4864-a87b-01bab15b4a39 service swift] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:40.553502 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d46423-6d88-4864-a87b-01bab15b4a39 service swift] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:40.553903 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d46423-6d88-4864-a87b-01bab15b4a39 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:40.569904 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d46423-6d88-4864-a87b-01bab15b4a39 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:40.572091 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d46423-6d88-4864-a87b-01bab15b4a39 service swift] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:40.592859 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1126/2259] 10.222.0.59 () {60 vars in 1384 bytes} [Tue Oct 4 12:03:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 12:03:40.643787 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1134/2260] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:03:40 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:03:41.312341 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:03:44.346518 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d46423-6d88-4864-a87b-01bab15b4a39 service swift] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:44.414300 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d46423-6d88-4864-a87b-01bab15b4a39 service swift] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:44.419057 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b97208-b0eb-4725-8fb9-4fc815bff532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:44.419694 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b97208-b0eb-4725-8fb9-4fc815bff532 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:44.419972 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b97208-b0eb-4725-8fb9-4fc815bff532 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:44.420246 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b97208-b0eb-4725-8fb9-4fc815bff532 admin admin] PATH_INFO: `/v3/users/dd52b0ba48f242a19b98d4c630446d59` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:44.421396 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b97208-b0eb-4725-8fb9-4fc815bff532 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd52b0ba48f242a19b98d4c630446d59)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:44.423379 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b97208-b0eb-4725-8fb9-4fc815bff532 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:44.857505 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-02b97208-b0eb-4725-8fb9-4fc815bff532 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd52b0ba48f242a19b98d4c630446d59'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:44.886775 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-02b97208-b0eb-4725-8fb9-4fc815bff532 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd52b0ba48f242a19b98d4c630446d59'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:44.888125 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-02b97208-b0eb-4725-8fb9-4fc815bff532 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd52b0ba48f242a19b98d4c630446d59'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:44.889058 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-02b97208-b0eb-4725-8fb9-4fc815bff532 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd52b0ba48f242a19b98d4c630446d59'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:45.004671 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-02b97208-b0eb-4725-8fb9-4fc815bff532 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd52b0ba48f242a19b98d4c630446d59'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:45.035069 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1127/2261] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Oct 4 12:03:44 2022] DELETE /identity/v3/users/dd52b0ba48f242a19b98d4c630446d59 => generated 0 bytes in 690 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:03:45.041356 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7758fd29-25fb-4c1e-a33f-8cece3601a02 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:45.042022 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7758fd29-25fb-4c1e-a33f-8cece3601a02 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:45.042022 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7758fd29-25fb-4c1e-a33f-8cece3601a02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:45.070849 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-7758fd29-25fb-4c1e-a33f-8cece3601a02 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:03:45.072026 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-7758fd29-25fb-4c1e-a33f-8cece3601a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:03:45.144312 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1135/2262] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:03:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:03:45.156822 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b97208-b0eb-4725-8fb9-4fc815bff532 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:45.158982 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-02b97208-b0eb-4725-8fb9-4fc815bff532 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:03:45.232321 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b97208-b0eb-4725-8fb9-4fc815bff532 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:45.240037 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c0b8d3-dd24-4409-889f-4a4769c4eeb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7289515c5c44914a19daa439de98cb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:45.240774 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c0b8d3-dd24-4409-889f-4a4769c4eeb9 service neutron] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:45.241048 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c0b8d3-dd24-4409-889f-4a4769c4eeb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:45.241475 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c0b8d3-dd24-4409-889f-4a4769c4eeb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:45.252350 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c0b8d3-dd24-4409-889f-4a4769c4eeb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:45.255820 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c0b8d3-dd24-4409-889f-4a4769c4eeb9 service neutron] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:45.284274 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1128/2263] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:03:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:03:46.041096 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7758fd29-25fb-4c1e-a33f-8cece3601a02 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:46.050916 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-7758fd29-25fb-4c1e-a33f-8cece3601a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:03:46.093148 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7758fd29-25fb-4c1e-a33f-8cece3601a02 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:46.112923 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2f4010-9bd8-4450-a49d-5b351c9337b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:46.114747 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2f4010-9bd8-4450-a49d-5b351c9337b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:46.115034 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2f4010-9bd8-4450-a49d-5b351c9337b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:46.116458 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2f4010-9bd8-4450-a49d-5b351c9337b9 admin admin] PATH_INFO: `/v3/projects/cd145b6efbf24ce49771c14c04c07075` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:46.118978 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2f4010-9bd8-4450-a49d-5b351c9337b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd145b6efbf24ce49771c14c04c07075)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:46.123296 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2f4010-9bd8-4450-a49d-5b351c9337b9 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:46.249437 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:03:46.375489 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-3c2f4010-9bd8-4450-a49d-5b351c9337b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd145b6efbf24ce49771c14c04c07075', 'request_id': 'req-3c2f4010-9bd8-4450-a49d-5b351c9337b9'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:46.516084 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-3c2f4010-9bd8-4450-a49d-5b351c9337b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd145b6efbf24ce49771c14c04c07075', 'request_id': 'req-3c2f4010-9bd8-4450-a49d-5b351c9337b9'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:46.526666 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-3c2f4010-9bd8-4450-a49d-5b351c9337b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd145b6efbf24ce49771c14c04c07075', 'request_id': 'req-3c2f4010-9bd8-4450-a49d-5b351c9337b9'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:46.554011 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-3c2f4010-9bd8-4450-a49d-5b351c9337b9 admin admin] The token cache is being invalidate because project cd145b6efbf24ce49771c14c04c07075 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:03:46.554546 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-3c2f4010-9bd8-4450-a49d-5b351c9337b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:46.555483 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-3c2f4010-9bd8-4450-a49d-5b351c9337b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:46.558544 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1136/2264] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Oct 4 12:03:46 2022] DELETE /identity/v3/projects/cd145b6efbf24ce49771c14c04c07075 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:03:46.562572 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c0b8d3-dd24-4409-889f-4a4769c4eeb9 service neutron] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:46.576584 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c0b8d3-dd24-4409-889f-4a4769c4eeb9 service neutron] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:46.664992 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7508f2f4-fd40-41c1-a23c-f477b7f5dd38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:46.665953 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7508f2f4-fd40-41c1-a23c-f477b7f5dd38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:46.666381 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7508f2f4-fd40-41c1-a23c-f477b7f5dd38 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:46.666809 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7508f2f4-fd40-41c1-a23c-f477b7f5dd38 admin admin] PATH_INFO: `/v3/users/7862fd3a67b2422c80fa7594d3ee430c` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:46.668542 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7508f2f4-fd40-41c1-a23c-f477b7f5dd38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7862fd3a67b2422c80fa7594d3ee430c)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:46.672419 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7508f2f4-fd40-41c1-a23c-f477b7f5dd38 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:47.004403 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-7508f2f4-fd40-41c1-a23c-f477b7f5dd38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7862fd3a67b2422c80fa7594d3ee430c'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:47.024259 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-7508f2f4-fd40-41c1-a23c-f477b7f5dd38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7862fd3a67b2422c80fa7594d3ee430c'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:47.025281 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-7508f2f4-fd40-41c1-a23c-f477b7f5dd38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7862fd3a67b2422c80fa7594d3ee430c'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:47.025905 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-7508f2f4-fd40-41c1-a23c-f477b7f5dd38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7862fd3a67b2422c80fa7594d3ee430c'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:47.301826 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-7508f2f4-fd40-41c1-a23c-f477b7f5dd38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7862fd3a67b2422c80fa7594d3ee430c'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:47.330662 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1129/2265] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Oct 4 12:03:46 2022] DELETE /identity/v3/users/7862fd3a67b2422c80fa7594d3ee430c => generated 0 bytes in 768 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:03:47.780475 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:03:48.716077 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2f4010-9bd8-4450-a49d-5b351c9337b9 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:48.717992 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-3c2f4010-9bd8-4450-a49d-5b351c9337b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:03:48.740419 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2f4010-9bd8-4450-a49d-5b351c9337b9 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:48.818606 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcce481-e0b4-4028-b129-9e224e29a0bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:48.819984 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcce481-e0b4-4028-b129-9e224e29a0bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:48.820434 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcce481-e0b4-4028-b129-9e224e29a0bc admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:48.820892 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcce481-e0b4-4028-b129-9e224e29a0bc admin admin] PATH_INFO: `/v3/projects/cdade62f641f434896ff9ca8bacb6e3f` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:48.822262 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcce481-e0b4-4028-b129-9e224e29a0bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdade62f641f434896ff9ca8bacb6e3f)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:48.824561 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcce481-e0b4-4028-b129-9e224e29a0bc admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:49.027093 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-6fcce481-e0b4-4028-b129-9e224e29a0bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdade62f641f434896ff9ca8bacb6e3f', 'request_id': 'req-6fcce481-e0b4-4028-b129-9e224e29a0bc'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:49.162863 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-6fcce481-e0b4-4028-b129-9e224e29a0bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdade62f641f434896ff9ca8bacb6e3f', 'request_id': 'req-6fcce481-e0b4-4028-b129-9e224e29a0bc'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:49.172067 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-6fcce481-e0b4-4028-b129-9e224e29a0bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdade62f641f434896ff9ca8bacb6e3f', 'request_id': 'req-6fcce481-e0b4-4028-b129-9e224e29a0bc'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:49.184363 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-6fcce481-e0b4-4028-b129-9e224e29a0bc admin admin] The token cache is being invalidate because project cdade62f641f434896ff9ca8bacb6e3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:03:49.184673 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-6fcce481-e0b4-4028-b129-9e224e29a0bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:49.185448 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-6fcce481-e0b4-4028-b129-9e224e29a0bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:49.190328 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1137/2266] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Oct 4 12:03:48 2022] DELETE /identity/v3/projects/cdade62f641f434896ff9ca8bacb6e3f => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:03:49.191580 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7508f2f4-fd40-41c1-a23c-f477b7f5dd38 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:49.195122 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-7508f2f4-fd40-41c1-a23c-f477b7f5dd38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:03:49.208912 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7508f2f4-fd40-41c1-a23c-f477b7f5dd38 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:49.343846 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021595bd-e391-4979-85fb-d7738b6d120c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:49.350170 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021595bd-e391-4979-85fb-d7738b6d120c admin admin] REQUEST_METHOD: `DELETE` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:49.350398 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021595bd-e391-4979-85fb-d7738b6d120c admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:49.351223 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021595bd-e391-4979-85fb-d7738b6d120c admin admin] PATH_INFO: `/v3/users/bb5cec2c2a90484d93ef22ebd8d9c9ca` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:49.353417 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021595bd-e391-4979-85fb-d7738b6d120c admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb5cec2c2a90484d93ef22ebd8d9c9ca)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:49.358453 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021595bd-e391-4979-85fb-d7738b6d120c admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:49.726846 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-021595bd-e391-4979-85fb-d7738b6d120c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb5cec2c2a90484d93ef22ebd8d9c9ca'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:49.742694 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-021595bd-e391-4979-85fb-d7738b6d120c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb5cec2c2a90484d93ef22ebd8d9c9ca'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:49.742694 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-021595bd-e391-4979-85fb-d7738b6d120c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb5cec2c2a90484d93ef22ebd8d9c9ca'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:49.743776 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-021595bd-e391-4979-85fb-d7738b6d120c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb5cec2c2a90484d93ef22ebd8d9c9ca'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:49.839763 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-021595bd-e391-4979-85fb-d7738b6d120c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb5cec2c2a90484d93ef22ebd8d9c9ca'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:49.883874 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1130/2267] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Oct 4 12:03:49 2022] DELETE /identity/v3/users/bb5cec2c2a90484d93ef22ebd8d9c9ca => generated 0 bytes in 689 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:03:50.724060 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcce481-e0b4-4028-b129-9e224e29a0bc admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:50.724060 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-6fcce481-e0b4-4028-b129-9e224e29a0bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:03:50.737417 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcce481-e0b4-4028-b129-9e224e29a0bc admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:50.846903 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f63c64f-2b5c-4dc4-9d06-785743186798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:50.847666 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f63c64f-2b5c-4dc4-9d06-785743186798 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:50.848020 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f63c64f-2b5c-4dc4-9d06-785743186798 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:50.848370 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f63c64f-2b5c-4dc4-9d06-785743186798 admin admin] PATH_INFO: `/v3/projects/62582557d5f341e995de32dcecd4ae67` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:50.851993 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f63c64f-2b5c-4dc4-9d06-785743186798 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62582557d5f341e995de32dcecd4ae67)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:50.854350 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f63c64f-2b5c-4dc4-9d06-785743186798 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:51.014830 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-6f63c64f-2b5c-4dc4-9d06-785743186798 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62582557d5f341e995de32dcecd4ae67', 'request_id': 'req-6f63c64f-2b5c-4dc4-9d06-785743186798'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:51.095648 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:03:51.135091 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-6f63c64f-2b5c-4dc4-9d06-785743186798 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62582557d5f341e995de32dcecd4ae67', 'request_id': 'req-6f63c64f-2b5c-4dc4-9d06-785743186798'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:51.147518 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-6f63c64f-2b5c-4dc4-9d06-785743186798 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62582557d5f341e995de32dcecd4ae67', 'request_id': 'req-6f63c64f-2b5c-4dc4-9d06-785743186798'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:51.160074 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:03:51.166295 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-6f63c64f-2b5c-4dc4-9d06-785743186798 admin admin] The token cache is being invalidate because project 62582557d5f341e995de32dcecd4ae67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:03:51.166931 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-6f63c64f-2b5c-4dc4-9d06-785743186798 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:51.168082 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-6f63c64f-2b5c-4dc4-9d06-785743186798 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:03:51.170098 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1138/2268] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Oct 4 12:03:50 2022] DELETE /identity/v3/projects/62582557d5f341e995de32dcecd4ae67 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:03:51.178392 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2329c996-9fe5-459a-96f8-cf07c8cbd853 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:51.178663 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2329c996-9fe5-459a-96f8-cf07c8cbd853 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:51.179190 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2329c996-9fe5-459a-96f8-cf07c8cbd853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:51.219054 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-2329c996-9fe5-459a-96f8-cf07c8cbd853 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:03:51.221852 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-2329c996-9fe5-459a-96f8-cf07c8cbd853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:03:51.319032 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1131/2269] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:03:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:03:51.328018 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f2eec2-ad7c-4fa3-bbab-9d8440c0508f None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:51.328018 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f2eec2-ad7c-4fa3-bbab-9d8440c0508f None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:51.332246 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f2eec2-ad7c-4fa3-bbab-9d8440c0508f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:51.374322 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-13f2eec2-ad7c-4fa3-bbab-9d8440c0508f None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:03:51.376961 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-13f2eec2-ad7c-4fa3-bbab-9d8440c0508f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:03:51.386092 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1139/2270] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:03:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:03:51.392910 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2329c996-9fe5-459a-96f8-cf07c8cbd853 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:51.411200 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2329c996-9fe5-459a-96f8-cf07c8cbd853 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:51.416925 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7b4ffd-b240-4967-a242-ab5bdba07986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:51.417557 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b4ffd-b240-4967-a242-ab5bdba07986 admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:51.417838 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b4ffd-b240-4967-a242-ab5bdba07986 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:51.418116 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b4ffd-b240-4967-a242-ab5bdba07986 admin admin] PATH_INFO: `/v3/domains` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:51.419393 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7b4ffd-b240-4967-a242-ab5bdba07986 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:03:51.419732 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7b4ffd-b240-4967-a242-ab5bdba07986 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:51.421434 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7b4ffd-b240-4967-a242-ab5bdba07986 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:51.441065 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1132/2271] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Oct 4 12:03:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 12:03:51.445399 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f2eec2-ad7c-4fa3-bbab-9d8440c0508f None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:51.456653 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f2eec2-ad7c-4fa3-bbab-9d8440c0508f None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:51.473370 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71b0f3e-7513-422c-b13c-a9a4d45e449c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:51.475201 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71b0f3e-7513-422c-b13c-a9a4d45e449c admin admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:51.475526 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71b0f3e-7513-422c-b13c-a9a4d45e449c admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:51.475768 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71b0f3e-7513-422c-b13c-a9a4d45e449c admin admin] PATH_INFO: `/v3/projects` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:51.476533 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71b0f3e-7513-422c-b13c-a9a4d45e449c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:51.482189 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71b0f3e-7513-422c-b13c-a9a4d45e449c admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:51.611270 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1140/2272] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Oct 4 12:03:51 2022] POST /identity/v3/projects => generated 371 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:03:51.612113 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7b4ffd-b240-4967-a242-ab5bdba07986 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:51.630767 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7b4ffd-b240-4967-a242-ab5bdba07986 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:51.743321 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c698ffbb-d190-45b8-bd80-8787ae65e854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:51.744300 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c698ffbb-d190-45b8-bd80-8787ae65e854 admin admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:51.744791 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c698ffbb-d190-45b8-bd80-8787ae65e854 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:51.745236 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c698ffbb-d190-45b8-bd80-8787ae65e854 admin admin] PATH_INFO: `/v3/users` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:51.746104 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c698ffbb-d190-45b8-bd80-8787ae65e854 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:51.748266 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c698ffbb-d190-45b8-bd80-8787ae65e854 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:51.966117 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1133/2273] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Oct 4 12:03:51 2022] POST /identity/v3/users => generated 286 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 12:03:51.967426 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71b0f3e-7513-422c-b13c-a9a4d45e449c admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:51.991509 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71b0f3e-7513-422c-b13c-a9a4d45e449c admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:51.996196 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72650ad6-f471-4215-b0d1-c1bafea2dbe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:51.996849 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72650ad6-f471-4215-b0d1-c1bafea2dbe4 admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:51.997133 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72650ad6-f471-4215-b0d1-c1bafea2dbe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:51.997409 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72650ad6-f471-4215-b0d1-c1bafea2dbe4 admin admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:51.998498 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72650ad6-f471-4215-b0d1-c1bafea2dbe4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:51.999715 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72650ad6-f471-4215-b0d1-c1bafea2dbe4 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:52.012652 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1141/2274] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:03:51 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:03:52.016098 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c698ffbb-d190-45b8-bd80-8787ae65e854 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:52.028199 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c698ffbb-d190-45b8-bd80-8787ae65e854 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:52.034291 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fc0d67-5baf-4e59-9291-eadd8a05054b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:52.035075 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fc0d67-5baf-4e59-9291-eadd8a05054b admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:52.035473 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fc0d67-5baf-4e59-9291-eadd8a05054b admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:52.035856 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fc0d67-5baf-4e59-9291-eadd8a05054b admin admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:52.036626 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fc0d67-5baf-4e59-9291-eadd8a05054b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:52.038337 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fc0d67-5baf-4e59-9291-eadd8a05054b admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:52.056269 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1134/2275] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:03:52 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:03:52.057627 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72650ad6-f471-4215-b0d1-c1bafea2dbe4 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:52.072063 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72650ad6-f471-4215-b0d1-c1bafea2dbe4 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:52.077394 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bb6563-773c-4407-95f3-d3a9507f70b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:52.078174 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bb6563-773c-4407-95f3-d3a9507f70b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:52.078591 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bb6563-773c-4407-95f3-d3a9507f70b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:52.078993 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bb6563-773c-4407-95f3-d3a9507f70b8 admin admin] PATH_INFO: `/v3/projects/f6ca0cbd93e94e78b6b49483946e9832/users/24c1e15411394a06bb88ca1cfc0ec429/roles/ab4307f3b7994c1c80036fa7db93b6b9` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:52.095127 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bb6563-773c-4407-95f3-d3a9507f70b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6ca0cbd93e94e78b6b49483946e9832, user_id=24c1e15411394a06bb88ca1cfc0ec429, role_id=ab4307f3b7994c1c80036fa7db93b6b9)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:52.097933 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bb6563-773c-4407-95f3-d3a9507f70b8 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:52.257724 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1142/2276] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Oct 4 12:03:52 2022] PUT /identity/v3/projects/f6ca0cbd93e94e78b6b49483946e9832/users/24c1e15411394a06bb88ca1cfc0ec429/roles/ab4307f3b7994c1c80036fa7db93b6b9 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:03:52.272199 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427e56da-3f20-407f-a7c8-0db784ebf2c4 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:52.280366 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427e56da-3f20-407f-a7c8-0db784ebf2c4 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:52.280366 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427e56da-3f20-407f-a7c8-0db784ebf2c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:52.316666 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-427e56da-3f20-407f-a7c8-0db784ebf2c4 None None] MFA Rules not processed for user `24c1e15411394a06bb88ca1cfc0ec429`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:03:52.319838 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-427e56da-3f20-407f-a7c8-0db784ebf2c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:03:52.433251 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1135/2277] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:03:52 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:03:52.449448 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bb6563-773c-4407-95f3-d3a9507f70b8 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:03:52.451567 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-b9bb6563-773c-4407-95f3-d3a9507f70b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:03:52.554574 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bb6563-773c-4407-95f3-d3a9507f70b8 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:03:52.558371 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da919fe6-c90e-4a6f-855d-a6c1bf717a3a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e2a05b782424ab2928b5864f1bfd556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:03:52.559340 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da919fe6-c90e-4a6f-855d-a6c1bf717a3a service cinder] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:03:52.559681 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da919fe6-c90e-4a6f-855d-a6c1bf717a3a service cinder] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:03:52.559966 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da919fe6-c90e-4a6f-855d-a6c1bf717a3a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:03:52.577263 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da919fe6-c90e-4a6f-855d-a6c1bf717a3a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:03:52.579681 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da919fe6-c90e-4a6f-855d-a6c1bf717a3a service cinder] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:03:52.590546 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1143/2278] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:03:52 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:03:56.511737 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:03:56.723328 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:03:59.027948 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:03:59.643221 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:04:00.631695 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:04:01.905112 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5df859-8f1a-479f-807b-f18b1fea2ede None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:04:01.905605 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5df859-8f1a-479f-807b-f18b1fea2ede None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:04:01.905801 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5df859-8f1a-479f-807b-f18b1fea2ede None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:04:01.907814 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1136/2279] 10.222.0.59 () {54 vars in 921 bytes} [Tue Oct 4 12:04:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:04:01.913799 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa4ceea-1576-4409-9aba-58a75e72d59a None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:04:01.914283 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa4ceea-1576-4409-9aba-58a75e72d59a None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:04:01.914469 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa4ceea-1576-4409-9aba-58a75e72d59a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:04:01.935430 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-1fa4ceea-1576-4409-9aba-58a75e72d59a None None] MFA Rules not processed for user `a8e23d1d2fe24bdf9552e7c2f0ae3424`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:04:01.937062 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-1fa4ceea-1576-4409-9aba-58a75e72d59a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:04:02.014915 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1144/2280] 10.222.0.59 () {58 vars in 1018 bytes} [Tue Oct 4 12:04:01 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:04:02.027577 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5df859-8f1a-479f-807b-f18b1fea2ede None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:04:02.029578 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-be5df859-8f1a-479f-807b-f18b1fea2ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:04:02.100643 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5df859-8f1a-479f-807b-f18b1fea2ede None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:04:02.104348 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d97435-6e40-49ec-82f1-bd5dfe213643 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd516d0755be84b7293156625df1b13b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:04:02.105006 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d97435-6e40-49ec-82f1-bd5dfe213643 service glance] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:04:02.105591 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d97435-6e40-49ec-82f1-bd5dfe213643 service glance] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:04:02.105884 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d97435-6e40-49ec-82f1-bd5dfe213643 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:04:02.117351 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d97435-6e40-49ec-82f1-bd5dfe213643 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:04:02.118840 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d97435-6e40-49ec-82f1-bd5dfe213643 service glance] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:04:02.134694 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1137/2281] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:04:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:04:02.433599 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19de59a3-499b-4925-b6a6-53ec24e851be None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:04:02.433887 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19de59a3-499b-4925-b6a6-53ec24e851be None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:04:02.434166 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19de59a3-499b-4925-b6a6-53ec24e851be None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:04:02.435523 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1145/2282] 10.222.0.59 () {54 vars in 921 bytes} [Tue Oct 4 12:04:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:04:02.441345 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af254a4-5ff6-405c-acc9-485ddf1b4b36 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:04:02.441637 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af254a4-5ff6-405c-acc9-485ddf1b4b36 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:04:02.441915 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af254a4-5ff6-405c-acc9-485ddf1b4b36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:04:02.462448 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-4af254a4-5ff6-405c-acc9-485ddf1b4b36 None None] MFA Rules not processed for user `e7289515c5c44914a19daa439de98cb1`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:04:02.463671 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-4af254a4-5ff6-405c-acc9-485ddf1b4b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:04:02.515462 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1138/2283] 10.222.0.59 () {58 vars in 1018 bytes} [Tue Oct 4 12:04:02 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:04:02.528933 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19de59a3-499b-4925-b6a6-53ec24e851be None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:04:02.530658 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-19de59a3-499b-4925-b6a6-53ec24e851be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:04:02.543583 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19de59a3-499b-4925-b6a6-53ec24e851be None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:04:02.547641 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ab81d3-0588-4a39-9c9f-f61d2bf90b94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7289515c5c44914a19daa439de98cb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:04:02.548227 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ab81d3-0588-4a39-9c9f-f61d2bf90b94 service neutron] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:04:02.548507 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ab81d3-0588-4a39-9c9f-f61d2bf90b94 service neutron] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:04:02.548814 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ab81d3-0588-4a39-9c9f-f61d2bf90b94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:04:02.555728 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ab81d3-0588-4a39-9c9f-f61d2bf90b94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:04:02.557200 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ab81d3-0588-4a39-9c9f-f61d2bf90b94 service neutron] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:04:02.565991 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1146/2284] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:04:02 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:04:02.656968 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd98893e-3a11-4d91-a953-d44dedb89511 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:04:02.657314 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd98893e-3a11-4d91-a953-d44dedb89511 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:04:02.657630 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd98893e-3a11-4d91-a953-d44dedb89511 None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:04:02.659048 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1139/2285] 10.222.0.59 () {54 vars in 921 bytes} [Tue Oct 4 12:04:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:04:02.664749 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1036424f-ec6f-452c-94a9-0d3ef8e959d4 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:04:02.665050 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1036424f-ec6f-452c-94a9-0d3ef8e959d4 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:04:02.665368 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1036424f-ec6f-452c-94a9-0d3ef8e959d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:04:02.690810 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-1036424f-ec6f-452c-94a9-0d3ef8e959d4 None None] MFA Rules not processed for user `a8e23d1d2fe24bdf9552e7c2f0ae3424`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:04:02.692007 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-1036424f-ec6f-452c-94a9-0d3ef8e959d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:04:02.706625 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1147/2286] 10.222.0.59 () {58 vars in 1018 bytes} [Tue Oct 4 12:04:02 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:04:02.717931 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd98893e-3a11-4d91-a953-d44dedb89511 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:04:02.721463 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-dd98893e-3a11-4d91-a953-d44dedb89511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:04:02.741486 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd98893e-3a11-4d91-a953-d44dedb89511 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:04:02.745544 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90569a8-57fc-45a7-be41-c468d38e0024 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7289515c5c44914a19daa439de98cb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:04:02.746144 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90569a8-57fc-45a7-be41-c468d38e0024 service neutron] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:04:02.746418 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90569a8-57fc-45a7-be41-c468d38e0024 service neutron] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:04:02.746685 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90569a8-57fc-45a7-be41-c468d38e0024 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:04:02.764715 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90569a8-57fc-45a7-be41-c468d38e0024 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:04:02.767241 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90569a8-57fc-45a7-be41-c468d38e0024 service neutron] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:04:02.782699 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1140/2287] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:04:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:04:02.814612 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:04:03.717426 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:04:05.202927 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:04:06.575635 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:04:08.586396 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:04:09.237932 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d647c2f-106d-480c-a790-c7ba4d93dfe9 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:04:09.238428 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d647c2f-106d-480c-a790-c7ba4d93dfe9 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:04:09.238527 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d647c2f-106d-480c-a790-c7ba4d93dfe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:04:09.265198 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-3d647c2f-106d-480c-a790-c7ba4d93dfe9 None None] MFA Rules not processed for user `06d1850ea27c483780eed67ede9cc1e3`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:04:09.267310 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-3d647c2f-106d-480c-a790-c7ba4d93dfe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:04:09.329196 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1148/2288] 10.222.0.59 () {58 vars in 1009 bytes} [Tue Oct 4 12:04:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:04:09.342439 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90569a8-57fc-45a7-be41-c468d38e0024 service neutron] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:04:09.344530 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-b90569a8-57fc-45a7-be41-c468d38e0024 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:04:09.418889 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90569a8-57fc-45a7-be41-c468d38e0024 service neutron] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:04:09.424273 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b552a5-c8cc-4ebe-adb6-0efc9a12a394 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1605c3e03b7a4bcba4e19f0d92c671bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:04:09.424918 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b552a5-c8cc-4ebe-adb6-0efc9a12a394 service swift] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:04:09.425200 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b552a5-c8cc-4ebe-adb6-0efc9a12a394 service swift] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:04:09.425522 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b552a5-c8cc-4ebe-adb6-0efc9a12a394 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:04:09.434438 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b552a5-c8cc-4ebe-adb6-0efc9a12a394 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:04:09.436026 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b552a5-c8cc-4ebe-adb6-0efc9a12a394 service swift] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:04:09.444898 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1141/2289] 10.222.0.59 () {60 vars in 1384 bytes} [Tue Oct 4 12:04:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 12:04:09.585888 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:04:10.471581 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:04:10.975166 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d647c2f-106d-480c-a790-c7ba4d93dfe9 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:04:11.018800 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:04:11.072959 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d647c2f-106d-480c-a790-c7ba4d93dfe9 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:04:11.077491 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c5a0a6-7aea-479e-81d1-3dc086e956e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:04:11.078914 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c5a0a6-7aea-479e-81d1-3dc086e956e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:04:11.079199 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c5a0a6-7aea-479e-81d1-3dc086e956e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:04:11.079477 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c5a0a6-7aea-479e-81d1-3dc086e956e9 admin admin] PATH_INFO: `/v3/users/24c1e15411394a06bb88ca1cfc0ec429` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:04:11.080657 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c5a0a6-7aea-479e-81d1-3dc086e956e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24c1e15411394a06bb88ca1cfc0ec429)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:04:11.082635 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c5a0a6-7aea-479e-81d1-3dc086e956e9 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:04:11.210341 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d854438a-9450-4c75-b9ef-87cb9715713d None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:04:11.214474 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d854438a-9450-4c75-b9ef-87cb9715713d None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:04:11.214474 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d854438a-9450-4c75-b9ef-87cb9715713d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:04:11.221115 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:04:11.233224 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-d854438a-9450-4c75-b9ef-87cb9715713d None None] MFA Rules not processed for user `06d1850ea27c483780eed67ede9cc1e3`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:04:11.234382 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-d854438a-9450-4c75-b9ef-87cb9715713d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:04:11.242635 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1142/2290] 10.222.0.59 () {58 vars in 1009 bytes} [Tue Oct 4 12:04:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 12:04:11.270570 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d854438a-9450-4c75-b9ef-87cb9715713d None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:04:11.287401 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d854438a-9450-4c75-b9ef-87cb9715713d None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:04:11.293602 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee08f126-5775-46bc-a299-5f5c01656740 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1605c3e03b7a4bcba4e19f0d92c671bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:04:11.294233 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee08f126-5775-46bc-a299-5f5c01656740 service swift] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:04:11.294517 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee08f126-5775-46bc-a299-5f5c01656740 service swift] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:04:11.294789 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee08f126-5775-46bc-a299-5f5c01656740 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:04:11.304399 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee08f126-5775-46bc-a299-5f5c01656740 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:04:11.306039 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee08f126-5775-46bc-a299-5f5c01656740 service swift] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:04:11.314311 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1143/2291] 10.222.0.59 () {60 vars in 1384 bytes} [Tue Oct 4 12:04:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 04 12:04:11.421211 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-95c5a0a6-7aea-479e-81d1-3dc086e956e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24c1e15411394a06bb88ca1cfc0ec429'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:04:11.440892 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-95c5a0a6-7aea-479e-81d1-3dc086e956e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24c1e15411394a06bb88ca1cfc0ec429'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:04:11.443500 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-95c5a0a6-7aea-479e-81d1-3dc086e956e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24c1e15411394a06bb88ca1cfc0ec429'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:04:11.445214 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-95c5a0a6-7aea-479e-81d1-3dc086e956e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24c1e15411394a06bb88ca1cfc0ec429'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:04:11.579808 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-95c5a0a6-7aea-479e-81d1-3dc086e956e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24c1e15411394a06bb88ca1cfc0ec429'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:04:11.621917 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1149/2292] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Oct 4 12:04:10 2022] DELETE /identity/v3/users/24c1e15411394a06bb88ca1cfc0ec429 => generated 0 bytes in 646 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:04:11.748496 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da82811-385b-443a-9c6b-f09e92604ff9 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:04:11.749504 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da82811-385b-443a-9c6b-f09e92604ff9 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:04:11.750535 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da82811-385b-443a-9c6b-f09e92604ff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:04:11.811323 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-6da82811-385b-443a-9c6b-f09e92604ff9 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:04:11.814754 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-6da82811-385b-443a-9c6b-f09e92604ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:04:11.936785 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1144/2293] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:04:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:04:11.943482 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c5a0a6-7aea-479e-81d1-3dc086e956e9 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:04:11.945044 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-95c5a0a6-7aea-479e-81d1-3dc086e956e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:04:12.091673 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c5a0a6-7aea-479e-81d1-3dc086e956e9 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:04:12.114890 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ae2b8e-caf5-4363-9235-87b0f91529c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7289515c5c44914a19daa439de98cb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:04:12.116514 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ae2b8e-caf5-4363-9235-87b0f91529c2 service neutron] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:04:12.117408 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ae2b8e-caf5-4363-9235-87b0f91529c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:04:12.118384 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ae2b8e-caf5-4363-9235-87b0f91529c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:04:12.157649 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ae2b8e-caf5-4363-9235-87b0f91529c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:04:12.159821 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ae2b8e-caf5-4363-9235-87b0f91529c2 service neutron] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:04:12.179877 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1150/2294] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:04:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:04:12.925053 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da82811-385b-443a-9c6b-f09e92604ff9 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:04:12.936990 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-6da82811-385b-443a-9c6b-f09e92604ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:04:12.965381 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da82811-385b-443a-9c6b-f09e92604ff9 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:04:12.971491 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0e9c00-59ed-480f-a2de-97d0152e5289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:04:12.973575 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0e9c00-59ed-480f-a2de-97d0152e5289 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:04:12.974216 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0e9c00-59ed-480f-a2de-97d0152e5289 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:04:12.974952 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0e9c00-59ed-480f-a2de-97d0152e5289 admin admin] PATH_INFO: `/v3/projects/f6ca0cbd93e94e78b6b49483946e9832` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:04:12.977140 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0e9c00-59ed-480f-a2de-97d0152e5289 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6ca0cbd93e94e78b6b49483946e9832)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:04:12.980543 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0e9c00-59ed-480f-a2de-97d0152e5289 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:04:13.265753 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-2d0e9c00-59ed-480f-a2de-97d0152e5289 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6ca0cbd93e94e78b6b49483946e9832', 'request_id': 'req-2d0e9c00-59ed-480f-a2de-97d0152e5289'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:04:13.286335 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-2d0e9c00-59ed-480f-a2de-97d0152e5289 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6ca0cbd93e94e78b6b49483946e9832', 'request_id': 'req-2d0e9c00-59ed-480f-a2de-97d0152e5289'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:04:13.477848 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-2d0e9c00-59ed-480f-a2de-97d0152e5289 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6ca0cbd93e94e78b6b49483946e9832', 'request_id': 'req-2d0e9c00-59ed-480f-a2de-97d0152e5289'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:04:13.498921 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-2d0e9c00-59ed-480f-a2de-97d0152e5289 admin admin] The token cache is being invalidate because project f6ca0cbd93e94e78b6b49483946e9832 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:04:13.499216 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-2d0e9c00-59ed-480f-a2de-97d0152e5289 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:04:13.501712 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-2d0e9c00-59ed-480f-a2de-97d0152e5289 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:04:13.505210 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1145/2295] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Oct 4 12:04:12 2022] DELETE /identity/v3/projects/f6ca0cbd93e94e78b6b49483946e9832 => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:04:13.510283 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c88a03-4650-4246-949d-648142af2d41 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:04:13.510735 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c88a03-4650-4246-949d-648142af2d41 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:04:13.511030 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c88a03-4650-4246-949d-648142af2d41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:04:13.538789 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-22c88a03-4650-4246-949d-648142af2d41 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:04:13.540308 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-22c88a03-4650-4246-949d-648142af2d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:04:13.609056 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1151/2296] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:04:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:04:13.618117 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d3022b-8164-4bf6-82fe-6d3db9c7fe3c None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:04:13.618719 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d3022b-8164-4bf6-82fe-6d3db9c7fe3c None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:04:13.620112 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d3022b-8164-4bf6-82fe-6d3db9c7fe3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:04:13.651654 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-77d3022b-8164-4bf6-82fe-6d3db9c7fe3c None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:04:13.654244 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-77d3022b-8164-4bf6-82fe-6d3db9c7fe3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:04:13.670852 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1146/2297] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:04:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 12:04:13.674921 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c88a03-4650-4246-949d-648142af2d41 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:04:13.686055 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c88a03-4650-4246-949d-648142af2d41 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:04:13.690932 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e7db39-bff5-4a1f-a92e-29f8a7d08066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:04:13.691549 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e7db39-bff5-4a1f-a92e-29f8a7d08066 admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:04:13.691832 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e7db39-bff5-4a1f-a92e-29f8a7d08066 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:04:13.692109 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e7db39-bff5-4a1f-a92e-29f8a7d08066 admin admin] PATH_INFO: `/v3/domains` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:04:13.692888 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e7db39-bff5-4a1f-a92e-29f8a7d08066 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:04:13.695276 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e7db39-bff5-4a1f-a92e-29f8a7d08066 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:04:13.697157 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e7db39-bff5-4a1f-a92e-29f8a7d08066 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:04:13.716825 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d3022b-8164-4bf6-82fe-6d3db9c7fe3c None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:04:13.724244 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1152/2298] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Oct 4 12:04:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:04:13.730114 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d3022b-8164-4bf6-82fe-6d3db9c7fe3c None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:04:13.736476 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010b1a45-993a-48e1-9044-5fbf9b3a6cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:04:13.737420 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010b1a45-993a-48e1-9044-5fbf9b3a6cbf admin admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:04:13.737572 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010b1a45-993a-48e1-9044-5fbf9b3a6cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:04:13.737828 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010b1a45-993a-48e1-9044-5fbf9b3a6cbf admin admin] PATH_INFO: `/v3/projects` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:04:13.738436 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010b1a45-993a-48e1-9044-5fbf9b3a6cbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:04:13.741193 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010b1a45-993a-48e1-9044-5fbf9b3a6cbf admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:04:13.900015 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1147/2299] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Oct 4 12:04:13 2022] POST /identity/v3/projects => generated 375 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:04:13.909280 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e7db39-bff5-4a1f-a92e-29f8a7d08066 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:04:13.919733 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e7db39-bff5-4a1f-a92e-29f8a7d08066 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:04:14.025361 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e98b30-5c23-4a8b-84ff-6c776c9ff7fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:04:14.026478 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e98b30-5c23-4a8b-84ff-6c776c9ff7fc admin admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:04:14.026798 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e98b30-5c23-4a8b-84ff-6c776c9ff7fc admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:04:14.027078 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e98b30-5c23-4a8b-84ff-6c776c9ff7fc admin admin] PATH_INFO: `/v3/users` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:04:14.027757 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e98b30-5c23-4a8b-84ff-6c776c9ff7fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:04:14.029829 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e98b30-5c23-4a8b-84ff-6c776c9ff7fc admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:04:14.457380 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1153/2300] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Oct 4 12:04:13 2022] POST /identity/v3/users => generated 288 bytes in 548 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:04:14.462231 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010b1a45-993a-48e1-9044-5fbf9b3a6cbf admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:04:14.476145 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010b1a45-993a-48e1-9044-5fbf9b3a6cbf admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:04:14.487364 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9609ff0a-fa14-4aee-a1a0-4ead00812bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:04:14.490341 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9609ff0a-fa14-4aee-a1a0-4ead00812bfe admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:04:14.490858 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9609ff0a-fa14-4aee-a1a0-4ead00812bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:04:14.491294 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9609ff0a-fa14-4aee-a1a0-4ead00812bfe admin admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:04:14.496380 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9609ff0a-fa14-4aee-a1a0-4ead00812bfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:04:14.500388 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9609ff0a-fa14-4aee-a1a0-4ead00812bfe admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:04:14.534244 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1148/2301] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:04:14 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:04:14.543494 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e98b30-5c23-4a8b-84ff-6c776c9ff7fc admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:04:14.569956 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e98b30-5c23-4a8b-84ff-6c776c9ff7fc admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:04:14.587797 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48afda42-e728-4111-b223-eaab072f9c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:04:14.589022 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48afda42-e728-4111-b223-eaab072f9c75 admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:04:14.589479 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48afda42-e728-4111-b223-eaab072f9c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:04:14.589850 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48afda42-e728-4111-b223-eaab072f9c75 admin admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:04:14.590838 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48afda42-e728-4111-b223-eaab072f9c75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:04:14.593817 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48afda42-e728-4111-b223-eaab072f9c75 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:04:14.607614 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:04:14.619242 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1154/2302] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:04:14 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 12:04:14.626346 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9609ff0a-fa14-4aee-a1a0-4ead00812bfe admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:04:14.644084 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9609ff0a-fa14-4aee-a1a0-4ead00812bfe admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:04:14.693845 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c0409f-baa6-4396-b805-b578d5e04469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:04:14.695392 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c0409f-baa6-4396-b805-b578d5e04469 admin admin] REQUEST_METHOD: `PUT` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:04:14.695687 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c0409f-baa6-4396-b805-b578d5e04469 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:04:14.696734 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c0409f-baa6-4396-b805-b578d5e04469 admin admin] PATH_INFO: `/v3/projects/6b8316789dcd4a4783a080ec22dab6f4/users/5bfa73935ed24d24a2c0cd8053adae13/roles/ab4307f3b7994c1c80036fa7db93b6b9` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:04:14.725478 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c0409f-baa6-4396-b805-b578d5e04469 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b8316789dcd4a4783a080ec22dab6f4, user_id=5bfa73935ed24d24a2c0cd8053adae13, role_id=ab4307f3b7994c1c80036fa7db93b6b9)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:04:14.728146 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c0409f-baa6-4396-b805-b578d5e04469 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:04:14.922776 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1149/2303] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Oct 4 12:04:14 2022] PUT /identity/v3/projects/6b8316789dcd4a4783a080ec22dab6f4/users/5bfa73935ed24d24a2c0cd8053adae13/roles/ab4307f3b7994c1c80036fa7db93b6b9 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:04:14.936692 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2030f9-4724-4bcb-a380-3cb9aea2c7ff None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:04:14.937081 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2030f9-4724-4bcb-a380-3cb9aea2c7ff None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:04:14.937430 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2030f9-4724-4bcb-a380-3cb9aea2c7ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:04:14.978220 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-bd2030f9-4724-4bcb-a380-3cb9aea2c7ff None None] MFA Rules not processed for user `5bfa73935ed24d24a2c0cd8053adae13`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:04:14.979636 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-bd2030f9-4724-4bcb-a380-3cb9aea2c7ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:04:14.993269 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:04:15.095929 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1155/2304] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:04:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:04:15.114318 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c0409f-baa6-4396-b805-b578d5e04469 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:04:15.118641 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-46c0409f-baa6-4396-b805-b578d5e04469 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:04:15.247639 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c0409f-baa6-4396-b805-b578d5e04469 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:04:15.257579 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c0fb8b-d848-4fa7-85a6-c09b6b514a4a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e2a05b782424ab2928b5864f1bfd556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:04:15.258245 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c0fb8b-d848-4fa7-85a6-c09b6b514a4a service cinder] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:04:15.258527 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c0fb8b-d848-4fa7-85a6-c09b6b514a4a service cinder] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:04:15.260053 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c0fb8b-d848-4fa7-85a6-c09b6b514a4a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:04:15.287709 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c0fb8b-d848-4fa7-85a6-c09b6b514a4a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:04:15.289337 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c0fb8b-d848-4fa7-85a6-c09b6b514a4a service cinder] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:04:15.316920 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1150/2305] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:04:15 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:04:17.197500 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:04:19.213039 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:04:19.603558 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:04:22.843019 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2030f9-4724-4bcb-a380-3cb9aea2c7ff None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:04:22.845339 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-bd2030f9-4724-4bcb-a380-3cb9aea2c7ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:04:22.937599 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2030f9-4724-4bcb-a380-3cb9aea2c7ff None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:04:22.944936 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9eb755a-2723-4505-bc0d-b47390a285d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:04:22.945713 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eb755a-2723-4505-bc0d-b47390a285d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:04:22.946062 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eb755a-2723-4505-bc0d-b47390a285d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:04:22.946565 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eb755a-2723-4505-bc0d-b47390a285d7 admin admin] PATH_INFO: `/v3/users/1bcacf5a31a34dc7a0a9ee97c5692cfd` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:04:22.948376 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9eb755a-2723-4505-bc0d-b47390a285d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1bcacf5a31a34dc7a0a9ee97c5692cfd)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:04:22.963114 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9eb755a-2723-4505-bc0d-b47390a285d7 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:04:23.496266 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-e9eb755a-2723-4505-bc0d-b47390a285d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1bcacf5a31a34dc7a0a9ee97c5692cfd'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:04:23.503186 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c0fb8b-d848-4fa7-85a6-c09b6b514a4a service cinder] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:04:23.510631 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-e9eb755a-2723-4505-bc0d-b47390a285d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1bcacf5a31a34dc7a0a9ee97c5692cfd'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:04:23.513998 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-e9eb755a-2723-4505-bc0d-b47390a285d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1bcacf5a31a34dc7a0a9ee97c5692cfd'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:04:23.515555 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-e9eb755a-2723-4505-bc0d-b47390a285d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1bcacf5a31a34dc7a0a9ee97c5692cfd'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:04:23.523400 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c0fb8b-d848-4fa7-85a6-c09b6b514a4a service cinder] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:04:23.529253 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5472020-bb94-4643-8679-5608ecdb5720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:04:23.531880 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5472020-bb94-4643-8679-5608ecdb5720 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:04:23.532754 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5472020-bb94-4643-8679-5608ecdb5720 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:04:23.533400 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5472020-bb94-4643-8679-5608ecdb5720 admin admin] PATH_INFO: `/v3/users/5bfa73935ed24d24a2c0cd8053adae13` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:04:23.535546 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5472020-bb94-4643-8679-5608ecdb5720 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bfa73935ed24d24a2c0cd8053adae13)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:04:23.538702 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5472020-bb94-4643-8679-5608ecdb5720 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:04:23.653785 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-e9eb755a-2723-4505-bc0d-b47390a285d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1bcacf5a31a34dc7a0a9ee97c5692cfd'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:04:23.682329 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1156/2306] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Oct 4 12:04:22 2022] DELETE /identity/v3/users/1bcacf5a31a34dc7a0a9ee97c5692cfd => generated 0 bytes in 840 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:04:23.688292 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bab5acb-e335-4f36-ad17-d9cc850edcd2 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:04:23.688686 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bab5acb-e335-4f36-ad17-d9cc850edcd2 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:04:23.689049 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bab5acb-e335-4f36-ad17-d9cc850edcd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:04:23.713136 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-3bab5acb-e335-4f36-ad17-d9cc850edcd2 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:04:23.714445 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-3bab5acb-e335-4f36-ad17-d9cc850edcd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:04:23.787387 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1157/2307] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:04:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 12:04:23.797416 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bab5acb-e335-4f36-ad17-d9cc850edcd2 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:04:23.798831 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-3bab5acb-e335-4f36-ad17-d9cc850edcd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:04:23.870979 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bab5acb-e335-4f36-ad17-d9cc850edcd2 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:04:23.873994 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcebe05-5973-4284-9eca-9c39dc3cf3fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7289515c5c44914a19daa439de98cb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:04:23.874797 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcebe05-5973-4284-9eca-9c39dc3cf3fb service neutron] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:04:23.875084 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcebe05-5973-4284-9eca-9c39dc3cf3fb service neutron] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:04:23.875388 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcebe05-5973-4284-9eca-9c39dc3cf3fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:04:23.886174 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcebe05-5973-4284-9eca-9c39dc3cf3fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:04:23.890512 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcebe05-5973-4284-9eca-9c39dc3cf3fb service neutron] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:04:23.900484 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1158/2308] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:04:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 12:04:23.943433 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-c5472020-bb94-4643-8679-5608ecdb5720 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bfa73935ed24d24a2c0cd8053adae13'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:04:23.958236 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-c5472020-bb94-4643-8679-5608ecdb5720 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bfa73935ed24d24a2c0cd8053adae13'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:04:23.960966 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-c5472020-bb94-4643-8679-5608ecdb5720 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bfa73935ed24d24a2c0cd8053adae13'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:04:23.964968 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-c5472020-bb94-4643-8679-5608ecdb5720 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bfa73935ed24d24a2c0cd8053adae13'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:04:24.203080 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-c5472020-bb94-4643-8679-5608ecdb5720 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bfa73935ed24d24a2c0cd8053adae13'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:04:24.232089 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1151/2309] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Oct 4 12:04:23 2022] DELETE /identity/v3/users/5bfa73935ed24d24a2c0cd8053adae13 => generated 0 bytes in 729 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:04:24.238072 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55b7608-48d0-4920-9a72-9250529efdb4 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:04:24.238508 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55b7608-48d0-4920-9a72-9250529efdb4 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:04:24.238873 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55b7608-48d0-4920-9a72-9250529efdb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:04:24.263131 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-d55b7608-48d0-4920-9a72-9250529efdb4 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:04:24.264518 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-d55b7608-48d0-4920-9a72-9250529efdb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:04:24.358020 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1159/2310] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:04:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:04:24.378688 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5472020-bb94-4643-8679-5608ecdb5720 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:04:24.381514 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-c5472020-bb94-4643-8679-5608ecdb5720 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:04:24.490308 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5472020-bb94-4643-8679-5608ecdb5720 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:04:24.500960 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74728246-a65b-40b5-abdf-6d0410123521 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7289515c5c44914a19daa439de98cb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:04:24.501615 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74728246-a65b-40b5-abdf-6d0410123521 service neutron] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:04:24.502099 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74728246-a65b-40b5-abdf-6d0410123521 service neutron] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:04:24.502386 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74728246-a65b-40b5-abdf-6d0410123521 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:04:24.521745 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74728246-a65b-40b5-abdf-6d0410123521 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:04:24.524464 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74728246-a65b-40b5-abdf-6d0410123521 service neutron] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:04:24.538200 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1152/2311] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:04:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:04:24.597680 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:04:24.651079 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55b7608-48d0-4920-9a72-9250529efdb4 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:04:24.653795 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-d55b7608-48d0-4920-9a72-9250529efdb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:04:24.678863 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55b7608-48d0-4920-9a72-9250529efdb4 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:04:24.713246 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524d810d-3ec8-42c3-8a35-71772db86bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:04:24.715409 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524d810d-3ec8-42c3-8a35-71772db86bad admin admin] REQUEST_METHOD: `DELETE` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:04:24.716109 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524d810d-3ec8-42c3-8a35-71772db86bad admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:04:24.717682 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524d810d-3ec8-42c3-8a35-71772db86bad admin admin] PATH_INFO: `/v3/projects/f69230efd4f542a1ad224e398281099c` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:04:24.732227 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524d810d-3ec8-42c3-8a35-71772db86bad admin admin] RBAC: Authorizing `identity:delete_project(project_id=f69230efd4f542a1ad224e398281099c)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:04:24.740323 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524d810d-3ec8-42c3-8a35-71772db86bad admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:04:24.814397 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:04:25.155292 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-524d810d-3ec8-42c3-8a35-71772db86bad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f69230efd4f542a1ad224e398281099c', 'request_id': 'req-524d810d-3ec8-42c3-8a35-71772db86bad'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:04:25.424724 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-524d810d-3ec8-42c3-8a35-71772db86bad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f69230efd4f542a1ad224e398281099c', 'request_id': 'req-524d810d-3ec8-42c3-8a35-71772db86bad'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:04:25.433533 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-524d810d-3ec8-42c3-8a35-71772db86bad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f69230efd4f542a1ad224e398281099c', 'request_id': 'req-524d810d-3ec8-42c3-8a35-71772db86bad'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:04:25.447936 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-524d810d-3ec8-42c3-8a35-71772db86bad admin admin] The token cache is being invalidate because project f69230efd4f542a1ad224e398281099c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:04:25.448374 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-524d810d-3ec8-42c3-8a35-71772db86bad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:04:25.449212 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-524d810d-3ec8-42c3-8a35-71772db86bad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:04:25.456482 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1160/2312] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Oct 4 12:04:24 2022] DELETE /identity/v3/projects/f69230efd4f542a1ad224e398281099c => generated 0 bytes in 801 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:04:25.457392 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cbbe6a-ddab-4fbc-b369-fedbd83736bb None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:04:25.457743 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cbbe6a-ddab-4fbc-b369-fedbd83736bb None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:04:25.458104 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cbbe6a-ddab-4fbc-b369-fedbd83736bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:04:25.468946 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524d810d-3ec8-42c3-8a35-71772db86bad admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:04:25.471454 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-524d810d-3ec8-42c3-8a35-71772db86bad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:04:25.494224 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-e8cbbe6a-ddab-4fbc-b369-fedbd83736bb None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:04:25.495736 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-e8cbbe6a-ddab-4fbc-b369-fedbd83736bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:04:25.604919 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524d810d-3ec8-42c3-8a35-71772db86bad admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:04:25.613794 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c645b7a-1b9c-424d-8d5e-a4c592541f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:04:25.614463 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c645b7a-1b9c-424d-8d5e-a4c592541f1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:04:25.614745 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c645b7a-1b9c-424d-8d5e-a4c592541f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:04:25.615017 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c645b7a-1b9c-424d-8d5e-a4c592541f1c admin admin] PATH_INFO: `/v3/projects/6b8316789dcd4a4783a080ec22dab6f4` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:04:25.616224 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c645b7a-1b9c-424d-8d5e-a4c592541f1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b8316789dcd4a4783a080ec22dab6f4)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:04:25.618540 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c645b7a-1b9c-424d-8d5e-a4c592541f1c admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:04:25.639178 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1153/2313] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:04:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 12:04:25.649994 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1c040d-2b92-4e0b-a356-3ccbd669f0f3 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:04:25.650553 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1c040d-2b92-4e0b-a356-3ccbd669f0f3 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:04:25.651319 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1c040d-2b92-4e0b-a356-3ccbd669f0f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:04:25.680855 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-ee1c040d-2b92-4e0b-a356-3ccbd669f0f3 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:04:25.682561 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-ee1c040d-2b92-4e0b-a356-3ccbd669f0f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:04:25.699751 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1154/2314] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:04:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 12:04:25.704301 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1c040d-2b92-4e0b-a356-3ccbd669f0f3 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:04:25.714357 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1c040d-2b92-4e0b-a356-3ccbd669f0f3 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:04:25.729626 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c09c663-ec33-4772-b788-7944a567890b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:04:25.730537 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c09c663-ec33-4772-b788-7944a567890b admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:04:25.730988 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c09c663-ec33-4772-b788-7944a567890b admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:04:25.731417 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c09c663-ec33-4772-b788-7944a567890b admin admin] PATH_INFO: `/v3/domains` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:04:25.732227 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c09c663-ec33-4772-b788-7944a567890b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:04:25.732968 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c09c663-ec33-4772-b788-7944a567890b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:04:25.734929 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c09c663-ec33-4772-b788-7944a567890b admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:04:25.755301 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1155/2315] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Oct 4 12:04:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 12:04:25.757649 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c09c663-ec33-4772-b788-7944a567890b admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:04:25.774373 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c09c663-ec33-4772-b788-7944a567890b admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:04:25.779555 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab937951-2b12-40ef-89a3-25a4f69ccd96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:04:25.792765 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab937951-2b12-40ef-89a3-25a4f69ccd96 admin admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:04:25.792765 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab937951-2b12-40ef-89a3-25a4f69ccd96 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:04:25.792765 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab937951-2b12-40ef-89a3-25a4f69ccd96 admin admin] PATH_INFO: `/v3/projects` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:04:25.792765 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab937951-2b12-40ef-89a3-25a4f69ccd96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:04:25.792765 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab937951-2b12-40ef-89a3-25a4f69ccd96 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:04:25.948994 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-9c645b7a-1b9c-424d-8d5e-a4c592541f1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b8316789dcd4a4783a080ec22dab6f4', 'request_id': 'req-9c645b7a-1b9c-424d-8d5e-a4c592541f1c'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:04:25.962997 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1156/2316] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Oct 4 12:04:25 2022] POST /identity/v3/projects => generated 391 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:04:25.967280 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab937951-2b12-40ef-89a3-25a4f69ccd96 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:04:26.066454 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-9c645b7a-1b9c-424d-8d5e-a4c592541f1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b8316789dcd4a4783a080ec22dab6f4', 'request_id': 'req-9c645b7a-1b9c-424d-8d5e-a4c592541f1c'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:04:26.081312 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-9c645b7a-1b9c-424d-8d5e-a4c592541f1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b8316789dcd4a4783a080ec22dab6f4', 'request_id': 'req-9c645b7a-1b9c-424d-8d5e-a4c592541f1c'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:04:26.084045 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab937951-2b12-40ef-89a3-25a4f69ccd96 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:04:26.096883 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae7d021-8487-462c-8a74-be12445ef533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:04:26.099357 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae7d021-8487-462c-8a74-be12445ef533 admin admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:04:26.099834 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae7d021-8487-462c-8a74-be12445ef533 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:04:26.100037 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-9c645b7a-1b9c-424d-8d5e-a4c592541f1c admin admin] The token cache is being invalidate because project 6b8316789dcd4a4783a080ec22dab6f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:04:26.100241 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-9c645b7a-1b9c-424d-8d5e-a4c592541f1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:04:26.101296 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae7d021-8487-462c-8a74-be12445ef533 admin admin] PATH_INFO: `/v3/users` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:04:26.101771 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-9c645b7a-1b9c-424d-8d5e-a4c592541f1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:04:26.102779 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae7d021-8487-462c-8a74-be12445ef533 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:04:26.104576 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1161/2317] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Oct 4 12:04:25 2022] DELETE /identity/v3/projects/6b8316789dcd4a4783a080ec22dab6f4 => generated 0 bytes in 636 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:04:26.109503 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae7d021-8487-462c-8a74-be12445ef533 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:04:26.110152 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52981a9c-0085-4929-b174-86c38b1101a4 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:04:26.110508 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52981a9c-0085-4929-b174-86c38b1101a4 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:04:26.111151 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52981a9c-0085-4929-b174-86c38b1101a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:04:26.143034 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-52981a9c-0085-4929-b174-86c38b1101a4 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:04:26.151747 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-52981a9c-0085-4929-b174-86c38b1101a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:04:26.161315 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1162/2318] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:04:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:04:26.170142 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58600e2-4a4f-45ef-ae1c-dda767c72852 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:04:26.170702 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58600e2-4a4f-45ef-ae1c-dda767c72852 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:04:26.171356 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58600e2-4a4f-45ef-ae1c-dda767c72852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:04:26.198568 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-a58600e2-4a4f-45ef-ae1c-dda767c72852 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:04:26.199795 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-a58600e2-4a4f-45ef-ae1c-dda767c72852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:04:26.210106 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1163/2319] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:04:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:04:26.216856 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58600e2-4a4f-45ef-ae1c-dda767c72852 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:04:26.267481 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58600e2-4a4f-45ef-ae1c-dda767c72852 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:04:26.277786 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50d2ac0-ee9e-435e-89c0-a09ebfa0d907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:04:26.278514 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50d2ac0-ee9e-435e-89c0-a09ebfa0d907 admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:04:26.278920 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50d2ac0-ee9e-435e-89c0-a09ebfa0d907 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:04:26.279284 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50d2ac0-ee9e-435e-89c0-a09ebfa0d907 admin admin] PATH_INFO: `/v3/domains` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:04:26.280062 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50d2ac0-ee9e-435e-89c0-a09ebfa0d907 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:04:26.281047 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50d2ac0-ee9e-435e-89c0-a09ebfa0d907 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:04:26.282940 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50d2ac0-ee9e-435e-89c0-a09ebfa0d907 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:04:26.293024 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1157/2320] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Oct 4 12:04:25 2022] POST /identity/v3/users => generated 296 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:04:26.297754 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae7d021-8487-462c-8a74-be12445ef533 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:04:26.300805 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-8ae7d021-8487-462c-8a74-be12445ef533 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:04:26.301711 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1164/2321] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Oct 4 12:04:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:04:26.306485 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50d2ac0-ee9e-435e-89c0-a09ebfa0d907 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:04:26.318008 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50d2ac0-ee9e-435e-89c0-a09ebfa0d907 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:04:26.323101 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd696b9-a483-463e-9d80-8f3cabf00141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:04:26.323840 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd696b9-a483-463e-9d80-8f3cabf00141 admin admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:04:26.324218 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd696b9-a483-463e-9d80-8f3cabf00141 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:04:26.324508 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae7d021-8487-462c-8a74-be12445ef533 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:04:26.324713 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd696b9-a483-463e-9d80-8f3cabf00141 admin admin] PATH_INFO: `/v3/projects` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:04:26.325593 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd696b9-a483-463e-9d80-8f3cabf00141 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:04:26.327924 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd696b9-a483-463e-9d80-8f3cabf00141 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:04:26.332919 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bb1257-a8fb-4a69-ab29-5fdef2cae33d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:04:26.334410 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bb1257-a8fb-4a69-ab29-5fdef2cae33d admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:04:26.334686 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bb1257-a8fb-4a69-ab29-5fdef2cae33d admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:04:26.334947 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bb1257-a8fb-4a69-ab29-5fdef2cae33d admin admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:04:26.337441 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bb1257-a8fb-4a69-ab29-5fdef2cae33d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:04:26.339762 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bb1257-a8fb-4a69-ab29-5fdef2cae33d admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:04:26.387827 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1158/2322] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:04:26 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:04:26.394125 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bb1257-a8fb-4a69-ab29-5fdef2cae33d admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:04:26.409427 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bb1257-a8fb-4a69-ab29-5fdef2cae33d admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:04:26.432624 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf988a1-162e-4c24-a8ec-487614fb229b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:04:26.433441 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf988a1-162e-4c24-a8ec-487614fb229b admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:04:26.434234 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf988a1-162e-4c24-a8ec-487614fb229b admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:04:26.434630 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf988a1-162e-4c24-a8ec-487614fb229b admin admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:04:26.435761 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf988a1-162e-4c24-a8ec-487614fb229b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:04:26.439986 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf988a1-162e-4c24-a8ec-487614fb229b admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:04:26.457986 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1159/2323] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:04:26 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:04:26.462764 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf988a1-162e-4c24-a8ec-487614fb229b admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:04:26.480372 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf988a1-162e-4c24-a8ec-487614fb229b admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:04:26.486664 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff65ce9-5730-4b60-9818-e3de183f1ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:04:26.487601 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff65ce9-5730-4b60-9818-e3de183f1ed2 admin admin] REQUEST_METHOD: `PUT` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:04:26.488053 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff65ce9-5730-4b60-9818-e3de183f1ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:04:26.488487 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff65ce9-5730-4b60-9818-e3de183f1ed2 admin admin] PATH_INFO: `/v3/projects/b434e19874aa4b549d8999178ff979dd/users/ee880e96177a4d5ab348a632f89f69c4/roles/ab4307f3b7994c1c80036fa7db93b6b9` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:04:26.524278 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1165/2324] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Oct 4 12:04:26 2022] POST /identity/v3/projects => generated 383 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 12:04:26.529924 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd696b9-a483-463e-9d80-8f3cabf00141 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:04:26.541100 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff65ce9-5730-4b60-9818-e3de183f1ed2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b434e19874aa4b549d8999178ff979dd, user_id=ee880e96177a4d5ab348a632f89f69c4, role_id=ab4307f3b7994c1c80036fa7db93b6b9)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:04:26.544894 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff65ce9-5730-4b60-9818-e3de183f1ed2 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:04:26.654032 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1160/2325] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Oct 4 12:04:26 2022] PUT /identity/v3/projects/b434e19874aa4b549d8999178ff979dd/users/ee880e96177a4d5ab348a632f89f69c4/roles/ab4307f3b7994c1c80036fa7db93b6b9 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:04:26.658396 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd696b9-a483-463e-9d80-8f3cabf00141 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:04:26.730669 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1d15e9-fcec-4063-ae34-07c496e1915b None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:04:26.731223 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1d15e9-fcec-4063-ae34-07c496e1915b None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:04:26.731608 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1d15e9-fcec-4063-ae34-07c496e1915b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:04:26.805773 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-2f1d15e9-fcec-4063-ae34-07c496e1915b None None] MFA Rules not processed for user `ee880e96177a4d5ab348a632f89f69c4`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:04:26.807869 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-2f1d15e9-fcec-4063-ae34-07c496e1915b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:04:26.818382 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecac895-8aba-4238-9f6b-52f1727ae8a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:04:26.819105 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecac895-8aba-4238-9f6b-52f1727ae8a1 admin admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:04:26.819446 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecac895-8aba-4238-9f6b-52f1727ae8a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:04:26.819773 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecac895-8aba-4238-9f6b-52f1727ae8a1 admin admin] PATH_INFO: `/v3/users` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:04:26.820653 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecac895-8aba-4238-9f6b-52f1727ae8a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:04:26.825125 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecac895-8aba-4238-9f6b-52f1727ae8a1 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:04:26.894119 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1161/2326] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:04:26 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:04:26.907044 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1d15e9-fcec-4063-ae34-07c496e1915b None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:04:26.907391 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-2f1d15e9-fcec-4063-ae34-07c496e1915b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:04:26.969815 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1166/2327] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Oct 4 12:04:26 2022] POST /identity/v3/users => generated 292 bytes in 439 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:04:26.973870 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecac895-8aba-4238-9f6b-52f1727ae8a1 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:04:26.989533 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1d15e9-fcec-4063-ae34-07c496e1915b None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:04:26.993367 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acb77ee-68e9-4ae0-bbce-5175410a2378 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e2a05b782424ab2928b5864f1bfd556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:04:26.994005 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acb77ee-68e9-4ae0-bbce-5175410a2378 service cinder] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:04:26.994421 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acb77ee-68e9-4ae0-bbce-5175410a2378 service cinder] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:04:26.994705 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acb77ee-68e9-4ae0-bbce-5175410a2378 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:04:27.011422 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acb77ee-68e9-4ae0-bbce-5175410a2378 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:04:27.012664 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecac895-8aba-4238-9f6b-52f1727ae8a1 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:04:27.018534 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acb77ee-68e9-4ae0-bbce-5175410a2378 service cinder] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:04:27.026125 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e412551b-c486-4a06-8df9-dd396c213bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:04:27.027609 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e412551b-c486-4a06-8df9-dd396c213bd3 admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:04:27.029183 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e412551b-c486-4a06-8df9-dd396c213bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:04:27.029671 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e412551b-c486-4a06-8df9-dd396c213bd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:04:27.031920 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e412551b-c486-4a06-8df9-dd396c213bd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:04:27.034074 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1162/2328] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:04:26 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:04:27.034318 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e412551b-c486-4a06-8df9-dd396c213bd3 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:04:27.052578 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1167/2329] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:04:26 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 12:04:27.054011 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acb77ee-68e9-4ae0-bbce-5175410a2378 service cinder] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:04:27.079016 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acb77ee-68e9-4ae0-bbce-5175410a2378 service cinder] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:04:27.086590 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b75a3d6-ef5b-418d-845d-2fb316635fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:04:27.086985 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b75a3d6-ef5b-418d-845d-2fb316635fa1 admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:04:27.087238 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b75a3d6-ef5b-418d-845d-2fb316635fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:04:27.087509 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b75a3d6-ef5b-418d-845d-2fb316635fa1 admin admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:04:27.088159 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b75a3d6-ef5b-418d-845d-2fb316635fa1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:04:27.091562 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b75a3d6-ef5b-418d-845d-2fb316635fa1 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:04:27.112520 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e412551b-c486-4a06-8df9-dd396c213bd3 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:04:27.113598 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1163/2330] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:04:27 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 12:04:27.123083 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e412551b-c486-4a06-8df9-dd396c213bd3 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:04:27.130179 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8c8409-a2f7-40c6-940c-b4f6f91b254b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:04:27.131134 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8c8409-a2f7-40c6-940c-b4f6f91b254b admin admin] REQUEST_METHOD: `PUT` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:04:27.131801 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8c8409-a2f7-40c6-940c-b4f6f91b254b admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:04:27.133924 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8c8409-a2f7-40c6-940c-b4f6f91b254b admin admin] PATH_INFO: `/v3/projects/e202415265a64e2eb6295962d2fb81e7/users/92bb1140da0340ff832a12a09f4818c8/roles/ab4307f3b7994c1c80036fa7db93b6b9` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:04:27.155886 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8c8409-a2f7-40c6-940c-b4f6f91b254b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e202415265a64e2eb6295962d2fb81e7, user_id=92bb1140da0340ff832a12a09f4818c8, role_id=ab4307f3b7994c1c80036fa7db93b6b9)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:04:27.159335 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8c8409-a2f7-40c6-940c-b4f6f91b254b admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:04:27.278940 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b460de-df78-4313-9161-382ce46502bb None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:04:27.281489 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b460de-df78-4313-9161-382ce46502bb None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:04:27.283306 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b460de-df78-4313-9161-382ce46502bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:04:27.297270 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1168/2331] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Oct 4 12:04:27 2022] PUT /identity/v3/projects/e202415265a64e2eb6295962d2fb81e7/users/92bb1140da0340ff832a12a09f4818c8/roles/ab4307f3b7994c1c80036fa7db93b6b9 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:04:27.367858 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-55b460de-df78-4313-9161-382ce46502bb None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:04:27.371742 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-55b460de-df78-4313-9161-382ce46502bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:04:27.555497 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1164/2332] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:04:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:04:27.567985 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8c8409-a2f7-40c6-940c-b4f6f91b254b admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:04:27.570235 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-dd8c8409-a2f7-40c6-940c-b4f6f91b254b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:04:27.704353 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8c8409-a2f7-40c6-940c-b4f6f91b254b admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:04:27.713805 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4999f17d-d7d4-4918-9c80-ee27eebe1a00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7289515c5c44914a19daa439de98cb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:04:27.714902 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4999f17d-d7d4-4918-9c80-ee27eebe1a00 service neutron] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:04:27.715656 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4999f17d-d7d4-4918-9c80-ee27eebe1a00 service neutron] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:04:27.716107 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4999f17d-d7d4-4918-9c80-ee27eebe1a00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:04:27.728398 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4999f17d-d7d4-4918-9c80-ee27eebe1a00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:04:27.729873 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4999f17d-d7d4-4918-9c80-ee27eebe1a00 service neutron] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:04:27.742557 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1169/2333] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:04:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:04:29.348027 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:04:29.459769 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:04:29.543446 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b633cf-de67-4d22-b7b9-852666f609d4 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:04:29.543737 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b633cf-de67-4d22-b7b9-852666f609d4 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:04:29.544022 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b633cf-de67-4d22-b7b9-852666f609d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:04:29.566533 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-f6b633cf-de67-4d22-b7b9-852666f609d4 None None] MFA Rules not processed for user `06d1850ea27c483780eed67ede9cc1e3`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:04:29.587284 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-f6b633cf-de67-4d22-b7b9-852666f609d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:04:29.636919 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1165/2334] 10.222.0.59 () {58 vars in 967 bytes} [Tue Oct 4 12:04:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:04:29.653436 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4999f17d-d7d4-4918-9c80-ee27eebe1a00 service neutron] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:04:29.656785 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-4999f17d-d7d4-4918-9c80-ee27eebe1a00 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:04:29.750010 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4999f17d-d7d4-4918-9c80-ee27eebe1a00 service neutron] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:04:29.789317 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce703a2-46c1-47eb-9a71-023dc4ddf9ff service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1605c3e03b7a4bcba4e19f0d92c671bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:04:29.792886 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce703a2-46c1-47eb-9a71-023dc4ddf9ff service swift] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:04:29.793340 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce703a2-46c1-47eb-9a71-023dc4ddf9ff service swift] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:04:29.794595 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce703a2-46c1-47eb-9a71-023dc4ddf9ff service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:04:29.805746 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce703a2-46c1-47eb-9a71-023dc4ddf9ff service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:04:29.809506 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce703a2-46c1-47eb-9a71-023dc4ddf9ff service swift] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:04:29.823435 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1170/2335] 10.222.0.59 () {60 vars in 1384 bytes} [Tue Oct 4 12:04:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 12:04:30.438255 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652a5722-5fc7-4775-ace0-a16f640c6226 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:04:30.438551 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652a5722-5fc7-4775-ace0-a16f640c6226 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:04:30.438834 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652a5722-5fc7-4775-ace0-a16f640c6226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:04:30.471721 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-652a5722-5fc7-4775-ace0-a16f640c6226 None None] MFA Rules not processed for user `92bb1140da0340ff832a12a09f4818c8`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:04:30.473664 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-652a5722-5fc7-4775-ace0-a16f640c6226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:04:30.591420 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1166/2336] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:04:30 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:04:30.604521 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce703a2-46c1-47eb-9a71-023dc4ddf9ff service swift] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:04:30.606037 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-1ce703a2-46c1-47eb-9a71-023dc4ddf9ff service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:04:30.641585 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652a5722-5fc7-4775-ace0-a16f640c6226 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:04:30.644270 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-652a5722-5fc7-4775-ace0-a16f640c6226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:04:30.670707 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce703a2-46c1-47eb-9a71-023dc4ddf9ff service swift] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:04:30.675040 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d058121-df28-48f6-9707-1f3b22b431ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e2a05b782424ab2928b5864f1bfd556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:04:30.675669 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d058121-df28-48f6-9707-1f3b22b431ac service cinder] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:04:30.675948 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d058121-df28-48f6-9707-1f3b22b431ac service cinder] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:04:30.676258 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d058121-df28-48f6-9707-1f3b22b431ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:04:30.688895 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d058121-df28-48f6-9707-1f3b22b431ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:04:30.690214 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d058121-df28-48f6-9707-1f3b22b431ac service cinder] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:04:30.707154 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1171/2337] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:04:30 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:04:30.733076 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652a5722-5fc7-4775-ace0-a16f640c6226 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:04:30.739639 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9527d4ef-492a-42ce-9f39-e1edc15ca6e1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be119968b02440adbbbc85c553077b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:04:30.740490 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9527d4ef-492a-42ce-9f39-e1edc15ca6e1 service placement] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:04:30.740960 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9527d4ef-492a-42ce-9f39-e1edc15ca6e1 service placement] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:04:30.741404 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9527d4ef-492a-42ce-9f39-e1edc15ca6e1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:04:30.744231 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-9527d4ef-492a-42ce-9f39-e1edc15ca6e1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:04:30.783868 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9527d4ef-492a-42ce-9f39-e1edc15ca6e1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:04:30.783868 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9527d4ef-492a-42ce-9f39-e1edc15ca6e1 service placement] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:04:30.807052 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1167/2338] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:04:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:04:31.496784 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fddd4a9-26ab-4daa-a79c-ddcd314a844e None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:04:31.497455 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fddd4a9-26ab-4daa-a79c-ddcd314a844e None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:04:31.497944 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fddd4a9-26ab-4daa-a79c-ddcd314a844e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:04:31.545647 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-2fddd4a9-26ab-4daa-a79c-ddcd314a844e None None] MFA Rules not processed for user `06d1850ea27c483780eed67ede9cc1e3`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:04:31.547119 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-2fddd4a9-26ab-4daa-a79c-ddcd314a844e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:04:31.556249 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1172/2339] 10.222.0.59 () {58 vars in 967 bytes} [Tue Oct 4 12:04:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:04:31.575805 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9527d4ef-492a-42ce-9f39-e1edc15ca6e1 service placement] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:04:31.590977 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9527d4ef-492a-42ce-9f39-e1edc15ca6e1 service placement] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:04:31.595514 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf407410-5eda-4a49-8160-158fecb5d044 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1605c3e03b7a4bcba4e19f0d92c671bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:04:31.611981 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf407410-5eda-4a49-8160-158fecb5d044 service swift] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:04:31.612414 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf407410-5eda-4a49-8160-158fecb5d044 service swift] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:04:31.613016 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf407410-5eda-4a49-8160-158fecb5d044 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:04:31.625054 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf407410-5eda-4a49-8160-158fecb5d044 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:04:31.627112 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf407410-5eda-4a49-8160-158fecb5d044 service swift] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:04:31.638206 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1168/2340] 10.222.0.59 () {60 vars in 1384 bytes} [Tue Oct 4 12:04:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 12:04:32.619561 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:04:33.160879 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edc3c88-c89a-4925-b52e-736032eee3f8 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:04:33.161426 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edc3c88-c89a-4925-b52e-736032eee3f8 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:04:33.161426 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edc3c88-c89a-4925-b52e-736032eee3f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:04:33.180015 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-5edc3c88-c89a-4925-b52e-736032eee3f8 None None] MFA Rules not processed for user `92bb1140da0340ff832a12a09f4818c8`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:04:33.181422 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-5edc3c88-c89a-4925-b52e-736032eee3f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:04:33.188715 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1173/2341] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:04:33 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:04:33.685841 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:04:35.031567 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:04:35.128550 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:04:35.755209 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10ca26b-b64e-4e90-81e2-79d776ea0ad8 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:04:35.755586 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10ca26b-b64e-4e90-81e2-79d776ea0ad8 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:04:35.755975 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10ca26b-b64e-4e90-81e2-79d776ea0ad8 None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:04:35.757496 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1169/2342] 10.222.0.59 () {54 vars in 921 bytes} [Tue Oct 4 12:04:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:04:35.774371 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46184a73-fb32-4513-aaa2-e67ce875e295 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:04:35.774659 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46184a73-fb32-4513-aaa2-e67ce875e295 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:04:35.774933 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46184a73-fb32-4513-aaa2-e67ce875e295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:04:35.799961 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-46184a73-fb32-4513-aaa2-e67ce875e295 None None] MFA Rules not processed for user `be119968b02440adbbbc85c553077b92`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:04:35.802468 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-46184a73-fb32-4513-aaa2-e67ce875e295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:04:35.829191 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1174/2343] 10.222.0.59 () {58 vars in 1018 bytes} [Tue Oct 4 12:04:35 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:04:35.840360 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10ca26b-b64e-4e90-81e2-79d776ea0ad8 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:04:35.854857 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10ca26b-b64e-4e90-81e2-79d776ea0ad8 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:04:35.861875 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83beacd1-0a36-47f4-b9d8-c09b36a74a28 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be119968b02440adbbbc85c553077b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:04:35.862468 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83beacd1-0a36-47f4-b9d8-c09b36a74a28 service placement] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:04:35.862760 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83beacd1-0a36-47f4-b9d8-c09b36a74a28 service placement] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:04:35.863003 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83beacd1-0a36-47f4-b9d8-c09b36a74a28 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:04:35.871889 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83beacd1-0a36-47f4-b9d8-c09b36a74a28 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:04:35.873483 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83beacd1-0a36-47f4-b9d8-c09b36a74a28 service placement] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:04:35.884968 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1170/2344] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:04:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:04:35.955575 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46184a73-fb32-4513-aaa2-e67ce875e295 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:04:35.957181 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-46184a73-fb32-4513-aaa2-e67ce875e295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:04:35.972775 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46184a73-fb32-4513-aaa2-e67ce875e295 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:04:35.979795 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d24951-fbbc-4507-ade7-527b03df1c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:04:35.979795 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d24951-fbbc-4507-ade7-527b03df1c96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:04:35.979795 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d24951-fbbc-4507-ade7-527b03df1c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:04:35.979795 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d24951-fbbc-4507-ade7-527b03df1c96 admin admin] PATH_INFO: `/v3/users/d10032bc71e64ffdb16753c659b98a3c` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:04:35.981912 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d24951-fbbc-4507-ade7-527b03df1c96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d10032bc71e64ffdb16753c659b98a3c)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:04:35.984790 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d24951-fbbc-4507-ade7-527b03df1c96 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:04:36.284591 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-c1d24951-fbbc-4507-ade7-527b03df1c96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd10032bc71e64ffdb16753c659b98a3c'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:04:36.291997 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-c1d24951-fbbc-4507-ade7-527b03df1c96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd10032bc71e64ffdb16753c659b98a3c'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:04:36.292787 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-c1d24951-fbbc-4507-ade7-527b03df1c96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd10032bc71e64ffdb16753c659b98a3c'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:04:36.293416 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-c1d24951-fbbc-4507-ade7-527b03df1c96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd10032bc71e64ffdb16753c659b98a3c'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:04:36.396270 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-c1d24951-fbbc-4507-ade7-527b03df1c96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd10032bc71e64ffdb16753c659b98a3c'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:04:36.419028 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1175/2345] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Oct 4 12:04:35 2022] DELETE /identity/v3/users/d10032bc71e64ffdb16753c659b98a3c => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:04:36.688928 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83beacd1-0a36-47f4-b9d8-c09b36a74a28 service placement] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:04:36.701123 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83beacd1-0a36-47f4-b9d8-c09b36a74a28 service placement] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:04:36.765507 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386a29f9-bf6b-42eb-9e0f-9f16528c8ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:04:36.766138 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386a29f9-bf6b-42eb-9e0f-9f16528c8ea3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:04:36.766421 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386a29f9-bf6b-42eb-9e0f-9f16528c8ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:04:36.766699 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386a29f9-bf6b-42eb-9e0f-9f16528c8ea3 admin admin] PATH_INFO: `/v3/projects/d2c2d1b48c3c4556a3a876837b36d1dc` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:04:36.767852 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386a29f9-bf6b-42eb-9e0f-9f16528c8ea3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2c2d1b48c3c4556a3a876837b36d1dc)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:04:36.769934 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386a29f9-bf6b-42eb-9e0f-9f16528c8ea3 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:04:36.904752 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-386a29f9-bf6b-42eb-9e0f-9f16528c8ea3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2c2d1b48c3c4556a3a876837b36d1dc', 'request_id': 'req-386a29f9-bf6b-42eb-9e0f-9f16528c8ea3'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:04:36.911884 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-386a29f9-bf6b-42eb-9e0f-9f16528c8ea3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2c2d1b48c3c4556a3a876837b36d1dc', 'request_id': 'req-386a29f9-bf6b-42eb-9e0f-9f16528c8ea3'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:04:36.984992 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-386a29f9-bf6b-42eb-9e0f-9f16528c8ea3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2c2d1b48c3c4556a3a876837b36d1dc', 'request_id': 'req-386a29f9-bf6b-42eb-9e0f-9f16528c8ea3'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:04:36.996040 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-386a29f9-bf6b-42eb-9e0f-9f16528c8ea3 admin admin] The token cache is being invalidate because project d2c2d1b48c3c4556a3a876837b36d1dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:04:36.996357 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-386a29f9-bf6b-42eb-9e0f-9f16528c8ea3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:04:36.997005 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-386a29f9-bf6b-42eb-9e0f-9f16528c8ea3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:04:36.998567 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1171/2346] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Oct 4 12:04:36 2022] DELETE /identity/v3/projects/d2c2d1b48c3c4556a3a876837b36d1dc => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:04:37.005665 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1292a40c-1ab2-47b1-b9f6-38b027d72a12 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:04:37.005954 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1292a40c-1ab2-47b1-b9f6-38b027d72a12 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:04:37.006229 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1292a40c-1ab2-47b1-b9f6-38b027d72a12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:04:37.026993 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-1292a40c-1ab2-47b1-b9f6-38b027d72a12 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:04:37.028245 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-1292a40c-1ab2-47b1-b9f6-38b027d72a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:04:37.087733 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1176/2347] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:04:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:04:37.096408 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e6a8bb-5eed-4714-b844-27acbf16c11a None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:04:37.096733 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e6a8bb-5eed-4714-b844-27acbf16c11a None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:04:37.097010 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e6a8bb-5eed-4714-b844-27acbf16c11a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:04:37.118380 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-58e6a8bb-5eed-4714-b844-27acbf16c11a None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:04:37.119566 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-58e6a8bb-5eed-4714-b844-27acbf16c11a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:04:37.127450 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1172/2348] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:04:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:04:37.131736 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1292a40c-1ab2-47b1-b9f6-38b027d72a12 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:04:37.141955 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1292a40c-1ab2-47b1-b9f6-38b027d72a12 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:04:37.146448 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bf8cbe-ccd4-4d37-9145-5a3dc940ebe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:04:37.147043 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bf8cbe-ccd4-4d37-9145-5a3dc940ebe7 admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:04:37.147317 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bf8cbe-ccd4-4d37-9145-5a3dc940ebe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:04:37.147585 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bf8cbe-ccd4-4d37-9145-5a3dc940ebe7 admin admin] PATH_INFO: `/v3/domains` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:04:37.151417 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bf8cbe-ccd4-4d37-9145-5a3dc940ebe7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:04:37.151417 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bf8cbe-ccd4-4d37-9145-5a3dc940ebe7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:04:37.151417 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bf8cbe-ccd4-4d37-9145-5a3dc940ebe7 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:04:37.162154 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1177/2349] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Oct 4 12:04:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:04:37.166469 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e6a8bb-5eed-4714-b844-27acbf16c11a None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:04:37.175686 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e6a8bb-5eed-4714-b844-27acbf16c11a None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:04:37.180287 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff526c2-8ea0-40db-af2f-533cca3a249f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:04:37.180934 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff526c2-8ea0-40db-af2f-533cca3a249f admin admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:04:37.181213 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff526c2-8ea0-40db-af2f-533cca3a249f admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:04:37.181484 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff526c2-8ea0-40db-af2f-533cca3a249f admin admin] PATH_INFO: `/v3/projects` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:04:37.182143 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff526c2-8ea0-40db-af2f-533cca3a249f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:04:37.184019 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff526c2-8ea0-40db-af2f-533cca3a249f admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:04:37.321236 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1173/2350] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Oct 4 12:04:37 2022] POST /identity/v3/projects => generated 397 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 12:04:37.325496 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bf8cbe-ccd4-4d37-9145-5a3dc940ebe7 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:04:37.335741 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bf8cbe-ccd4-4d37-9145-5a3dc940ebe7 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:04:37.399889 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dcbb90-f131-4489-bee9-2aceda026cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:04:37.400512 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dcbb90-f131-4489-bee9-2aceda026cee admin admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:04:37.400912 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dcbb90-f131-4489-bee9-2aceda026cee admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:04:37.401133 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dcbb90-f131-4489-bee9-2aceda026cee admin admin] PATH_INFO: `/v3/users` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:04:37.401760 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dcbb90-f131-4489-bee9-2aceda026cee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:04:37.403680 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dcbb90-f131-4489-bee9-2aceda026cee admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:04:37.539358 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1178/2351] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Oct 4 12:04:37 2022] POST /identity/v3/users => generated 299 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:04:37.543449 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff526c2-8ea0-40db-af2f-533cca3a249f admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:04:37.554406 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff526c2-8ea0-40db-af2f-533cca3a249f admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:04:37.559014 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e16d7a2-52ed-4d12-b402-7b1397f046e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:04:37.559627 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e16d7a2-52ed-4d12-b402-7b1397f046e8 admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:04:37.559903 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e16d7a2-52ed-4d12-b402-7b1397f046e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:04:37.560198 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e16d7a2-52ed-4d12-b402-7b1397f046e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:04:37.560875 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e16d7a2-52ed-4d12-b402-7b1397f046e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:04:37.562496 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e16d7a2-52ed-4d12-b402-7b1397f046e8 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:04:37.568153 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:04:37.573427 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1174/2352] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:04:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:04:37.583213 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dcbb90-f131-4489-bee9-2aceda026cee admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:04:37.593742 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dcbb90-f131-4489-bee9-2aceda026cee admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:04:37.598476 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012447d5-b4a8-4611-b5e8-89b6705ac3f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:04:37.599172 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012447d5-b4a8-4611-b5e8-89b6705ac3f2 admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:04:37.599454 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012447d5-b4a8-4611-b5e8-89b6705ac3f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:04:37.599978 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012447d5-b4a8-4611-b5e8-89b6705ac3f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:04:37.600838 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012447d5-b4a8-4611-b5e8-89b6705ac3f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:04:37.602582 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012447d5-b4a8-4611-b5e8-89b6705ac3f2 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:04:37.614894 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1179/2353] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:04:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 12:04:37.620551 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e16d7a2-52ed-4d12-b402-7b1397f046e8 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:04:37.630974 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e16d7a2-52ed-4d12-b402-7b1397f046e8 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:04:37.635484 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348bd331-a47d-4d01-b0a3-c32d23e4622f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:04:37.636120 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348bd331-a47d-4d01-b0a3-c32d23e4622f admin admin] REQUEST_METHOD: `PUT` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:04:37.636396 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348bd331-a47d-4d01-b0a3-c32d23e4622f admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:04:37.636721 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348bd331-a47d-4d01-b0a3-c32d23e4622f admin admin] PATH_INFO: `/v3/projects/a0e31c5759914c898c7ffff667837069/users/a36175712fe349e0ae60996c9e0b40cc/roles/ab4307f3b7994c1c80036fa7db93b6b9` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:04:37.651904 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348bd331-a47d-4d01-b0a3-c32d23e4622f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0e31c5759914c898c7ffff667837069, user_id=a36175712fe349e0ae60996c9e0b40cc, role_id=ab4307f3b7994c1c80036fa7db93b6b9)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:04:37.655499 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348bd331-a47d-4d01-b0a3-c32d23e4622f admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:04:37.772796 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1175/2354] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Oct 4 12:04:37 2022] PUT /identity/v3/projects/a0e31c5759914c898c7ffff667837069/users/a36175712fe349e0ae60996c9e0b40cc/roles/ab4307f3b7994c1c80036fa7db93b6b9 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:04:37.777068 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9920150-8b21-48c3-a93a-e94132f1d2a9 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:04:37.779149 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9920150-8b21-48c3-a93a-e94132f1d2a9 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:04:37.779149 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9920150-8b21-48c3-a93a-e94132f1d2a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:04:37.819873 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:04:37.827481 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-f9920150-8b21-48c3-a93a-e94132f1d2a9 None None] MFA Rules not processed for user `a36175712fe349e0ae60996c9e0b40cc`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:04:37.828890 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-f9920150-8b21-48c3-a93a-e94132f1d2a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:04:37.895884 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1180/2355] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:04:37 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:04:37.914479 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348bd331-a47d-4d01-b0a3-c32d23e4622f admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:04:37.922241 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-348bd331-a47d-4d01-b0a3-c32d23e4622f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:04:37.992892 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348bd331-a47d-4d01-b0a3-c32d23e4622f admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:04:37.997108 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ffd595-2feb-421f-8482-3cb43c590e8d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e2a05b782424ab2928b5864f1bfd556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:04:37.997745 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ffd595-2feb-421f-8482-3cb43c590e8d service cinder] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:04:38.001443 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ffd595-2feb-421f-8482-3cb43c590e8d service cinder] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:04:38.001443 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ffd595-2feb-421f-8482-3cb43c590e8d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:04:38.008855 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ffd595-2feb-421f-8482-3cb43c590e8d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:04:38.010453 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ffd595-2feb-421f-8482-3cb43c590e8d service cinder] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:04:38.022372 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1176/2356] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:04:37 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:04:40.816798 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:04:40.967867 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:04:41.818528 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9920150-8b21-48c3-a93a-e94132f1d2a9 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:04:41.821394 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-f9920150-8b21-48c3-a93a-e94132f1d2a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:04:41.951868 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9920150-8b21-48c3-a93a-e94132f1d2a9 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:04:41.958451 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bca986e-1106-4d00-8c88-710e4aeb0773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:04:41.959115 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bca986e-1106-4d00-8c88-710e4aeb0773 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:04:41.959399 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bca986e-1106-4d00-8c88-710e4aeb0773 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:04:41.959674 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bca986e-1106-4d00-8c88-710e4aeb0773 admin admin] PATH_INFO: `/v3/users/ee880e96177a4d5ab348a632f89f69c4` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:04:41.960929 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bca986e-1106-4d00-8c88-710e4aeb0773 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee880e96177a4d5ab348a632f89f69c4)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:04:41.963574 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bca986e-1106-4d00-8c88-710e4aeb0773 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:04:42.171969 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-6bca986e-1106-4d00-8c88-710e4aeb0773 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee880e96177a4d5ab348a632f89f69c4'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:04:42.179820 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-6bca986e-1106-4d00-8c88-710e4aeb0773 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee880e96177a4d5ab348a632f89f69c4'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:04:42.184950 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-6bca986e-1106-4d00-8c88-710e4aeb0773 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee880e96177a4d5ab348a632f89f69c4'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:04:42.184950 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-6bca986e-1106-4d00-8c88-710e4aeb0773 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee880e96177a4d5ab348a632f89f69c4'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:04:42.316509 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-6bca986e-1106-4d00-8c88-710e4aeb0773 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee880e96177a4d5ab348a632f89f69c4'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:04:42.335236 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1181/2357] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Oct 4 12:04:41 2022] DELETE /identity/v3/users/ee880e96177a4d5ab348a632f89f69c4 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:04:42.339680 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd474c0-855f-4c2a-9749-0bee8b6baaee None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:04:42.340171 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd474c0-855f-4c2a-9749-0bee8b6baaee None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:04:42.340267 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd474c0-855f-4c2a-9749-0bee8b6baaee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:04:42.361655 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-3dd474c0-855f-4c2a-9749-0bee8b6baaee None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:04:42.363134 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-3dd474c0-855f-4c2a-9749-0bee8b6baaee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:04:42.431978 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1177/2358] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:04:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:04:42.443415 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bca986e-1106-4d00-8c88-710e4aeb0773 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:04:42.444950 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-6bca986e-1106-4d00-8c88-710e4aeb0773 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:04:42.566000 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bca986e-1106-4d00-8c88-710e4aeb0773 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:04:42.569872 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a8e15c-eabd-48e1-afa9-f7f5e646cdf1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7289515c5c44914a19daa439de98cb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:04:42.570496 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a8e15c-eabd-48e1-afa9-f7f5e646cdf1 service neutron] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:04:42.570848 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a8e15c-eabd-48e1-afa9-f7f5e646cdf1 service neutron] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:04:42.571192 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a8e15c-eabd-48e1-afa9-f7f5e646cdf1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:04:42.581258 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a8e15c-eabd-48e1-afa9-f7f5e646cdf1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:04:42.586634 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a8e15c-eabd-48e1-afa9-f7f5e646cdf1 service neutron] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:04:42.593084 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1182/2359] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:04:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:04:43.216742 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd474c0-855f-4c2a-9749-0bee8b6baaee None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:04:43.217931 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-3dd474c0-855f-4c2a-9749-0bee8b6baaee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:04:43.230764 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd474c0-855f-4c2a-9749-0bee8b6baaee None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:04:43.236587 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096f8d6f-e3d2-4a00-a6bf-e89db0644554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:04:43.237214 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096f8d6f-e3d2-4a00-a6bf-e89db0644554 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:04:43.237488 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096f8d6f-e3d2-4a00-a6bf-e89db0644554 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:04:43.237958 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096f8d6f-e3d2-4a00-a6bf-e89db0644554 admin admin] PATH_INFO: `/v3/projects/b434e19874aa4b549d8999178ff979dd` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:04:43.239105 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096f8d6f-e3d2-4a00-a6bf-e89db0644554 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b434e19874aa4b549d8999178ff979dd)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:04:43.241365 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096f8d6f-e3d2-4a00-a6bf-e89db0644554 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:04:43.494494 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:04:43.514474 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-096f8d6f-e3d2-4a00-a6bf-e89db0644554 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b434e19874aa4b549d8999178ff979dd', 'request_id': 'req-096f8d6f-e3d2-4a00-a6bf-e89db0644554'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:04:43.520711 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-096f8d6f-e3d2-4a00-a6bf-e89db0644554 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b434e19874aa4b549d8999178ff979dd', 'request_id': 'req-096f8d6f-e3d2-4a00-a6bf-e89db0644554'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:04:43.722382 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-096f8d6f-e3d2-4a00-a6bf-e89db0644554 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b434e19874aa4b549d8999178ff979dd', 'request_id': 'req-096f8d6f-e3d2-4a00-a6bf-e89db0644554'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:04:43.741068 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-096f8d6f-e3d2-4a00-a6bf-e89db0644554 admin admin] The token cache is being invalidate because project b434e19874aa4b549d8999178ff979dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:04:43.741862 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-096f8d6f-e3d2-4a00-a6bf-e89db0644554 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:04:43.742292 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-096f8d6f-e3d2-4a00-a6bf-e89db0644554 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:04:43.753558 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1178/2360] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Oct 4 12:04:43 2022] DELETE /identity/v3/projects/b434e19874aa4b549d8999178ff979dd => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:04:44.640668 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a8e15c-eabd-48e1-afa9-f7f5e646cdf1 service neutron] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:04:44.642169 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-a6a8e15c-eabd-48e1-afa9-f7f5e646cdf1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:04:44.654687 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a8e15c-eabd-48e1-afa9-f7f5e646cdf1 service neutron] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:04:44.717865 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf501d5-0605-4665-b034-b9751f41db80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:04:44.718215 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf501d5-0605-4665-b034-b9751f41db80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:04:44.718497 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf501d5-0605-4665-b034-b9751f41db80 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:04:44.718952 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf501d5-0605-4665-b034-b9751f41db80 admin admin] PATH_INFO: `/v3/users/a36175712fe349e0ae60996c9e0b40cc` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:04:44.720162 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf501d5-0605-4665-b034-b9751f41db80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a36175712fe349e0ae60996c9e0b40cc)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:04:44.722554 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf501d5-0605-4665-b034-b9751f41db80 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:04:44.962425 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:04:45.011304 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-ecf501d5-0605-4665-b034-b9751f41db80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a36175712fe349e0ae60996c9e0b40cc'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:04:45.019792 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-ecf501d5-0605-4665-b034-b9751f41db80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a36175712fe349e0ae60996c9e0b40cc'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:04:45.020509 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-ecf501d5-0605-4665-b034-b9751f41db80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a36175712fe349e0ae60996c9e0b40cc'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:04:45.021169 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-ecf501d5-0605-4665-b034-b9751f41db80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a36175712fe349e0ae60996c9e0b40cc'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:04:45.184935 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-ecf501d5-0605-4665-b034-b9751f41db80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a36175712fe349e0ae60996c9e0b40cc'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:04:45.207542 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1183/2361] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Oct 4 12:04:44 2022] DELETE /identity/v3/users/a36175712fe349e0ae60996c9e0b40cc => generated 0 bytes in 567 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:04:45.212662 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4d1c33-efe2-4f01-8a5e-6c3922db12e0 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:04:45.213154 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4d1c33-efe2-4f01-8a5e-6c3922db12e0 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:04:45.213277 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4d1c33-efe2-4f01-8a5e-6c3922db12e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:04:45.237351 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-2f4d1c33-efe2-4f01-8a5e-6c3922db12e0 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:04:45.238560 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-2f4d1c33-efe2-4f01-8a5e-6c3922db12e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:04:45.306483 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1179/2362] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:04:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:04:45.317211 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf501d5-0605-4665-b034-b9751f41db80 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:04:45.318646 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-ecf501d5-0605-4665-b034-b9751f41db80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:04:45.377899 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf501d5-0605-4665-b034-b9751f41db80 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:04:45.381613 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea11ffb9-f491-46ab-b0f8-f3f863381db5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7289515c5c44914a19daa439de98cb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:04:45.382722 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea11ffb9-f491-46ab-b0f8-f3f863381db5 service neutron] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:04:45.382722 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea11ffb9-f491-46ab-b0f8-f3f863381db5 service neutron] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:04:45.382907 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea11ffb9-f491-46ab-b0f8-f3f863381db5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:04:45.392551 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea11ffb9-f491-46ab-b0f8-f3f863381db5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:04:45.394022 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea11ffb9-f491-46ab-b0f8-f3f863381db5 service neutron] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:04:45.403617 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1184/2363] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:04:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:04:45.902480 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4d1c33-efe2-4f01-8a5e-6c3922db12e0 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:04:45.904032 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-2f4d1c33-efe2-4f01-8a5e-6c3922db12e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:04:45.933610 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4d1c33-efe2-4f01-8a5e-6c3922db12e0 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:04:45.950765 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a7bb4f-4098-4db6-b6dd-01a236e1e638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:04:45.952284 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a7bb4f-4098-4db6-b6dd-01a236e1e638 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:04:45.952681 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a7bb4f-4098-4db6-b6dd-01a236e1e638 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:04:45.952869 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a7bb4f-4098-4db6-b6dd-01a236e1e638 admin admin] PATH_INFO: `/v3/projects/a0e31c5759914c898c7ffff667837069` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:04:45.955205 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a7bb4f-4098-4db6-b6dd-01a236e1e638 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0e31c5759914c898c7ffff667837069)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:04:45.957352 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a7bb4f-4098-4db6-b6dd-01a236e1e638 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:04:46.180574 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-98a7bb4f-4098-4db6-b6dd-01a236e1e638 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0e31c5759914c898c7ffff667837069', 'request_id': 'req-98a7bb4f-4098-4db6-b6dd-01a236e1e638'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:04:46.187124 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-98a7bb4f-4098-4db6-b6dd-01a236e1e638 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0e31c5759914c898c7ffff667837069', 'request_id': 'req-98a7bb4f-4098-4db6-b6dd-01a236e1e638'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:04:46.267991 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604fbf7b-55ad-439a-96d5-3fca48034be8 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:04:46.268487 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604fbf7b-55ad-439a-96d5-3fca48034be8 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:04:46.268624 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604fbf7b-55ad-439a-96d5-3fca48034be8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:04:46.289274 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-604fbf7b-55ad-439a-96d5-3fca48034be8 None None] MFA Rules not processed for user `74861e3dd6e14d999aeae1f057b24582`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:04:46.290477 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-604fbf7b-55ad-439a-96d5-3fca48034be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:04:46.344242 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1185/2364] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:04:46 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:04:46.493626 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-98a7bb4f-4098-4db6-b6dd-01a236e1e638 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0e31c5759914c898c7ffff667837069', 'request_id': 'req-98a7bb4f-4098-4db6-b6dd-01a236e1e638'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:04:46.505625 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-98a7bb4f-4098-4db6-b6dd-01a236e1e638 admin admin] The token cache is being invalidate because project a0e31c5759914c898c7ffff667837069 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:04:46.505919 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-98a7bb4f-4098-4db6-b6dd-01a236e1e638 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:04:46.506572 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-98a7bb4f-4098-4db6-b6dd-01a236e1e638 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:04:46.508387 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1180/2365] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Oct 4 12:04:45 2022] DELETE /identity/v3/projects/a0e31c5759914c898c7ffff667837069 => generated 0 bytes in 606 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:04:46.513235 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d8a2a-0aee-491a-b8f9-3fd8b823a171 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:04:46.513517 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d8a2a-0aee-491a-b8f9-3fd8b823a171 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:04:46.513798 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d8a2a-0aee-491a-b8f9-3fd8b823a171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:04:46.536997 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-2b7d8a2a-0aee-491a-b8f9-3fd8b823a171 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:04:46.538219 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-2b7d8a2a-0aee-491a-b8f9-3fd8b823a171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:04:46.748654 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1186/2366] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:04:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:04:46.752778 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95718cbf-f881-496d-a423-cb7010676e6a None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:04:46.753519 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95718cbf-f881-496d-a423-cb7010676e6a None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:04:46.754050 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95718cbf-f881-496d-a423-cb7010676e6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:04:46.781446 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-95718cbf-f881-496d-a423-cb7010676e6a None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:04:46.783141 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-95718cbf-f881-496d-a423-cb7010676e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:04:46.792763 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1181/2367] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:04:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:04:46.796287 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7d8a2a-0aee-491a-b8f9-3fd8b823a171 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:04:46.808878 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7d8a2a-0aee-491a-b8f9-3fd8b823a171 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:04:46.815176 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac773980-3398-4469-9427-c9a22507a706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:04:46.815885 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac773980-3398-4469-9427-c9a22507a706 admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:04:46.816102 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac773980-3398-4469-9427-c9a22507a706 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:04:46.816371 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac773980-3398-4469-9427-c9a22507a706 admin admin] PATH_INFO: `/v3/domains` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:04:46.817058 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac773980-3398-4469-9427-c9a22507a706 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:04:46.817360 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac773980-3398-4469-9427-c9a22507a706 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:04:46.818957 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac773980-3398-4469-9427-c9a22507a706 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:04:46.832450 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1187/2368] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Oct 4 12:04:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:04:46.837377 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95718cbf-f881-496d-a423-cb7010676e6a None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:04:46.847485 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95718cbf-f881-496d-a423-cb7010676e6a None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:04:46.853040 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e44e64-81f7-44a2-9f53-a212f814fe7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:04:46.853777 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e44e64-81f7-44a2-9f53-a212f814fe7a admin admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:04:46.854123 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e44e64-81f7-44a2-9f53-a212f814fe7a admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:04:46.854407 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e44e64-81f7-44a2-9f53-a212f814fe7a admin admin] PATH_INFO: `/v3/projects` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:04:46.855068 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e44e64-81f7-44a2-9f53-a212f814fe7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:04:46.857049 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e44e64-81f7-44a2-9f53-a212f814fe7a admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:04:47.003470 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1182/2369] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Oct 4 12:04:46 2022] POST /identity/v3/projects => generated 383 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:04:47.004548 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac773980-3398-4469-9427-c9a22507a706 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:04:47.016340 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac773980-3398-4469-9427-c9a22507a706 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:04:47.074680 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b55201-9c3d-4855-88a7-aba4afb8fb0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:04:47.075291 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b55201-9c3d-4855-88a7-aba4afb8fb0b admin admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:04:47.075573 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b55201-9c3d-4855-88a7-aba4afb8fb0b admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:04:47.075848 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b55201-9c3d-4855-88a7-aba4afb8fb0b admin admin] PATH_INFO: `/v3/users` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:04:47.077079 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b55201-9c3d-4855-88a7-aba4afb8fb0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:04:47.079003 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b55201-9c3d-4855-88a7-aba4afb8fb0b admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:04:47.360585 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1188/2370] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Oct 4 12:04:47 2022] POST /identity/v3/users => generated 292 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 12:04:47.365128 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e44e64-81f7-44a2-9f53-a212f814fe7a admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:04:47.375944 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e44e64-81f7-44a2-9f53-a212f814fe7a admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:04:47.380478 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2321f75-0e6b-47d0-ba33-021000d97daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:04:47.381183 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2321f75-0e6b-47d0-ba33-021000d97daf admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:04:47.381534 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2321f75-0e6b-47d0-ba33-021000d97daf admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:04:47.382154 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2321f75-0e6b-47d0-ba33-021000d97daf admin admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:04:47.382984 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2321f75-0e6b-47d0-ba33-021000d97daf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:04:47.384586 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2321f75-0e6b-47d0-ba33-021000d97daf admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:04:47.395632 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1183/2371] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:04:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:04:47.399399 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b55201-9c3d-4855-88a7-aba4afb8fb0b admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:04:47.409479 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b55201-9c3d-4855-88a7-aba4afb8fb0b admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:04:47.416220 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae3a344-7872-4cb6-b3de-f294d7f47403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:04:47.417062 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae3a344-7872-4cb6-b3de-f294d7f47403 admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:04:47.417339 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae3a344-7872-4cb6-b3de-f294d7f47403 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:04:47.417801 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae3a344-7872-4cb6-b3de-f294d7f47403 admin admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:04:47.418613 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae3a344-7872-4cb6-b3de-f294d7f47403 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:04:47.420583 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae3a344-7872-4cb6-b3de-f294d7f47403 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:04:47.433309 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1189/2372] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:04:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:04:47.435405 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2321f75-0e6b-47d0-ba33-021000d97daf admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:04:47.447236 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2321f75-0e6b-47d0-ba33-021000d97daf admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:04:47.452590 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c659a3-40f0-48f2-8031-1ee77d6b69bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:04:47.453344 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c659a3-40f0-48f2-8031-1ee77d6b69bd admin admin] REQUEST_METHOD: `PUT` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:04:47.453690 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c659a3-40f0-48f2-8031-1ee77d6b69bd admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:04:47.454295 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c659a3-40f0-48f2-8031-1ee77d6b69bd admin admin] PATH_INFO: `/v3/projects/a1ea3836fdc647eda9302d8b79984d14/users/5be08c643ebf4bf99f3c6dfe239fc9d5/roles/ab4307f3b7994c1c80036fa7db93b6b9` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:04:47.470861 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c659a3-40f0-48f2-8031-1ee77d6b69bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1ea3836fdc647eda9302d8b79984d14, user_id=5be08c643ebf4bf99f3c6dfe239fc9d5, role_id=ab4307f3b7994c1c80036fa7db93b6b9)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:04:47.473717 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c659a3-40f0-48f2-8031-1ee77d6b69bd admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:04:47.585298 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1184/2373] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Oct 4 12:04:47 2022] PUT /identity/v3/projects/a1ea3836fdc647eda9302d8b79984d14/users/5be08c643ebf4bf99f3c6dfe239fc9d5/roles/ab4307f3b7994c1c80036fa7db93b6b9 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:04:47.590356 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32ef781-8781-441e-bda0-412aa0ab7f62 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:04:47.590643 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32ef781-8781-441e-bda0-412aa0ab7f62 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:04:47.590932 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32ef781-8781-441e-bda0-412aa0ab7f62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:04:47.610310 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-a32ef781-8781-441e-bda0-412aa0ab7f62 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:04:47.611767 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-a32ef781-8781-441e-bda0-412aa0ab7f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:04:47.668542 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1190/2374] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:04:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:04:47.679056 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c659a3-40f0-48f2-8031-1ee77d6b69bd admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:04:47.680869 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-57c659a3-40f0-48f2-8031-1ee77d6b69bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:04:47.744363 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c659a3-40f0-48f2-8031-1ee77d6b69bd admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:04:47.748172 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c9bc43-9d06-4397-8df8-b79d36c9b3c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7289515c5c44914a19daa439de98cb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:04:47.749527 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c9bc43-9d06-4397-8df8-b79d36c9b3c8 service neutron] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:04:47.749809 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c9bc43-9d06-4397-8df8-b79d36c9b3c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:04:47.750083 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c9bc43-9d06-4397-8df8-b79d36c9b3c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:04:47.759500 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c9bc43-9d06-4397-8df8-b79d36c9b3c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:04:47.760956 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c9bc43-9d06-4397-8df8-b79d36c9b3c8 service neutron] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:04:47.770724 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1185/2375] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:04:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:04:48.636849 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:04:50.146370 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:04:53.278256 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:04:53.315995 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:04:55.528087 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:04:55.563227 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:04:56.430442 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877a15f6-ca1a-4597-9e1b-37f50b5c1a58 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:04:56.430734 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877a15f6-ca1a-4597-9e1b-37f50b5c1a58 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:04:56.431199 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877a15f6-ca1a-4597-9e1b-37f50b5c1a58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:04:56.465403 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-877a15f6-ca1a-4597-9e1b-37f50b5c1a58 None None] MFA Rules not processed for user `5be08c643ebf4bf99f3c6dfe239fc9d5`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:04:56.467862 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-877a15f6-ca1a-4597-9e1b-37f50b5c1a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:04:56.549418 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1191/2376] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:04:56 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:04:56.554077 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c9bc43-9d06-4397-8df8-b79d36c9b3c8 service neutron] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:04:56.564387 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c9bc43-9d06-4397-8df8-b79d36c9b3c8 service neutron] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:04:56.569944 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee1b44f-1695-47f1-af2b-0a4e39300917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:04:56.570566 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee1b44f-1695-47f1-af2b-0a4e39300917 admin admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:04:56.570853 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee1b44f-1695-47f1-af2b-0a4e39300917 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:04:56.571148 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee1b44f-1695-47f1-af2b-0a4e39300917 admin admin] PATH_INFO: `/v3/projects` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:04:56.571848 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee1b44f-1695-47f1-af2b-0a4e39300917 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:04:56.573752 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee1b44f-1695-47f1-af2b-0a4e39300917 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:04:56.626428 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:04:56.784921 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1186/2377] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Oct 4 12:04:56 2022] POST /identity/v3/projects => generated 385 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:04:56.785966 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877a15f6-ca1a-4597-9e1b-37f50b5c1a58 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:04:56.796820 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:04:56.798664 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877a15f6-ca1a-4597-9e1b-37f50b5c1a58 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:04:56.858131 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1201a74b-7907-4e23-9618-c644deacd765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:04:56.859314 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1201a74b-7907-4e23-9618-c644deacd765 admin admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:04:56.859596 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1201a74b-7907-4e23-9618-c644deacd765 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:04:56.859877 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1201a74b-7907-4e23-9618-c644deacd765 admin admin] PATH_INFO: `/v3/users` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:04:56.860535 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1201a74b-7907-4e23-9618-c644deacd765 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:04:56.862813 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1201a74b-7907-4e23-9618-c644deacd765 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:04:56.985531 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1192/2378] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Oct 4 12:04:56 2022] POST /identity/v3/users => generated 299 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 12:04:56.989886 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee1b44f-1695-47f1-af2b-0a4e39300917 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:04:57.001468 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee1b44f-1695-47f1-af2b-0a4e39300917 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:04:57.006914 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc42c26f-bf77-4cfb-a038-d6d9e7b74e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:04:57.008110 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc42c26f-bf77-4cfb-a038-d6d9e7b74e35 admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:04:57.008590 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc42c26f-bf77-4cfb-a038-d6d9e7b74e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:04:57.009037 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc42c26f-bf77-4cfb-a038-d6d9e7b74e35 admin admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:04:57.009894 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc42c26f-bf77-4cfb-a038-d6d9e7b74e35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:04:57.011934 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc42c26f-bf77-4cfb-a038-d6d9e7b74e35 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:04:57.024509 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1187/2379] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:04:56 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:04:57.028208 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1201a74b-7907-4e23-9618-c644deacd765 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:04:57.040656 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1201a74b-7907-4e23-9618-c644deacd765 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:04:57.055655 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc62bb1a-ae59-44a7-857b-72b2f0a62c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:04:57.056966 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc62bb1a-ae59-44a7-857b-72b2f0a62c31 admin admin] REQUEST_METHOD: `PUT` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:04:57.057406 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc62bb1a-ae59-44a7-857b-72b2f0a62c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:04:57.057832 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc62bb1a-ae59-44a7-857b-72b2f0a62c31 admin admin] PATH_INFO: `/v3/projects/e350fc6312a14853838c9d0953aeaf00/users/64c0d124a98a43abb8b964995f97c252/roles/d6e7421d1ff9451c808004b818354550` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:04:57.078532 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc62bb1a-ae59-44a7-857b-72b2f0a62c31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e350fc6312a14853838c9d0953aeaf00, user_id=64c0d124a98a43abb8b964995f97c252, role_id=d6e7421d1ff9451c808004b818354550)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:04:57.082115 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc62bb1a-ae59-44a7-857b-72b2f0a62c31 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:04:57.232272 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1193/2380] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Oct 4 12:04:57 2022] PUT /identity/v3/projects/e350fc6312a14853838c9d0953aeaf00/users/64c0d124a98a43abb8b964995f97c252/roles/d6e7421d1ff9451c808004b818354550 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:04:57.236410 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc42c26f-bf77-4cfb-a038-d6d9e7b74e35 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:04:57.247675 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc42c26f-bf77-4cfb-a038-d6d9e7b74e35 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:04:57.309618 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7809b7-a79b-4fb1-8ee0-a9ba7143fa26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:04:57.310142 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7809b7-a79b-4fb1-8ee0-a9ba7143fa26 admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:04:57.310511 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7809b7-a79b-4fb1-8ee0-a9ba7143fa26 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:04:57.311310 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7809b7-a79b-4fb1-8ee0-a9ba7143fa26 admin admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:04:57.312129 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7809b7-a79b-4fb1-8ee0-a9ba7143fa26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:04:57.313763 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7809b7-a79b-4fb1-8ee0-a9ba7143fa26 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:04:57.330088 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1188/2381] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:04:57 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:04:57.331252 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc62bb1a-ae59-44a7-857b-72b2f0a62c31 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:04:57.342086 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc62bb1a-ae59-44a7-857b-72b2f0a62c31 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:04:57.346708 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df994d49-097c-4c76-b7c7-58479a3a3d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:04:57.347362 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df994d49-097c-4c76-b7c7-58479a3a3d3d admin admin] REQUEST_METHOD: `PUT` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:04:57.347631 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df994d49-097c-4c76-b7c7-58479a3a3d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:04:57.347895 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df994d49-097c-4c76-b7c7-58479a3a3d3d admin admin] PATH_INFO: `/v3/projects/e350fc6312a14853838c9d0953aeaf00/users/64c0d124a98a43abb8b964995f97c252/roles/d6e7421d1ff9451c808004b818354550` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:04:57.350180 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df994d49-097c-4c76-b7c7-58479a3a3d3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e350fc6312a14853838c9d0953aeaf00, user_id=64c0d124a98a43abb8b964995f97c252, role_id=d6e7421d1ff9451c808004b818354550)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:04:57.353117 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df994d49-097c-4c76-b7c7-58479a3a3d3d admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:04:57.370469 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1194/2382] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Oct 4 12:04:57 2022] PUT /identity/v3/projects/e350fc6312a14853838c9d0953aeaf00/users/64c0d124a98a43abb8b964995f97c252/roles/d6e7421d1ff9451c808004b818354550 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:04:58.591139 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:05:00.535676 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:05:01.044267 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0983c35e-a5e0-4b86-b937-039d8c289df8 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:05:01.046715 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0983c35e-a5e0-4b86-b937-039d8c289df8 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:05:01.046715 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0983c35e-a5e0-4b86-b937-039d8c289df8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:05:01.066430 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-0983c35e-a5e0-4b86-b937-039d8c289df8 None None] MFA Rules not processed for user `39a8f928f83449d08a766f9c5303b31b`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:05:01.068086 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-0983c35e-a5e0-4b86-b937-039d8c289df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:05:01.133469 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1189/2383] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:05:01 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:05:02.179142 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:05:04.333255 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:05:04.824403 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb000d9-5b90-4965-b749-85c68cb8b253 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:05:04.824727 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb000d9-5b90-4965-b749-85c68cb8b253 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:05:04.825060 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb000d9-5b90-4965-b749-85c68cb8b253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:05:04.859053 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-efb000d9-5b90-4965-b749-85c68cb8b253 None None] MFA Rules not processed for user `64c0d124a98a43abb8b964995f97c252`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:05:04.860333 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-efb000d9-5b90-4965-b749-85c68cb8b253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:05:04.978409 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1195/2384] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:05:04 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 12:05:04.994141 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0983c35e-a5e0-4b86-b937-039d8c289df8 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:05:04.996061 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-0983c35e-a5e0-4b86-b937-039d8c289df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:05:05.068976 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0983c35e-a5e0-4b86-b937-039d8c289df8 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:05:05.072743 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41f0b30-56f1-42a1-8c46-9f4c5ce48a12 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd516d0755be84b7293156625df1b13b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:05:05.073367 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41f0b30-56f1-42a1-8c46-9f4c5ce48a12 service glance] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:05:05.073643 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41f0b30-56f1-42a1-8c46-9f4c5ce48a12 service glance] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:05:05.073914 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41f0b30-56f1-42a1-8c46-9f4c5ce48a12 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:05:05.134702 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41f0b30-56f1-42a1-8c46-9f4c5ce48a12 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:05:05.136152 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41f0b30-56f1-42a1-8c46-9f4c5ce48a12 service glance] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:05:05.146648 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1190/2385] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:05:04 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 12:05:05.437439 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:05:05.495063 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72605c99-a1df-4b6e-aafe-dd96aa89b09a None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:05:05.495532 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72605c99-a1df-4b6e-aafe-dd96aa89b09a None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:05:05.495786 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72605c99-a1df-4b6e-aafe-dd96aa89b09a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:05:05.526266 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-72605c99-a1df-4b6e-aafe-dd96aa89b09a None None] MFA Rules not processed for user `06d1850ea27c483780eed67ede9cc1e3`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:05:05.527854 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-72605c99-a1df-4b6e-aafe-dd96aa89b09a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:05:05.608092 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1196/2386] 10.222.0.59 () {58 vars in 1009 bytes} [Tue Oct 4 12:05:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:05:05.643522 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41f0b30-56f1-42a1-8c46-9f4c5ce48a12 service glance] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:05:05.645034 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-a41f0b30-56f1-42a1-8c46-9f4c5ce48a12 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:05:05.735109 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41f0b30-56f1-42a1-8c46-9f4c5ce48a12 service glance] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:05:05.742356 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f99ba19-565b-49e7-919a-49d31fe16b6e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1605c3e03b7a4bcba4e19f0d92c671bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:05:05.743053 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f99ba19-565b-49e7-919a-49d31fe16b6e service swift] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:05:05.743362 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f99ba19-565b-49e7-919a-49d31fe16b6e service swift] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:05:05.743634 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f99ba19-565b-49e7-919a-49d31fe16b6e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:05:05.753468 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f99ba19-565b-49e7-919a-49d31fe16b6e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:05:05.755126 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f99ba19-565b-49e7-919a-49d31fe16b6e service swift] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:05:05.764301 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1191/2387] 10.222.0.59 () {60 vars in 1384 bytes} [Tue Oct 4 12:05:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 12:05:07.384850 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:05:08.619873 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:05:09.631414 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:05:10.819622 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:05:11.821582 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:05:13.145014 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:05:13.269417 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f814c449-5b63-4dbf-ab53-08e39421acec None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:05:13.269983 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f814c449-5b63-4dbf-ab53-08e39421acec None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:05:13.269983 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f814c449-5b63-4dbf-ab53-08e39421acec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:05:13.291232 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-f814c449-5b63-4dbf-ab53-08e39421acec None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:05:13.292522 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-f814c449-5b63-4dbf-ab53-08e39421acec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:05:13.363034 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1197/2388] 10.222.0.13 () {58 vars in 1016 bytes} [Tue Oct 4 12:05:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:05:13.377981 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f99ba19-565b-49e7-919a-49d31fe16b6e service swift] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:05:13.379939 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-3f99ba19-565b-49e7-919a-49d31fe16b6e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:05:13.482646 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f99ba19-565b-49e7-919a-49d31fe16b6e service swift] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:05:13.488640 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8133e69-70c8-4fb9-bdb6-3f5037d3b70f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8e23d1d2fe24bdf9552e7c2f0ae3424', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:05:13.489261 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8133e69-70c8-4fb9-bdb6-3f5037d3b70f service nova] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:05:13.489535 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8133e69-70c8-4fb9-bdb6-3f5037d3b70f service nova] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:05:13.489816 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8133e69-70c8-4fb9-bdb6-3f5037d3b70f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:05:13.499812 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8133e69-70c8-4fb9-bdb6-3f5037d3b70f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:05:13.503802 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8133e69-70c8-4fb9-bdb6-3f5037d3b70f service nova] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:05:13.511902 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1192/2389] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:05:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:05:13.829372 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:05:14.722272 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=85,keystone:DELETE=10,keystone:INSERT=5 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:05:15.174463 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:05:17.059449 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:05:17.170510 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:05:19.051979 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeeaf00-8b74-414d-93f7-6dd590778ba5 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:05:19.052568 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeeaf00-8b74-414d-93f7-6dd590778ba5 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:05:19.052568 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeeaf00-8b74-414d-93f7-6dd590778ba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:05:19.072407 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-bbeeaf00-8b74-414d-93f7-6dd590778ba5 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:05:19.073627 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-bbeeaf00-8b74-414d-93f7-6dd590778ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:05:19.088010 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1198/2390] 10.222.0.13 () {58 vars in 1016 bytes} [Tue Oct 4 12:05:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:05:19.095935 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9da9753-ad0a-49b2-8e76-8aa1a7651479 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:05:19.096636 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9da9753-ad0a-49b2-8e76-8aa1a7651479 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:05:19.096636 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9da9753-ad0a-49b2-8e76-8aa1a7651479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:05:19.107558 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeeaf00-8b74-414d-93f7-6dd590778ba5 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:05:19.109094 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-bbeeaf00-8b74-414d-93f7-6dd590778ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:05:19.117082 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-b9da9753-ad0a-49b2-8e76-8aa1a7651479 None None] MFA Rules not processed for user `5be08c643ebf4bf99f3c6dfe239fc9d5`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:05:19.118260 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-b9da9753-ad0a-49b2-8e76-8aa1a7651479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:05:19.126003 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1193/2391] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:05:19 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:05:19.128362 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeeaf00-8b74-414d-93f7-6dd590778ba5 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:05:19.136776 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc9ed6d-c2e3-4b83-b219-993705bdb51c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8e23d1d2fe24bdf9552e7c2f0ae3424', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:05:19.138297 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc9ed6d-c2e3-4b83-b219-993705bdb51c service nova] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:05:19.138752 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc9ed6d-c2e3-4b83-b219-993705bdb51c service nova] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:05:19.139199 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc9ed6d-c2e3-4b83-b219-993705bdb51c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:05:19.148054 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc9ed6d-c2e3-4b83-b219-993705bdb51c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:05:19.149678 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc9ed6d-c2e3-4b83-b219-993705bdb51c service nova] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:05:19.159790 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1199/2392] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:05:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 12:05:21.326773 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:05:21.634540 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:05:22.501854 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a404c7f5-f084-4e46-8fa3-b261d875c3f9 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:05:22.502147 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a404c7f5-f084-4e46-8fa3-b261d875c3f9 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:05:22.502429 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a404c7f5-f084-4e46-8fa3-b261d875c3f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:05:22.522365 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-a404c7f5-f084-4e46-8fa3-b261d875c3f9 None None] MFA Rules not processed for user `6c95a1206a4a4788b47882c7bb3e7a61`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:05:22.523559 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-a404c7f5-f084-4e46-8fa3-b261d875c3f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:05:22.580756 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1194/2393] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:05:22 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:05:22.672255 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:05:23.744770 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:05:24.905241 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:05:25.674551 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4234fc81-e0ad-4e1a-8764-1f52814c82a2 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:05:25.674842 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4234fc81-e0ad-4e1a-8764-1f52814c82a2 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:05:25.675119 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4234fc81-e0ad-4e1a-8764-1f52814c82a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:05:25.695250 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-4234fc81-e0ad-4e1a-8764-1f52814c82a2 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:05:25.696529 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-4234fc81-e0ad-4e1a-8764-1f52814c82a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:05:25.704662 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1200/2394] 10.222.0.13 () {58 vars in 1016 bytes} [Tue Oct 4 12:05:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:05:25.753882 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a404c7f5-f084-4e46-8fa3-b261d875c3f9 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:05:25.767492 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a404c7f5-f084-4e46-8fa3-b261d875c3f9 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:05:25.773084 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d0e4ce-d5e3-4e1b-a9f0-070e7506610f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8e23d1d2fe24bdf9552e7c2f0ae3424', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:05:25.773713 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d0e4ce-d5e3-4e1b-a9f0-070e7506610f service nova] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:05:25.773990 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d0e4ce-d5e3-4e1b-a9f0-070e7506610f service nova] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:05:25.774263 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d0e4ce-d5e3-4e1b-a9f0-070e7506610f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:05:25.782544 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d0e4ce-d5e3-4e1b-a9f0-070e7506610f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:05:25.784146 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d0e4ce-d5e3-4e1b-a9f0-070e7506610f service nova] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:05:25.799635 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1195/2395] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:05:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:05:27.500026 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:05:27.550228 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:05:27.912215 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363ec910-5a2f-4c1d-a649-8e862f8d2604 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:05:27.912990 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363ec910-5a2f-4c1d-a649-8e862f8d2604 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:05:27.913818 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363ec910-5a2f-4c1d-a649-8e862f8d2604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:05:27.936165 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-363ec910-5a2f-4c1d-a649-8e862f8d2604 None None] MFA Rules not processed for user `06d1850ea27c483780eed67ede9cc1e3`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:05:27.937671 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-363ec910-5a2f-4c1d-a649-8e862f8d2604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:05:27.945337 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1201/2396] 10.222.0.59 () {58 vars in 1009 bytes} [Tue Oct 4 12:05:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:05:27.958702 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d0e4ce-d5e3-4e1b-a9f0-070e7506610f service nova] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:05:27.970026 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d0e4ce-d5e3-4e1b-a9f0-070e7506610f service nova] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:05:27.976312 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbd415c-1bad-4312-b63c-5e0510c81ede service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1605c3e03b7a4bcba4e19f0d92c671bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:05:27.977104 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbd415c-1bad-4312-b63c-5e0510c81ede service swift] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:05:27.977401 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbd415c-1bad-4312-b63c-5e0510c81ede service swift] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:05:27.977687 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbd415c-1bad-4312-b63c-5e0510c81ede service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:05:27.990192 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbd415c-1bad-4312-b63c-5e0510c81ede service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:05:27.991806 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbd415c-1bad-4312-b63c-5e0510c81ede service swift] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:05:28.000350 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1196/2397] 10.222.0.59 () {60 vars in 1384 bytes} [Tue Oct 4 12:05:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 12:05:30.446428 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dece1dcc-b6cf-4dd3-b57a-1cf85bf6df5a None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:05:30.447371 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dece1dcc-b6cf-4dd3-b57a-1cf85bf6df5a None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:05:30.447800 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dece1dcc-b6cf-4dd3-b57a-1cf85bf6df5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:05:30.496846 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-dece1dcc-b6cf-4dd3-b57a-1cf85bf6df5a None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:05:30.508880 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-dece1dcc-b6cf-4dd3-b57a-1cf85bf6df5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:05:30.525319 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1202/2398] 10.222.0.13 () {58 vars in 1016 bytes} [Tue Oct 4 12:05:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:05:30.553147 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbd415c-1bad-4312-b63c-5e0510c81ede service swift] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:05:30.568545 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:05:30.573865 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbd415c-1bad-4312-b63c-5e0510c81ede service swift] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:05:30.583805 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c61d897-c7d7-47d9-97be-4adc526ae537 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8e23d1d2fe24bdf9552e7c2f0ae3424', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:05:30.584576 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c61d897-c7d7-47d9-97be-4adc526ae537 service nova] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:05:30.584958 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c61d897-c7d7-47d9-97be-4adc526ae537 service nova] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:05:30.585304 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c61d897-c7d7-47d9-97be-4adc526ae537 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:05:30.595256 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c61d897-c7d7-47d9-97be-4adc526ae537 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:05:30.596908 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c61d897-c7d7-47d9-97be-4adc526ae537 service nova] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:05:30.608523 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1197/2399] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:05:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:05:30.609794 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=89,keystone:DELETE=8,keystone:INSERT=3 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:05:31.802070 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:05:32.783111 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:05:33.435551 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:05:33.967803 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:05:38.127228 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:05:38.908888 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:05:39.841858 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:05:40.675507 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:05:42.080708 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db988298-3f83-4a36-b6f2-953ce105d8bc None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:05:42.081204 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db988298-3f83-4a36-b6f2-953ce105d8bc None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:05:42.081330 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db988298-3f83-4a36-b6f2-953ce105d8bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:05:42.100516 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-db988298-3f83-4a36-b6f2-953ce105d8bc None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:05:42.101733 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-db988298-3f83-4a36-b6f2-953ce105d8bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:05:42.109597 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1203/2400] 10.222.0.13 () {58 vars in 1016 bytes} [Tue Oct 4 12:05:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:05:42.125491 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c61d897-c7d7-47d9-97be-4adc526ae537 service nova] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:05:42.137303 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c61d897-c7d7-47d9-97be-4adc526ae537 service nova] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:05:42.143037 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acbc7b4-a462-44dd-9f89-b000e693e05d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8e23d1d2fe24bdf9552e7c2f0ae3424', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:05:42.143636 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acbc7b4-a462-44dd-9f89-b000e693e05d service nova] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:05:42.143920 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acbc7b4-a462-44dd-9f89-b000e693e05d service nova] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:05:42.144196 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acbc7b4-a462-44dd-9f89-b000e693e05d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:05:42.152321 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acbc7b4-a462-44dd-9f89-b000e693e05d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:05:42.154071 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acbc7b4-a462-44dd-9f89-b000e693e05d service nova] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:05:42.163693 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1198/2401] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:05:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:05:42.342636 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:05:42.710100 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:05:43.126933 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:05:43.355968 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:05:43.955832 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:05:43.992565 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:05:44.354042 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:05:44.727107 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:05:44.875686 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:05:45.507894 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:05:45.702556 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:05:46.412993 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40def14-7681-4f31-b629-4d9e0873394c None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:05:46.413496 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40def14-7681-4f31-b629-4d9e0873394c None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:05:46.413600 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40def14-7681-4f31-b629-4d9e0873394c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:05:46.434864 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-c40def14-7681-4f31-b629-4d9e0873394c None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:05:46.436410 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-c40def14-7681-4f31-b629-4d9e0873394c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:05:46.450902 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1204/2402] 10.222.0.13 () {58 vars in 1016 bytes} [Tue Oct 4 12:05:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:05:46.472891 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acbc7b4-a462-44dd-9f89-b000e693e05d service nova] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:05:46.485066 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acbc7b4-a462-44dd-9f89-b000e693e05d service nova] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:05:46.491347 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844d2a34-7482-429e-8a5f-34e942f5e815 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8e23d1d2fe24bdf9552e7c2f0ae3424', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:05:46.491935 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844d2a34-7482-429e-8a5f-34e942f5e815 service nova] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:05:46.492215 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844d2a34-7482-429e-8a5f-34e942f5e815 service nova] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:05:46.492489 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844d2a34-7482-429e-8a5f-34e942f5e815 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:05:46.502158 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844d2a34-7482-429e-8a5f-34e942f5e815 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:05:46.503739 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844d2a34-7482-429e-8a5f-34e942f5e815 service nova] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:05:46.514759 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1199/2403] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:05:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:05:47.207399 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:05:47.241294 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:05:48.515545 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:05:48.622877 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:05:49.755784 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:05:50.893048 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:05:52.373128 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:05:53.607488 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:05:54.052783 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:05:55.743028 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:05:55.799232 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333bedd8-c627-45a6-b885-94569062d2bd None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:05:55.799784 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333bedd8-c627-45a6-b885-94569062d2bd None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:05:55.799784 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333bedd8-c627-45a6-b885-94569062d2bd None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:05:55.801169 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1205/2404] 10.222.0.59 () {54 vars in 921 bytes} [Tue Oct 4 12:05:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:05:55.809279 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c93e584-07c0-47f9-995e-fc30786d4b8c None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:05:55.810427 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c93e584-07c0-47f9-995e-fc30786d4b8c None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:05:55.810897 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c93e584-07c0-47f9-995e-fc30786d4b8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:05:55.833930 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-5c93e584-07c0-47f9-995e-fc30786d4b8c None None] MFA Rules not processed for user `e7289515c5c44914a19daa439de98cb1`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:05:55.835143 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-5c93e584-07c0-47f9-995e-fc30786d4b8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:05:55.888639 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1200/2405] 10.222.0.59 () {58 vars in 1018 bytes} [Tue Oct 4 12:05:55 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:05:55.900532 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333bedd8-c627-45a6-b885-94569062d2bd None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:05:55.914134 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333bedd8-c627-45a6-b885-94569062d2bd None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:05:55.918739 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40be4644-6652-4914-8b29-18d5c39d8060 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7289515c5c44914a19daa439de98cb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:05:55.919484 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40be4644-6652-4914-8b29-18d5c39d8060 service neutron] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:05:55.923972 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40be4644-6652-4914-8b29-18d5c39d8060 service neutron] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:05:55.923972 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40be4644-6652-4914-8b29-18d5c39d8060 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:05:55.927530 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40be4644-6652-4914-8b29-18d5c39d8060 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:05:55.928993 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40be4644-6652-4914-8b29-18d5c39d8060 service neutron] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:05:55.939455 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1206/2406] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:05:55 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:05:56.035128 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db32a328-a44f-46e0-b070-b5668bb12588 None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:05:56.035413 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db32a328-a44f-46e0-b070-b5668bb12588 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:05:56.035671 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db32a328-a44f-46e0-b070-b5668bb12588 None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:05:56.037170 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1201/2407] 10.222.0.59 () {54 vars in 921 bytes} [Tue Oct 4 12:05:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:05:56.043807 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e547ce-cba9-4d17-8c58-703bb85e65b8 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:05:56.044224 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e547ce-cba9-4d17-8c58-703bb85e65b8 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:05:56.046678 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e547ce-cba9-4d17-8c58-703bb85e65b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:05:56.064108 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:05:56.065785 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-99e547ce-cba9-4d17-8c58-703bb85e65b8 None None] MFA Rules not processed for user `a8e23d1d2fe24bdf9552e7c2f0ae3424`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:05:56.067004 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-99e547ce-cba9-4d17-8c58-703bb85e65b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:05:56.080915 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1207/2408] 10.222.0.59 () {58 vars in 1018 bytes} [Tue Oct 4 12:05:56 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:05:56.095508 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db32a328-a44f-46e0-b070-b5668bb12588 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:05:56.113059 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db32a328-a44f-46e0-b070-b5668bb12588 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:05:56.117392 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995b748a-fd7c-48cb-90a0-a0d763fb582a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7289515c5c44914a19daa439de98cb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:05:56.121111 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995b748a-fd7c-48cb-90a0-a0d763fb582a service neutron] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:05:56.121111 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995b748a-fd7c-48cb-90a0-a0d763fb582a service neutron] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:05:56.121111 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995b748a-fd7c-48cb-90a0-a0d763fb582a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:05:56.130482 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995b748a-fd7c-48cb-90a0-a0d763fb582a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:05:56.131894 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995b748a-fd7c-48cb-90a0-a0d763fb582a service neutron] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:05:56.144816 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1202/2409] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:05:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 12:05:56.904640 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:05:57.407317 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:05:57.536319 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:05:58.208042 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:05:58.416639 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:05:58.669678 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:05:58.708232 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:05:59.086990 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:05:59.247395 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:05:59.275365 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:05:59.702359 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:05:59.732491 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:06:00.315527 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:DELETE=3,keystone:SELECT=97 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:06:00.350045 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:06:00.847107 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:06:00.925347 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:06:01.235362 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:06:01.412388 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:06:01.440912 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:06:02.418181 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:06:02.864344 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:06:03.429980 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:06:03.765425 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:06:05.144588 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e547ce-cba9-4d17-8c58-703bb85e65b8 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:06:05.158603 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e547ce-cba9-4d17-8c58-703bb85e65b8 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:06:05.166263 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbc2dd9-3cdd-47ec-84d3-3cce7caf87e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7289515c5c44914a19daa439de98cb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:06:05.170378 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbc2dd9-3cdd-47ec-84d3-3cce7caf87e7 service neutron] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:06:05.170851 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbc2dd9-3cdd-47ec-84d3-3cce7caf87e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:06:05.171129 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbc2dd9-3cdd-47ec-84d3-3cce7caf87e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:06:05.181520 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbc2dd9-3cdd-47ec-84d3-3cce7caf87e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:06:05.184903 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbc2dd9-3cdd-47ec-84d3-3cce7caf87e7 service neutron] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:06:05.205121 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1208/2410] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:06:05 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:06:13.522896 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fee421-25a6-4bde-b9af-a3a4ab6b97f7 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:06:13.523477 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fee421-25a6-4bde-b9af-a3a4ab6b97f7 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:06:13.523477 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fee421-25a6-4bde-b9af-a3a4ab6b97f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:06:13.549761 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-e8fee421-25a6-4bde-b9af-a3a4ab6b97f7 None None] MFA Rules not processed for user `92bb1140da0340ff832a12a09f4818c8`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:06:13.551344 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-e8fee421-25a6-4bde-b9af-a3a4ab6b97f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:06:13.644899 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1203/2411] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:06:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 12:06:15.195524 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=65 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:06:19.487650 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97689efa-3537-48f2-b449-c9c68151e184 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:06:19.488297 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97689efa-3537-48f2-b449-c9c68151e184 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:06:19.488297 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97689efa-3537-48f2-b449-c9c68151e184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:06:19.507971 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-97689efa-3537-48f2-b449-c9c68151e184 None None] MFA Rules not processed for user `74861e3dd6e14d999aeae1f057b24582`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:06:19.509207 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-97689efa-3537-48f2-b449-c9c68151e184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:06:19.565904 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1209/2412] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:06:19 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:06:21.218696 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fee421-25a6-4bde-b9af-a3a4ab6b97f7 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:06:21.231629 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fee421-25a6-4bde-b9af-a3a4ab6b97f7 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:06:21.235437 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a87a81c-1bd6-44e4-94d2-ba5af0d4644a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7289515c5c44914a19daa439de98cb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:06:21.236051 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a87a81c-1bd6-44e4-94d2-ba5af0d4644a service neutron] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:06:21.236331 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a87a81c-1bd6-44e4-94d2-ba5af0d4644a service neutron] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:06:21.236901 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a87a81c-1bd6-44e4-94d2-ba5af0d4644a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:06:21.238680 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-6a87a81c-1bd6-44e4-94d2-ba5af0d4644a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:06:21.253130 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a87a81c-1bd6-44e4-94d2-ba5af0d4644a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:06:21.255940 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a87a81c-1bd6-44e4-94d2-ba5af0d4644a service neutron] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:06:21.267152 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1204/2413] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:06:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:06:22.403405 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97689efa-3537-48f2-b449-c9c68151e184 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:06:22.405015 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-97689efa-3537-48f2-b449-c9c68151e184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:06:22.419376 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97689efa-3537-48f2-b449-c9c68151e184 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:06:22.424469 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615da2cd-9669-45b4-8a39-cd9df36919ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7289515c5c44914a19daa439de98cb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:06:22.425585 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615da2cd-9669-45b4-8a39-cd9df36919ce service neutron] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:06:22.425951 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615da2cd-9669-45b4-8a39-cd9df36919ce service neutron] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:06:22.426395 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615da2cd-9669-45b4-8a39-cd9df36919ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:06:22.428439 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-615da2cd-9669-45b4-8a39-cd9df36919ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:06:22.443306 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615da2cd-9669-45b4-8a39-cd9df36919ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:06:22.445098 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615da2cd-9669-45b4-8a39-cd9df36919ce service neutron] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:06:22.459894 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1210/2414] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:06:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:06:22.802458 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a87a81c-1bd6-44e4-94d2-ba5af0d4644a service neutron] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:06:22.811687 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a87a81c-1bd6-44e4-94d2-ba5af0d4644a service neutron] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:06:22.815486 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e1952d-3f5d-4219-a5a6-ff182ea8356a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7289515c5c44914a19daa439de98cb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:06:22.816100 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e1952d-3f5d-4219-a5a6-ff182ea8356a service neutron] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:06:22.816539 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e1952d-3f5d-4219-a5a6-ff182ea8356a service neutron] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:06:22.816729 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e1952d-3f5d-4219-a5a6-ff182ea8356a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:06:22.818650 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-a1e1952d-3f5d-4219-a5a6-ff182ea8356a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:06:22.832235 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e1952d-3f5d-4219-a5a6-ff182ea8356a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:06:22.833726 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e1952d-3f5d-4219-a5a6-ff182ea8356a service neutron] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:06:22.846057 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1205/2415] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:06:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:06:28.655285 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615da2cd-9669-45b4-8a39-cd9df36919ce service neutron] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:06:28.657151 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-615da2cd-9669-45b4-8a39-cd9df36919ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:06:28.674931 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615da2cd-9669-45b4-8a39-cd9df36919ce service neutron] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:06:28.680467 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f4ec11-74bd-41dc-951d-ef57a0c13b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:06:28.681295 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f4ec11-74bd-41dc-951d-ef57a0c13b85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:06:28.681637 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f4ec11-74bd-41dc-951d-ef57a0c13b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:06:28.682188 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f4ec11-74bd-41dc-951d-ef57a0c13b85 admin admin] PATH_INFO: `/v3/users/39a8f928f83449d08a766f9c5303b31b` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:06:28.683727 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f4ec11-74bd-41dc-951d-ef57a0c13b85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39a8f928f83449d08a766f9c5303b31b)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:06:28.686163 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f4ec11-74bd-41dc-951d-ef57a0c13b85 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:06:28.905820 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-27f4ec11-74bd-41dc-951d-ef57a0c13b85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39a8f928f83449d08a766f9c5303b31b'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:06:28.913358 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-27f4ec11-74bd-41dc-951d-ef57a0c13b85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39a8f928f83449d08a766f9c5303b31b'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:06:28.914081 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-27f4ec11-74bd-41dc-951d-ef57a0c13b85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39a8f928f83449d08a766f9c5303b31b'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:06:28.914686 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-27f4ec11-74bd-41dc-951d-ef57a0c13b85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39a8f928f83449d08a766f9c5303b31b'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:06:29.000651 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-27f4ec11-74bd-41dc-951d-ef57a0c13b85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39a8f928f83449d08a766f9c5303b31b'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:06:29.024185 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1211/2416] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Oct 4 12:06:28 2022] DELETE /identity/v3/users/39a8f928f83449d08a766f9c5303b31b => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:06:29.286476 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e1952d-3f5d-4219-a5a6-ff182ea8356a service neutron] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:06:29.295370 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e1952d-3f5d-4219-a5a6-ff182ea8356a service neutron] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:06:29.370871 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c04874-e81a-4cde-b675-222c90aa90b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:06:29.371528 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c04874-e81a-4cde-b675-222c90aa90b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:06:29.371810 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c04874-e81a-4cde-b675-222c90aa90b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:06:29.372086 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c04874-e81a-4cde-b675-222c90aa90b2 admin admin] PATH_INFO: `/v3/projects/7276be9c327849c3bde22ad79fedea72` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:06:29.373952 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c04874-e81a-4cde-b675-222c90aa90b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7276be9c327849c3bde22ad79fedea72)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:06:29.375975 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c04874-e81a-4cde-b675-222c90aa90b2 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:06:29.403317 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:06:29.517147 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-88c04874-e81a-4cde-b675-222c90aa90b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7276be9c327849c3bde22ad79fedea72', 'request_id': 'req-88c04874-e81a-4cde-b675-222c90aa90b2'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:06:29.524427 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-88c04874-e81a-4cde-b675-222c90aa90b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7276be9c327849c3bde22ad79fedea72', 'request_id': 'req-88c04874-e81a-4cde-b675-222c90aa90b2'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:06:29.623869 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-88c04874-e81a-4cde-b675-222c90aa90b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7276be9c327849c3bde22ad79fedea72', 'request_id': 'req-88c04874-e81a-4cde-b675-222c90aa90b2'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:06:29.639350 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-88c04874-e81a-4cde-b675-222c90aa90b2 admin admin] The token cache is being invalidate because project 7276be9c327849c3bde22ad79fedea72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:06:29.639740 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-88c04874-e81a-4cde-b675-222c90aa90b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:06:29.640404 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-88c04874-e81a-4cde-b675-222c90aa90b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:06:29.642713 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1206/2417] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Oct 4 12:06:29 2022] DELETE /identity/v3/projects/7276be9c327849c3bde22ad79fedea72 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:06:29.648115 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3ab1d1-49bc-4587-8a11-71eb9d3ce60a None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:06:29.648438 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3ab1d1-49bc-4587-8a11-71eb9d3ce60a None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:06:29.648740 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3ab1d1-49bc-4587-8a11-71eb9d3ce60a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:06:29.672549 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-2a3ab1d1-49bc-4587-8a11-71eb9d3ce60a None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:06:29.673850 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-2a3ab1d1-49bc-4587-8a11-71eb9d3ce60a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:06:29.746467 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1212/2418] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:06:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:06:29.754552 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ac1ff-c505-4ae6-ae2a-fa11f81677fb None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:06:29.755076 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ac1ff-c505-4ae6-ae2a-fa11f81677fb None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:06:29.755502 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ac1ff-c505-4ae6-ae2a-fa11f81677fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:06:29.781043 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-f86ac1ff-c505-4ae6-ae2a-fa11f81677fb None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:06:29.782283 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-f86ac1ff-c505-4ae6-ae2a-fa11f81677fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:06:29.792752 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1207/2419] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:06:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:06:29.802601 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3ab1d1-49bc-4587-8a11-71eb9d3ce60a None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:06:29.821076 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:06:29.831383 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3ab1d1-49bc-4587-8a11-71eb9d3ce60a None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:06:29.836578 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aeff8c-a9a7-4159-b2d6-718d3545824c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:06:29.837258 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aeff8c-a9a7-4159-b2d6-718d3545824c admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:06:29.837540 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aeff8c-a9a7-4159-b2d6-718d3545824c admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:06:29.838444 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aeff8c-a9a7-4159-b2d6-718d3545824c admin admin] PATH_INFO: `/v3/domains` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:06:29.839102 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03aeff8c-a9a7-4159-b2d6-718d3545824c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:06:29.839411 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03aeff8c-a9a7-4159-b2d6-718d3545824c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:06:29.841152 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03aeff8c-a9a7-4159-b2d6-718d3545824c admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:06:29.854512 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1213/2420] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Oct 4 12:06:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:06:29.859045 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86ac1ff-c505-4ae6-ae2a-fa11f81677fb None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:06:29.871463 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86ac1ff-c505-4ae6-ae2a-fa11f81677fb None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:06:29.876951 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec13717-45ec-40fa-b303-5b1df3dd573c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:06:29.877601 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec13717-45ec-40fa-b303-5b1df3dd573c admin admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:06:29.877877 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec13717-45ec-40fa-b303-5b1df3dd573c admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:06:29.878145 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec13717-45ec-40fa-b303-5b1df3dd573c admin admin] PATH_INFO: `/v3/projects` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:06:29.878812 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec13717-45ec-40fa-b303-5b1df3dd573c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:06:29.880723 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec13717-45ec-40fa-b303-5b1df3dd573c admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:06:30.040162 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1208/2421] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Oct 4 12:06:29 2022] POST /identity/v3/projects => generated 377 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:06:30.044887 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aeff8c-a9a7-4159-b2d6-718d3545824c admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:06:30.054679 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aeff8c-a9a7-4159-b2d6-718d3545824c admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:06:30.114401 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1204afb7-b6cb-47f8-b561-b51793b0066f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:06:30.115009 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1204afb7-b6cb-47f8-b561-b51793b0066f admin admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:06:30.115285 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1204afb7-b6cb-47f8-b561-b51793b0066f admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:06:30.115554 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1204afb7-b6cb-47f8-b561-b51793b0066f admin admin] PATH_INFO: `/v3/users` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:06:30.116213 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1204afb7-b6cb-47f8-b561-b51793b0066f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:06:30.118198 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1204afb7-b6cb-47f8-b561-b51793b0066f admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:06:30.309515 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1214/2422] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Oct 4 12:06:30 2022] POST /identity/v3/users => generated 289 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:06:30.313457 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec13717-45ec-40fa-b303-5b1df3dd573c admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:06:30.324445 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec13717-45ec-40fa-b303-5b1df3dd573c admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:06:30.329110 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c212da-5ec4-4407-bfb1-20191dd72379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:06:30.329713 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c212da-5ec4-4407-bfb1-20191dd72379 admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:06:30.330115 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c212da-5ec4-4407-bfb1-20191dd72379 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:06:30.330394 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c212da-5ec4-4407-bfb1-20191dd72379 admin admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:06:30.331071 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c212da-5ec4-4407-bfb1-20191dd72379 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:06:30.332703 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c212da-5ec4-4407-bfb1-20191dd72379 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:06:30.343562 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1209/2423] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:06:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:06:30.347722 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1204afb7-b6cb-47f8-b561-b51793b0066f admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:06:30.358629 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1204afb7-b6cb-47f8-b561-b51793b0066f admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:06:30.363323 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d990ba73-ec3a-466b-a9da-d71782a2cea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:06:30.363914 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d990ba73-ec3a-466b-a9da-d71782a2cea9 admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:06:30.364190 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d990ba73-ec3a-466b-a9da-d71782a2cea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:06:30.364500 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d990ba73-ec3a-466b-a9da-d71782a2cea9 admin admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:06:30.365137 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d990ba73-ec3a-466b-a9da-d71782a2cea9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:06:30.366713 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d990ba73-ec3a-466b-a9da-d71782a2cea9 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:06:30.377802 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1215/2424] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:06:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 12:06:30.382309 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c212da-5ec4-4407-bfb1-20191dd72379 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:06:30.392330 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c212da-5ec4-4407-bfb1-20191dd72379 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:06:30.397230 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a05908-5f95-4241-85a4-d2babfccf484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:06:30.397891 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a05908-5f95-4241-85a4-d2babfccf484 admin admin] REQUEST_METHOD: `PUT` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:06:30.398193 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a05908-5f95-4241-85a4-d2babfccf484 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:06:30.398454 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a05908-5f95-4241-85a4-d2babfccf484 admin admin] PATH_INFO: `/v3/projects/43ddaa7c45fd49f1a58449c859aa7d43/users/1b7f5ed542594c0eabffe87b89344716/roles/ab4307f3b7994c1c80036fa7db93b6b9` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:06:30.415215 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a05908-5f95-4241-85a4-d2babfccf484 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43ddaa7c45fd49f1a58449c859aa7d43, user_id=1b7f5ed542594c0eabffe87b89344716, role_id=ab4307f3b7994c1c80036fa7db93b6b9)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:06:30.419132 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a05908-5f95-4241-85a4-d2babfccf484 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:06:30.534046 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1210/2425] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Oct 4 12:06:30 2022] PUT /identity/v3/projects/43ddaa7c45fd49f1a58449c859aa7d43/users/1b7f5ed542594c0eabffe87b89344716/roles/ab4307f3b7994c1c80036fa7db93b6b9 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:06:30.539282 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d222d6-af7d-404d-a0f9-c6fa64ebc95f None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:06:30.539573 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d222d6-af7d-404d-a0f9-c6fa64ebc95f None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:06:30.540009 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d222d6-af7d-404d-a0f9-c6fa64ebc95f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:06:30.560834 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-44d222d6-af7d-404d-a0f9-c6fa64ebc95f None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:06:30.561967 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-44d222d6-af7d-404d-a0f9-c6fa64ebc95f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:06:30.627480 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1216/2426] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:06:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:06:30.637644 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a05908-5f95-4241-85a4-d2babfccf484 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:06:30.641010 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-48a05908-5f95-4241-85a4-d2babfccf484 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:06:30.702330 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a05908-5f95-4241-85a4-d2babfccf484 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:06:30.706043 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c601bcd-016f-4d6f-afce-df73a0313e84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7289515c5c44914a19daa439de98cb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:06:30.709383 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c601bcd-016f-4d6f-afce-df73a0313e84 service neutron] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:06:30.709383 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c601bcd-016f-4d6f-afce-df73a0313e84 service neutron] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:06:30.709383 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c601bcd-016f-4d6f-afce-df73a0313e84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:06:30.717289 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c601bcd-016f-4d6f-afce-df73a0313e84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:06:30.718824 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c601bcd-016f-4d6f-afce-df73a0313e84 service neutron] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:06:30.729076 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1211/2427] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:06:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:06:35.991060 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d222d6-af7d-404d-a0f9-c6fa64ebc95f None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:06:35.992830 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-44d222d6-af7d-404d-a0f9-c6fa64ebc95f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:06:36.127661 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d222d6-af7d-404d-a0f9-c6fa64ebc95f None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:06:36.136182 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f75cb9d-6baf-4f6a-81c6-e305b30a2f64 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8e23d1d2fe24bdf9552e7c2f0ae3424', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:06:36.137257 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f75cb9d-6baf-4f6a-81c6-e305b30a2f64 service nova] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:06:36.137387 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f75cb9d-6baf-4f6a-81c6-e305b30a2f64 service nova] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:06:36.137645 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f75cb9d-6baf-4f6a-81c6-e305b30a2f64 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:06:36.139853 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-5f75cb9d-6baf-4f6a-81c6-e305b30a2f64 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:06:36.159337 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:06:36.252986 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f75cb9d-6baf-4f6a-81c6-e305b30a2f64 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:06:36.254748 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f75cb9d-6baf-4f6a-81c6-e305b30a2f64 service nova] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:06:36.268390 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1217/2428] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:06:35 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:06:37.195251 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d36bac-bfea-4c44-baf8-bc10c717e450 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:06:37.195810 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d36bac-bfea-4c44-baf8-bc10c717e450 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:06:37.196581 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d36bac-bfea-4c44-baf8-bc10c717e450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:06:37.229825 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-32d36bac-bfea-4c44-baf8-bc10c717e450 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:06:37.233583 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-32d36bac-bfea-4c44-baf8-bc10c717e450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:06:37.246847 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1212/2429] 10.222.0.13 () {58 vars in 1016 bytes} [Tue Oct 4 12:06:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:06:37.267432 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f75cb9d-6baf-4f6a-81c6-e305b30a2f64 service nova] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:06:37.269863 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-5f75cb9d-6baf-4f6a-81c6-e305b30a2f64 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:06:37.285807 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f75cb9d-6baf-4f6a-81c6-e305b30a2f64 service nova] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:06:37.292800 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a1b4e6-2b72-4c9b-a656-e32b0b4e980e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8e23d1d2fe24bdf9552e7c2f0ae3424', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:06:37.293564 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a1b4e6-2b72-4c9b-a656-e32b0b4e980e service nova] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:06:37.293970 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a1b4e6-2b72-4c9b-a656-e32b0b4e980e service nova] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:06:37.294345 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a1b4e6-2b72-4c9b-a656-e32b0b4e980e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:06:37.303931 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a1b4e6-2b72-4c9b-a656-e32b0b4e980e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:06:37.305718 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a1b4e6-2b72-4c9b-a656-e32b0b4e980e service nova] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:06:37.317178 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1218/2430] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:06:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:06:38.099011 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15855e2f-f2cf-41e4-a7a5-1caed8edb82b None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:06:38.099388 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15855e2f-f2cf-41e4-a7a5-1caed8edb82b None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:06:38.099567 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15855e2f-f2cf-41e4-a7a5-1caed8edb82b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:06:38.137490 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-15855e2f-f2cf-41e4-a7a5-1caed8edb82b None None] MFA Rules not processed for user `1b7f5ed542594c0eabffe87b89344716`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:06:38.138728 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-15855e2f-f2cf-41e4-a7a5-1caed8edb82b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:06:38.178078 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:06:38.232709 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1213/2431] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:06:38 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:06:38.242676 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a1b4e6-2b72-4c9b-a656-e32b0b4e980e service nova] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:06:38.255549 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a1b4e6-2b72-4c9b-a656-e32b0b4e980e service nova] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:06:38.262118 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d8d28d-7c78-4feb-931b-1351ad36d928 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8e23d1d2fe24bdf9552e7c2f0ae3424', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:06:38.262768 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d8d28d-7c78-4feb-931b-1351ad36d928 service nova] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:06:38.263046 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d8d28d-7c78-4feb-931b-1351ad36d928 service nova] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:06:38.263315 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d8d28d-7c78-4feb-931b-1351ad36d928 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:06:38.272071 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d8d28d-7c78-4feb-931b-1351ad36d928 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:06:38.273708 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d8d28d-7c78-4feb-931b-1351ad36d928 service nova] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:06:38.287666 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1219/2432] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:06:38 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:06:39.162736 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15855e2f-f2cf-41e4-a7a5-1caed8edb82b None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:06:39.176369 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15855e2f-f2cf-41e4-a7a5-1caed8edb82b None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:06:39.186094 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f583b1a-8e3a-430e-8570-9f627594a43a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8e23d1d2fe24bdf9552e7c2f0ae3424', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:06:39.187043 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f583b1a-8e3a-430e-8570-9f627594a43a service nova] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:06:39.187488 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f583b1a-8e3a-430e-8570-9f627594a43a service nova] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:06:39.187941 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f583b1a-8e3a-430e-8570-9f627594a43a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:06:39.190158 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-6f583b1a-8e3a-430e-8570-9f627594a43a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:06:39.269282 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f583b1a-8e3a-430e-8570-9f627594a43a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:06:39.271046 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f583b1a-8e3a-430e-8570-9f627594a43a service nova] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:06:39.304833 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1214/2433] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:06:39 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:06:42.006687 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17afbb53-19c4-4825-b8b1-4ad5591cb406 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:06:42.007272 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17afbb53-19c4-4825-b8b1-4ad5591cb406 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:06:42.007272 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17afbb53-19c4-4825-b8b1-4ad5591cb406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:06:42.035184 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-17afbb53-19c4-4825-b8b1-4ad5591cb406 None None] MFA Rules not processed for user `1b7f5ed542594c0eabffe87b89344716`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:06:42.037142 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-17afbb53-19c4-4825-b8b1-4ad5591cb406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:06:42.047212 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1220/2434] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:06:42 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:06:42.126665 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63768aca-3af6-4346-848f-173ddbb7ced8 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:06:42.127431 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63768aca-3af6-4346-848f-173ddbb7ced8 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:06:42.127941 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63768aca-3af6-4346-848f-173ddbb7ced8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:06:42.171888 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-63768aca-3af6-4346-848f-173ddbb7ced8 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:06:42.173369 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-63768aca-3af6-4346-848f-173ddbb7ced8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:06:42.182461 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1215/2435] 10.222.0.13 () {58 vars in 1016 bytes} [Tue Oct 4 12:06:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:06:42.396768 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17afbb53-19c4-4825-b8b1-4ad5591cb406 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:06:42.398184 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-17afbb53-19c4-4825-b8b1-4ad5591cb406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:06:42.410826 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17afbb53-19c4-4825-b8b1-4ad5591cb406 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:06:42.414301 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a90f19-354e-4742-b960-111b5c09eff7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7289515c5c44914a19daa439de98cb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:06:42.414946 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a90f19-354e-4742-b960-111b5c09eff7 service neutron] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:06:42.415252 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a90f19-354e-4742-b960-111b5c09eff7 service neutron] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:06:42.416098 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a90f19-354e-4742-b960-111b5c09eff7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:06:42.417841 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-a0a90f19-354e-4742-b960-111b5c09eff7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:06:42.427016 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a90f19-354e-4742-b960-111b5c09eff7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:06:42.428425 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a90f19-354e-4742-b960-111b5c09eff7 service neutron] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:06:42.436406 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1221/2436] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:06:42 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:06:42.895876 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63768aca-3af6-4346-848f-173ddbb7ced8 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:06:42.910680 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63768aca-3af6-4346-848f-173ddbb7ced8 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:06:42.916240 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549532ac-9987-4751-b314-84f59f9ad0d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8e23d1d2fe24bdf9552e7c2f0ae3424', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:06:42.916974 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549532ac-9987-4751-b314-84f59f9ad0d0 service nova] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:06:42.917295 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549532ac-9987-4751-b314-84f59f9ad0d0 service nova] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:06:42.917514 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549532ac-9987-4751-b314-84f59f9ad0d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:06:42.926072 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549532ac-9987-4751-b314-84f59f9ad0d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:06:42.927782 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549532ac-9987-4751-b314-84f59f9ad0d0 service nova] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:06:42.937576 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1216/2437] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:06:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:06:43.148538 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fd3817-21ad-4829-bad7-cd8149e2f0b4 None None] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:06:43.149355 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fd3817-21ad-4829-bad7-cd8149e2f0b4 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:06:43.149355 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fd3817-21ad-4829-bad7-cd8149e2f0b4 None None] PATH_INFO: `/` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:06:43.151703 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1222/2438] 10.222.0.59 () {54 vars in 961 bytes} [Tue Oct 4 12:06:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:06:43.159036 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4365dca2-1f49-4246-8607-e0ad0f3013cd None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:06:43.160304 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4365dca2-1f49-4246-8607-e0ad0f3013cd None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:06:43.160586 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4365dca2-1f49-4246-8607-e0ad0f3013cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:06:43.181815 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-4365dca2-1f49-4246-8607-e0ad0f3013cd None None] MFA Rules not processed for user `be119968b02440adbbbc85c553077b92`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:06:43.183483 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-4365dca2-1f49-4246-8607-e0ad0f3013cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:06:43.256198 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1217/2439] 10.222.0.59 () {58 vars in 1058 bytes} [Tue Oct 4 12:06:43 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:06:43.265256 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fd3817-21ad-4829-bad7-cd8149e2f0b4 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:06:43.284261 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fd3817-21ad-4829-bad7-cd8149e2f0b4 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:06:43.289659 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8390a837-b185-4cda-a321-a341ca56f61e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be119968b02440adbbbc85c553077b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:06:43.289806 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8390a837-b185-4cda-a321-a341ca56f61e service placement] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:06:43.290024 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8390a837-b185-4cda-a321-a341ca56f61e service placement] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:06:43.290372 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8390a837-b185-4cda-a321-a341ca56f61e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:06:43.293028 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-8390a837-b185-4cda-a321-a341ca56f61e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:06:43.304911 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8390a837-b185-4cda-a321-a341ca56f61e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:06:43.306526 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8390a837-b185-4cda-a321-a341ca56f61e service placement] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:06:43.316829 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1223/2440] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:06:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:06:45.871898 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574ee24c-e64a-41b0-a951-36354140e831 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:06:45.872369 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574ee24c-e64a-41b0-a951-36354140e831 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:06:45.872514 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574ee24c-e64a-41b0-a951-36354140e831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:06:45.892787 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-574ee24c-e64a-41b0-a951-36354140e831 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:06:45.894014 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-574ee24c-e64a-41b0-a951-36354140e831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:06:45.902108 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1218/2441] 10.222.0.13 () {58 vars in 1016 bytes} [Tue Oct 4 12:06:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 12:06:45.917586 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8390a837-b185-4cda-a321-a341ca56f61e service placement] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:06:45.930620 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8390a837-b185-4cda-a321-a341ca56f61e service placement] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:06:45.939286 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b593044-33ec-4a7f-b2cf-fb9b778fb831 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8e23d1d2fe24bdf9552e7c2f0ae3424', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:06:45.939905 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b593044-33ec-4a7f-b2cf-fb9b778fb831 service nova] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:06:45.940184 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b593044-33ec-4a7f-b2cf-fb9b778fb831 service nova] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:06:45.940455 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b593044-33ec-4a7f-b2cf-fb9b778fb831 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:06:45.950563 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b593044-33ec-4a7f-b2cf-fb9b778fb831 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:06:45.952187 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b593044-33ec-4a7f-b2cf-fb9b778fb831 service nova] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:06:45.962781 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1224/2442] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:06:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:06:49.030707 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574ee24c-e64a-41b0-a951-36354140e831 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:06:49.040941 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574ee24c-e64a-41b0-a951-36354140e831 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:06:49.045067 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea4c86f-304b-4d20-a3e8-48618c5ad316 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7289515c5c44914a19daa439de98cb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:06:49.045679 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea4c86f-304b-4d20-a3e8-48618c5ad316 service neutron] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:06:49.046174 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea4c86f-304b-4d20-a3e8-48618c5ad316 service neutron] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:06:49.046445 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea4c86f-304b-4d20-a3e8-48618c5ad316 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:06:49.048423 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-8ea4c86f-304b-4d20-a3e8-48618c5ad316 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:06:49.058988 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea4c86f-304b-4d20-a3e8-48618c5ad316 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:06:49.060411 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea4c86f-304b-4d20-a3e8-48618c5ad316 service neutron] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:06:49.068928 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1219/2443] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:06:49 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:06:50.165009 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56fb4da-3207-426a-a78a-50ee11f3f9c1 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:06:50.166313 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56fb4da-3207-426a-a78a-50ee11f3f9c1 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:06:50.166627 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56fb4da-3207-426a-a78a-50ee11f3f9c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:06:50.187302 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-f56fb4da-3207-426a-a78a-50ee11f3f9c1 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:06:50.188818 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-f56fb4da-3207-426a-a78a-50ee11f3f9c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:06:50.197343 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1225/2444] 10.222.0.13 () {58 vars in 1016 bytes} [Tue Oct 4 12:06:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:06:50.217952 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea4c86f-304b-4d20-a3e8-48618c5ad316 service neutron] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:06:50.231937 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea4c86f-304b-4d20-a3e8-48618c5ad316 service neutron] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:06:50.237784 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c2ecf6-fa8e-4b87-8f04-69a727c83b3a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8e23d1d2fe24bdf9552e7c2f0ae3424', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:06:50.238393 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c2ecf6-fa8e-4b87-8f04-69a727c83b3a service nova] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:06:50.238671 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c2ecf6-fa8e-4b87-8f04-69a727c83b3a service nova] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:06:50.238938 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c2ecf6-fa8e-4b87-8f04-69a727c83b3a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:06:50.247647 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c2ecf6-fa8e-4b87-8f04-69a727c83b3a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:06:50.249254 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c2ecf6-fa8e-4b87-8f04-69a727c83b3a service nova] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:06:50.259641 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1220/2445] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:06:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:06:55.609546 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cf0001-d854-44e0-b210-5dba44e48151 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:06:55.610078 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cf0001-d854-44e0-b210-5dba44e48151 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:06:55.610206 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cf0001-d854-44e0-b210-5dba44e48151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:06:55.630490 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-a2cf0001-d854-44e0-b210-5dba44e48151 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:06:55.631678 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-a2cf0001-d854-44e0-b210-5dba44e48151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:06:55.640162 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1226/2446] 10.222.0.13 () {58 vars in 1016 bytes} [Tue Oct 4 12:06:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:06:55.657573 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c2ecf6-fa8e-4b87-8f04-69a727c83b3a service nova] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:06:55.669381 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c2ecf6-fa8e-4b87-8f04-69a727c83b3a service nova] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:06:55.674880 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8c1b3a-2dbb-4e28-af12-f08d21a2f6af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8e23d1d2fe24bdf9552e7c2f0ae3424', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:06:55.675487 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8c1b3a-2dbb-4e28-af12-f08d21a2f6af service nova] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:06:55.675768 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8c1b3a-2dbb-4e28-af12-f08d21a2f6af service nova] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:06:55.676034 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8c1b3a-2dbb-4e28-af12-f08d21a2f6af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:06:55.685621 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8c1b3a-2dbb-4e28-af12-f08d21a2f6af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:06:55.687190 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8c1b3a-2dbb-4e28-af12-f08d21a2f6af service nova] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:06:55.692138 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:06:55.697273 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1221/2447] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:06:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:07:01.688561 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cf0001-d854-44e0-b210-5dba44e48151 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:07:01.701929 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cf0001-d854-44e0-b210-5dba44e48151 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:07:01.707525 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2819fea6-7112-4c13-9e55-62e7522b3426 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8e23d1d2fe24bdf9552e7c2f0ae3424', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:07:01.708131 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2819fea6-7112-4c13-9e55-62e7522b3426 service nova] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:07:01.708413 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2819fea6-7112-4c13-9e55-62e7522b3426 service nova] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:07:01.708723 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2819fea6-7112-4c13-9e55-62e7522b3426 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:07:01.710540 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-2819fea6-7112-4c13-9e55-62e7522b3426 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:07:01.724868 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2819fea6-7112-4c13-9e55-62e7522b3426 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:07:01.726634 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2819fea6-7112-4c13-9e55-62e7522b3426 service nova] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:07:01.739586 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1227/2448] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:07:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:07:07.934096 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc29888-a7ff-4e9e-95d6-122e0ea44bfe None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:07:07.934580 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc29888-a7ff-4e9e-95d6-122e0ea44bfe None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:07:07.934700 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc29888-a7ff-4e9e-95d6-122e0ea44bfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:07:07.954647 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-fcc29888-a7ff-4e9e-95d6-122e0ea44bfe None None] MFA Rules not processed for user `06d1850ea27c483780eed67ede9cc1e3`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:07:07.956444 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-fcc29888-a7ff-4e9e-95d6-122e0ea44bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:07:08.012089 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1222/2449] 10.222.0.59 () {58 vars in 1009 bytes} [Tue Oct 4 12:07:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:07:08.054055 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2819fea6-7112-4c13-9e55-62e7522b3426 service nova] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:07:08.059952 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-2819fea6-7112-4c13-9e55-62e7522b3426 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:07:08.060418 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=70 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:07:08.130166 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2819fea6-7112-4c13-9e55-62e7522b3426 service nova] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:07:08.135888 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58b8137-2738-45eb-bfee-34e78db783f7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1605c3e03b7a4bcba4e19f0d92c671bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:07:08.136494 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58b8137-2738-45eb-bfee-34e78db783f7 service swift] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:07:08.136802 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58b8137-2738-45eb-bfee-34e78db783f7 service swift] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:07:08.137074 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58b8137-2738-45eb-bfee-34e78db783f7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:07:08.145113 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58b8137-2738-45eb-bfee-34e78db783f7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:07:08.146682 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58b8137-2738-45eb-bfee-34e78db783f7 service swift] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:07:08.155960 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1228/2450] 10.222.0.59 () {60 vars in 1384 bytes} [Tue Oct 4 12:07:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 12:07:18.005194 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=25 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:07:18.152661 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=31 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:07:23.360413 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc29888-a7ff-4e9e-95d6-122e0ea44bfe None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:07:23.373774 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc29888-a7ff-4e9e-95d6-122e0ea44bfe None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:07:23.379287 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207864a1-6643-47fb-84e9-b9764ca9c91d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8e23d1d2fe24bdf9552e7c2f0ae3424', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:07:23.379892 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207864a1-6643-47fb-84e9-b9764ca9c91d service nova] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:07:23.387193 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207864a1-6643-47fb-84e9-b9764ca9c91d service nova] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:07:23.387193 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207864a1-6643-47fb-84e9-b9764ca9c91d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:07:23.387193 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-207864a1-6643-47fb-84e9-b9764ca9c91d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:07:23.394425 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207864a1-6643-47fb-84e9-b9764ca9c91d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:07:23.396012 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207864a1-6643-47fb-84e9-b9764ca9c91d service nova] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:07:23.407223 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1223/2451] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:07:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:07:26.705226 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58b8137-2738-45eb-bfee-34e78db783f7 service swift] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:07:26.712644 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58b8137-2738-45eb-bfee-34e78db783f7 service swift] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:07:26.716371 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b7f0d3-6532-48cc-8fe5-6185583649e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7289515c5c44914a19daa439de98cb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:07:26.717003 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b7f0d3-6532-48cc-8fe5-6185583649e1 service neutron] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:07:26.717281 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b7f0d3-6532-48cc-8fe5-6185583649e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:07:26.717553 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b7f0d3-6532-48cc-8fe5-6185583649e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:07:26.719302 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-e8b7f0d3-6532-48cc-8fe5-6185583649e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:07:26.730102 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b7f0d3-6532-48cc-8fe5-6185583649e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:07:26.731551 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b7f0d3-6532-48cc-8fe5-6185583649e1 service neutron] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:07:26.740388 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1229/2452] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:07:26 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:07:27.366280 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a3a106-7109-48fd-bdfc-d423e3bcfb3a None None] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:07:27.366911 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a3a106-7109-48fd-bdfc-d423e3bcfb3a None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:07:27.366911 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a3a106-7109-48fd-bdfc-d423e3bcfb3a None None] PATH_INFO: `/` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:07:27.368289 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1224/2453] 10.222.0.59 () {54 vars in 921 bytes} [Tue Oct 4 12:07:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:07:27.373051 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d35763-f6bc-410e-bf8a-b3489b35676f None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:07:27.373362 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d35763-f6bc-410e-bf8a-b3489b35676f None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:07:27.373695 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d35763-f6bc-410e-bf8a-b3489b35676f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:07:27.393213 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-36d35763-f6bc-410e-bf8a-b3489b35676f None None] MFA Rules not processed for user `a8e23d1d2fe24bdf9552e7c2f0ae3424`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:07:27.394412 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-36d35763-f6bc-410e-bf8a-b3489b35676f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:07:27.404340 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1230/2454] 10.222.0.59 () {58 vars in 1018 bytes} [Tue Oct 4 12:07:27 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:07:27.416581 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a3a106-7109-48fd-bdfc-d423e3bcfb3a None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:07:27.418325 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-39a3a106-7109-48fd-bdfc-d423e3bcfb3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:07:27.480051 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a3a106-7109-48fd-bdfc-d423e3bcfb3a None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:07:27.483540 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940c6f8b-90cc-44b9-92ad-88154efa7515 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd516d0755be84b7293156625df1b13b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:07:27.484161 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940c6f8b-90cc-44b9-92ad-88154efa7515 service glance] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:07:27.484448 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940c6f8b-90cc-44b9-92ad-88154efa7515 service glance] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:07:27.484755 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940c6f8b-90cc-44b9-92ad-88154efa7515 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:07:27.495274 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940c6f8b-90cc-44b9-92ad-88154efa7515 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:07:27.496728 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940c6f8b-90cc-44b9-92ad-88154efa7515 service glance] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:07:27.512123 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1225/2455] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:07:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:07:30.905456 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4032f4e5-72b5-46c0-ba18-1e6d78081be6 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:07:30.905937 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4032f4e5-72b5-46c0-ba18-1e6d78081be6 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:07:30.906367 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4032f4e5-72b5-46c0-ba18-1e6d78081be6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:07:30.928711 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-4032f4e5-72b5-46c0-ba18-1e6d78081be6 None None] MFA Rules not processed for user `06d1850ea27c483780eed67ede9cc1e3`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:07:30.930094 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-4032f4e5-72b5-46c0-ba18-1e6d78081be6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:07:30.938057 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1231/2456] 10.222.0.59 () {58 vars in 1009 bytes} [Tue Oct 4 12:07:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 12:07:30.950864 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940c6f8b-90cc-44b9-92ad-88154efa7515 service glance] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:07:30.963343 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940c6f8b-90cc-44b9-92ad-88154efa7515 service glance] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:07:30.968423 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62092f3c-0c69-461f-8e1f-7ae563600a3e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1605c3e03b7a4bcba4e19f0d92c671bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:07:30.970592 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62092f3c-0c69-461f-8e1f-7ae563600a3e service swift] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:07:30.970592 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62092f3c-0c69-461f-8e1f-7ae563600a3e service swift] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:07:30.970592 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62092f3c-0c69-461f-8e1f-7ae563600a3e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:07:30.978426 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62092f3c-0c69-461f-8e1f-7ae563600a3e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:07:30.980025 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62092f3c-0c69-461f-8e1f-7ae563600a3e service swift] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:07:30.989043 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1226/2457] 10.222.0.59 () {60 vars in 1384 bytes} [Tue Oct 4 12:07:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 12:07:35.587082 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4032f4e5-72b5-46c0-ba18-1e6d78081be6 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:07:35.589421 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-4032f4e5-72b5-46c0-ba18-1e6d78081be6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:07:35.605639 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4032f4e5-72b5-46c0-ba18-1e6d78081be6 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:07:35.610818 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869d01df-a6bb-4458-97ca-be36df0fa287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:07:35.611469 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869d01df-a6bb-4458-97ca-be36df0fa287 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:07:35.611751 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869d01df-a6bb-4458-97ca-be36df0fa287 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:07:35.612276 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869d01df-a6bb-4458-97ca-be36df0fa287 admin admin] PATH_INFO: `/v3/users/92bb1140da0340ff832a12a09f4818c8` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:07:35.613781 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869d01df-a6bb-4458-97ca-be36df0fa287 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92bb1140da0340ff832a12a09f4818c8)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:07:35.615943 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869d01df-a6bb-4458-97ca-be36df0fa287 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:07:36.337553 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-869d01df-a6bb-4458-97ca-be36df0fa287 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92bb1140da0340ff832a12a09f4818c8'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:07:36.346761 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-869d01df-a6bb-4458-97ca-be36df0fa287 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92bb1140da0340ff832a12a09f4818c8'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:07:36.347610 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-869d01df-a6bb-4458-97ca-be36df0fa287 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92bb1140da0340ff832a12a09f4818c8'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:07:36.348215 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-869d01df-a6bb-4458-97ca-be36df0fa287 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92bb1140da0340ff832a12a09f4818c8'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:07:36.433571 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-869d01df-a6bb-4458-97ca-be36df0fa287 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92bb1140da0340ff832a12a09f4818c8'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:07:36.455454 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1232/2458] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Oct 4 12:07:35 2022] DELETE /identity/v3/users/92bb1140da0340ff832a12a09f4818c8 => generated 0 bytes in 869 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:07:36.818275 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62092f3c-0c69-461f-8e1f-7ae563600a3e service swift] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:07:36.832818 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62092f3c-0c69-461f-8e1f-7ae563600a3e service swift] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:07:36.903356 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a8a0bb-bf37-4921-8fb8-3b031ae68aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:07:36.904151 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a8a0bb-bf37-4921-8fb8-3b031ae68aca admin admin] REQUEST_METHOD: `DELETE` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:07:36.904434 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a8a0bb-bf37-4921-8fb8-3b031ae68aca admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:07:36.904737 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a8a0bb-bf37-4921-8fb8-3b031ae68aca admin admin] PATH_INFO: `/v3/projects/e202415265a64e2eb6295962d2fb81e7` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:07:36.905969 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a8a0bb-bf37-4921-8fb8-3b031ae68aca admin admin] RBAC: Authorizing `identity:delete_project(project_id=e202415265a64e2eb6295962d2fb81e7)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:07:36.907994 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a8a0bb-bf37-4921-8fb8-3b031ae68aca admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:07:37.084038 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-62a8a0bb-bf37-4921-8fb8-3b031ae68aca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e202415265a64e2eb6295962d2fb81e7', 'request_id': 'req-62a8a0bb-bf37-4921-8fb8-3b031ae68aca'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:07:37.091289 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-62a8a0bb-bf37-4921-8fb8-3b031ae68aca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e202415265a64e2eb6295962d2fb81e7', 'request_id': 'req-62a8a0bb-bf37-4921-8fb8-3b031ae68aca'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:07:37.242924 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-62a8a0bb-bf37-4921-8fb8-3b031ae68aca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e202415265a64e2eb6295962d2fb81e7', 'request_id': 'req-62a8a0bb-bf37-4921-8fb8-3b031ae68aca'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:07:37.265314 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-62a8a0bb-bf37-4921-8fb8-3b031ae68aca admin admin] The token cache is being invalidate because project e202415265a64e2eb6295962d2fb81e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:07:37.265314 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-62a8a0bb-bf37-4921-8fb8-3b031ae68aca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:07:37.265314 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-62a8a0bb-bf37-4921-8fb8-3b031ae68aca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:07:37.265314 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1227/2459] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Oct 4 12:07:36 2022] DELETE /identity/v3/projects/e202415265a64e2eb6295962d2fb81e7 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:07:40.300187 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869d01df-a6bb-4458-97ca-be36df0fa287 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:07:40.301786 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-869d01df-a6bb-4458-97ca-be36df0fa287 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:07:40.359712 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869d01df-a6bb-4458-97ca-be36df0fa287 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:07:40.411376 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44568a23-6285-470b-bd8e-b7d40cffb25c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7289515c5c44914a19daa439de98cb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:07:40.411985 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44568a23-6285-470b-bd8e-b7d40cffb25c service neutron] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:07:40.412289 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44568a23-6285-470b-bd8e-b7d40cffb25c service neutron] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:07:40.412621 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44568a23-6285-470b-bd8e-b7d40cffb25c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:07:40.415219 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-44568a23-6285-470b-bd8e-b7d40cffb25c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:07:40.429540 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:07:40.474343 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44568a23-6285-470b-bd8e-b7d40cffb25c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:07:40.476545 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44568a23-6285-470b-bd8e-b7d40cffb25c service neutron] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:07:40.485911 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1233/2460] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:07:40 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:07:41.827558 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a8a0bb-bf37-4921-8fb8-3b031ae68aca admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:07:41.829007 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-62a8a0bb-bf37-4921-8fb8-3b031ae68aca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:07:41.846289 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:07:41.946147 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a8a0bb-bf37-4921-8fb8-3b031ae68aca admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:07:41.952131 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12ee9bd-195b-40f9-bcbf-4c44a660acf8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8e23d1d2fe24bdf9552e7c2f0ae3424', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:07:41.952798 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12ee9bd-195b-40f9-bcbf-4c44a660acf8 service nova] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:07:41.953176 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12ee9bd-195b-40f9-bcbf-4c44a660acf8 service nova] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:07:41.953457 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12ee9bd-195b-40f9-bcbf-4c44a660acf8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:07:41.955256 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-b12ee9bd-195b-40f9-bcbf-4c44a660acf8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:07:41.968342 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12ee9bd-195b-40f9-bcbf-4c44a660acf8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:07:41.970514 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12ee9bd-195b-40f9-bcbf-4c44a660acf8 service nova] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:07:41.984488 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1228/2461] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:07:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:07:45.634982 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a58d0a-f6d7-4b4f-921c-ca0f635305f7 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:07:45.635529 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a58d0a-f6d7-4b4f-921c-ca0f635305f7 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:07:45.635529 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a58d0a-f6d7-4b4f-921c-ca0f635305f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:07:45.655708 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-31a58d0a-f6d7-4b4f-921c-ca0f635305f7 None None] MFA Rules not processed for user `06d1850ea27c483780eed67ede9cc1e3`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:07:45.656990 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-31a58d0a-f6d7-4b4f-921c-ca0f635305f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:07:45.717185 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1234/2462] 10.222.0.59 () {58 vars in 967 bytes} [Tue Oct 4 12:07:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:07:45.731714 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12ee9bd-195b-40f9-bcbf-4c44a660acf8 service nova] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:07:45.734312 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-b12ee9bd-195b-40f9-bcbf-4c44a660acf8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:07:45.813456 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12ee9bd-195b-40f9-bcbf-4c44a660acf8 service nova] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:07:45.818750 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2767258-2c1b-461d-a82a-64dee289ee9d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1605c3e03b7a4bcba4e19f0d92c671bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:07:45.819940 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2767258-2c1b-461d-a82a-64dee289ee9d service swift] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:07:45.820223 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2767258-2c1b-461d-a82a-64dee289ee9d service swift] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:07:45.820498 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2767258-2c1b-461d-a82a-64dee289ee9d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:07:45.829778 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2767258-2c1b-461d-a82a-64dee289ee9d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:07:45.831625 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2767258-2c1b-461d-a82a-64dee289ee9d service swift] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:07:45.848679 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1229/2463] 10.222.0.59 () {60 vars in 1384 bytes} [Tue Oct 4 12:07:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 04 12:07:48.676479 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a58d0a-f6d7-4b4f-921c-ca0f635305f7 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:07:48.677975 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-31a58d0a-f6d7-4b4f-921c-ca0f635305f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:07:48.690819 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a58d0a-f6d7-4b4f-921c-ca0f635305f7 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:07:48.694552 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ef4856-6426-4d36-91fd-3d8a8925dfad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7289515c5c44914a19daa439de98cb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:07:48.695339 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ef4856-6426-4d36-91fd-3d8a8925dfad service neutron] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:07:48.695614 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ef4856-6426-4d36-91fd-3d8a8925dfad service neutron] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:07:48.696022 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ef4856-6426-4d36-91fd-3d8a8925dfad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:07:48.697768 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-54ef4856-6426-4d36-91fd-3d8a8925dfad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:07:48.787055 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ef4856-6426-4d36-91fd-3d8a8925dfad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:07:48.787691 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ef4856-6426-4d36-91fd-3d8a8925dfad service neutron] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:07:48.812673 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1235/2464] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:07:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:07:53.154140 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2767258-2c1b-461d-a82a-64dee289ee9d service swift] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:07:53.155968 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-d2767258-2c1b-461d-a82a-64dee289ee9d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:07:53.244105 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2767258-2c1b-461d-a82a-64dee289ee9d service swift] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:07:53.249051 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec01db3-faff-437b-8056-a610c746929b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be119968b02440adbbbc85c553077b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:07:53.249587 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec01db3-faff-437b-8056-a610c746929b service placement] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:07:53.249865 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec01db3-faff-437b-8056-a610c746929b service placement] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:07:53.250192 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec01db3-faff-437b-8056-a610c746929b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:07:53.251873 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-aec01db3-faff-437b-8056-a610c746929b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:07:53.263541 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec01db3-faff-437b-8056-a610c746929b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:07:53.265145 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec01db3-faff-437b-8056-a610c746929b service placement] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:07:53.275518 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1230/2465] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:07:53 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:07:54.337118 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ef4856-6426-4d36-91fd-3d8a8925dfad service neutron] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:07:54.338948 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-54ef4856-6426-4d36-91fd-3d8a8925dfad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:07:54.349818 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ef4856-6426-4d36-91fd-3d8a8925dfad service neutron] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:07:54.354027 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3babc5-9eee-4704-83b6-ba691b764224 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7289515c5c44914a19daa439de98cb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:07:54.354631 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3babc5-9eee-4704-83b6-ba691b764224 service neutron] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:07:54.354914 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3babc5-9eee-4704-83b6-ba691b764224 service neutron] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:07:54.355185 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3babc5-9eee-4704-83b6-ba691b764224 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:07:54.357075 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-5c3babc5-9eee-4704-83b6-ba691b764224 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:07:54.370725 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3babc5-9eee-4704-83b6-ba691b764224 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:07:54.372302 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3babc5-9eee-4704-83b6-ba691b764224 service neutron] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:07:54.383090 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1236/2466] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:07:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:07:57.893804 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec01db3-faff-437b-8056-a610c746929b service placement] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:07:57.893804 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-aec01db3-faff-437b-8056-a610c746929b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:07:57.895639 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec01db3-faff-437b-8056-a610c746929b service placement] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:07:57.900540 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9811983-dc36-4828-ab0b-5afb7cee3a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:07:57.901240 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9811983-dc36-4828-ab0b-5afb7cee3a21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:07:57.901520 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9811983-dc36-4828-ab0b-5afb7cee3a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:07:57.901796 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9811983-dc36-4828-ab0b-5afb7cee3a21 admin admin] PATH_INFO: `/v3/users/a0df8dcc8c554e5ca9cdd5b3d5d71cdf` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:07:57.902952 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9811983-dc36-4828-ab0b-5afb7cee3a21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0df8dcc8c554e5ca9cdd5b3d5d71cdf)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:07:57.904999 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9811983-dc36-4828-ab0b-5afb7cee3a21 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:07:57.909968 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:07:58.253103 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-a9811983-dc36-4828-ab0b-5afb7cee3a21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0df8dcc8c554e5ca9cdd5b3d5d71cdf'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:07:58.261221 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-a9811983-dc36-4828-ab0b-5afb7cee3a21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0df8dcc8c554e5ca9cdd5b3d5d71cdf'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:07:58.261921 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-a9811983-dc36-4828-ab0b-5afb7cee3a21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0df8dcc8c554e5ca9cdd5b3d5d71cdf'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:07:58.263663 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-a9811983-dc36-4828-ab0b-5afb7cee3a21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0df8dcc8c554e5ca9cdd5b3d5d71cdf'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:07:58.353144 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-a9811983-dc36-4828-ab0b-5afb7cee3a21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0df8dcc8c554e5ca9cdd5b3d5d71cdf'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:07:58.371499 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1231/2467] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Oct 4 12:07:57 2022] DELETE /identity/v3/users/a0df8dcc8c554e5ca9cdd5b3d5d71cdf => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:07:58.710810 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3babc5-9eee-4704-83b6-ba691b764224 service neutron] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:07:58.726248 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3babc5-9eee-4704-83b6-ba691b764224 service neutron] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:07:58.797734 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:07:58.823407 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b68f261-2451-4766-a01e-c48cd57ae39a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:07:58.825284 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b68f261-2451-4766-a01e-c48cd57ae39a admin admin] REQUEST_METHOD: `DELETE` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:07:58.825810 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b68f261-2451-4766-a01e-c48cd57ae39a admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:07:58.826255 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7ef6f7-5554-47b4-b2ba-312c4f80c90c None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:07:58.826532 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b68f261-2451-4766-a01e-c48cd57ae39a admin admin] PATH_INFO: `/v3/projects/d8384f08ca14447395a91459b34a2099` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:07:58.826681 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7ef6f7-5554-47b4-b2ba-312c4f80c90c None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:07:58.827263 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7ef6f7-5554-47b4-b2ba-312c4f80c90c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:07:58.828421 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b68f261-2451-4766-a01e-c48cd57ae39a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8384f08ca14447395a91459b34a2099)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:07:58.830932 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b68f261-2451-4766-a01e-c48cd57ae39a admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:07:58.856568 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-3a7ef6f7-5554-47b4-b2ba-312c4f80c90c None None] MFA Rules not processed for user `06d1850ea27c483780eed67ede9cc1e3`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:07:58.857869 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-3a7ef6f7-5554-47b4-b2ba-312c4f80c90c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:07:58.924279 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1232/2468] 10.222.0.59 () {58 vars in 967 bytes} [Tue Oct 4 12:07:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:07:58.940435 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7ef6f7-5554-47b4-b2ba-312c4f80c90c None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:07:58.942885 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-3a7ef6f7-5554-47b4-b2ba-312c4f80c90c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:07:59.035273 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-2b68f261-2451-4766-a01e-c48cd57ae39a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8384f08ca14447395a91459b34a2099', 'request_id': 'req-2b68f261-2451-4766-a01e-c48cd57ae39a'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:07:59.062416 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7ef6f7-5554-47b4-b2ba-312c4f80c90c None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:07:59.093810 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:07:59.126495 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c480b5ed-1440-48bf-b58b-0e57fc37a802 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1605c3e03b7a4bcba4e19f0d92c671bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:07:59.127122 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c480b5ed-1440-48bf-b58b-0e57fc37a802 service swift] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:07:59.127400 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c480b5ed-1440-48bf-b58b-0e57fc37a802 service swift] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:07:59.127681 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c480b5ed-1440-48bf-b58b-0e57fc37a802 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:07:59.153073 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-2b68f261-2451-4766-a01e-c48cd57ae39a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8384f08ca14447395a91459b34a2099', 'request_id': 'req-2b68f261-2451-4766-a01e-c48cd57ae39a'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:07:59.161429 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-2b68f261-2451-4766-a01e-c48cd57ae39a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8384f08ca14447395a91459b34a2099', 'request_id': 'req-2b68f261-2451-4766-a01e-c48cd57ae39a'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:07:59.186636 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-2b68f261-2451-4766-a01e-c48cd57ae39a admin admin] The token cache is being invalidate because project d8384f08ca14447395a91459b34a2099 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:07:59.187158 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-2b68f261-2451-4766-a01e-c48cd57ae39a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:07:59.188412 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-2b68f261-2451-4766-a01e-c48cd57ae39a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:07:59.190734 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1237/2469] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Oct 4 12:07:58 2022] DELETE /identity/v3/projects/d8384f08ca14447395a91459b34a2099 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:07:59.190957 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c480b5ed-1440-48bf-b58b-0e57fc37a802 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:07:59.192566 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c480b5ed-1440-48bf-b58b-0e57fc37a802 service swift] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:07:59.196103 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b68f261-2451-4766-a01e-c48cd57ae39a admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:07:59.197967 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-2b68f261-2451-4766-a01e-c48cd57ae39a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:07:59.202286 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1233/2470] 10.222.0.59 () {60 vars in 1384 bytes} [Tue Oct 4 12:07:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 12:07:59.270467 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b68f261-2451-4766-a01e-c48cd57ae39a admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:07:59.276119 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b86145c-2182-4656-a839-28b161415854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:07:59.276440 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b86145c-2182-4656-a839-28b161415854 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:07:59.276765 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b86145c-2182-4656-a839-28b161415854 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:07:59.277045 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b86145c-2182-4656-a839-28b161415854 admin admin] PATH_INFO: `/v3/users/a120ff91fbf9410c98c5b9fa566704f2` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:07:59.278520 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b86145c-2182-4656-a839-28b161415854 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a120ff91fbf9410c98c5b9fa566704f2)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:07:59.280437 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b86145c-2182-4656-a839-28b161415854 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:07:59.324489 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c480b5ed-1440-48bf-b58b-0e57fc37a802 service swift] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:07:59.326972 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-c480b5ed-1440-48bf-b58b-0e57fc37a802 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:07:59.344790 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c480b5ed-1440-48bf-b58b-0e57fc37a802 service swift] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:07:59.349025 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8f988a-60a7-4dfa-91f6-20e8b0f4d6c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:07:59.349872 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8f988a-60a7-4dfa-91f6-20e8b0f4d6c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:07:59.350238 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8f988a-60a7-4dfa-91f6-20e8b0f4d6c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:07:59.350513 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8f988a-60a7-4dfa-91f6-20e8b0f4d6c6 admin admin] PATH_INFO: `/v3/users/74861e3dd6e14d999aeae1f057b24582` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:07:59.352483 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8f988a-60a7-4dfa-91f6-20e8b0f4d6c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74861e3dd6e14d999aeae1f057b24582)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:07:59.354430 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8f988a-60a7-4dfa-91f6-20e8b0f4d6c6 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:07:59.475910 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-7b86145c-2182-4656-a839-28b161415854 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a120ff91fbf9410c98c5b9fa566704f2'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:07:59.483546 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-7b86145c-2182-4656-a839-28b161415854 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a120ff91fbf9410c98c5b9fa566704f2'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:07:59.484245 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-7b86145c-2182-4656-a839-28b161415854 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a120ff91fbf9410c98c5b9fa566704f2'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:07:59.488290 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-7b86145c-2182-4656-a839-28b161415854 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a120ff91fbf9410c98c5b9fa566704f2'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:07:59.662253 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-7b86145c-2182-4656-a839-28b161415854 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a120ff91fbf9410c98c5b9fa566704f2'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:07:59.671717 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:07:59.676702 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-bc8f988a-60a7-4dfa-91f6-20e8b0f4d6c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74861e3dd6e14d999aeae1f057b24582'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:07:59.682396 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1238/2471] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Oct 4 12:07:59 2022] DELETE /identity/v3/users/a120ff91fbf9410c98c5b9fa566704f2 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:07:59.684717 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-bc8f988a-60a7-4dfa-91f6-20e8b0f4d6c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74861e3dd6e14d999aeae1f057b24582'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:07:59.685391 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-bc8f988a-60a7-4dfa-91f6-20e8b0f4d6c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74861e3dd6e14d999aeae1f057b24582'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:07:59.686002 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-bc8f988a-60a7-4dfa-91f6-20e8b0f4d6c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74861e3dd6e14d999aeae1f057b24582'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:07:59.787166 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-bc8f988a-60a7-4dfa-91f6-20e8b0f4d6c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74861e3dd6e14d999aeae1f057b24582'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:07:59.810456 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1234/2472] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Oct 4 12:07:59 2022] DELETE /identity/v3/users/74861e3dd6e14d999aeae1f057b24582 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:07:59.963566 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b86145c-2182-4656-a839-28b161415854 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:07:59.965242 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-7b86145c-2182-4656-a839-28b161415854 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:08:00.061698 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b86145c-2182-4656-a839-28b161415854 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:00.135724 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac01b93a-a4ac-4917-aa4c-00f1562ca645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:00.136554 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac01b93a-a4ac-4917-aa4c-00f1562ca645 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:00.136731 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac01b93a-a4ac-4917-aa4c-00f1562ca645 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:00.136989 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac01b93a-a4ac-4917-aa4c-00f1562ca645 admin admin] PATH_INFO: `/v3/projects/08b1a97d2ba640d48ad46cc8ce005a80` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:00.138368 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac01b93a-a4ac-4917-aa4c-00f1562ca645 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08b1a97d2ba640d48ad46cc8ce005a80)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:00.140333 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac01b93a-a4ac-4917-aa4c-00f1562ca645 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:00.282640 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-ac01b93a-a4ac-4917-aa4c-00f1562ca645 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08b1a97d2ba640d48ad46cc8ce005a80', 'request_id': 'req-ac01b93a-a4ac-4917-aa4c-00f1562ca645'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:00.362436 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8f988a-60a7-4dfa-91f6-20e8b0f4d6c6 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:00.364046 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-bc8f988a-60a7-4dfa-91f6-20e8b0f4d6c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:08:00.387129 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8f988a-60a7-4dfa-91f6-20e8b0f4d6c6 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:00.403903 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-ac01b93a-a4ac-4917-aa4c-00f1562ca645 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08b1a97d2ba640d48ad46cc8ce005a80', 'request_id': 'req-ac01b93a-a4ac-4917-aa4c-00f1562ca645'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:00.415796 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-ac01b93a-a4ac-4917-aa4c-00f1562ca645 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08b1a97d2ba640d48ad46cc8ce005a80', 'request_id': 'req-ac01b93a-a4ac-4917-aa4c-00f1562ca645'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:00.429804 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-ac01b93a-a4ac-4917-aa4c-00f1562ca645 admin admin] The token cache is being invalidate because project 08b1a97d2ba640d48ad46cc8ce005a80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:08:00.430186 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-ac01b93a-a4ac-4917-aa4c-00f1562ca645 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:00.431173 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-ac01b93a-a4ac-4917-aa4c-00f1562ca645 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:00.433081 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1239/2473] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Oct 4 12:07:59 2022] DELETE /identity/v3/projects/08b1a97d2ba640d48ad46cc8ce005a80 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:08:00.460557 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:08:00.478673 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27fda24-2e00-4e37-9348-de0d7dab2a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:00.479624 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27fda24-2e00-4e37-9348-de0d7dab2a0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:00.480104 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27fda24-2e00-4e37-9348-de0d7dab2a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:00.480573 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27fda24-2e00-4e37-9348-de0d7dab2a0e admin admin] PATH_INFO: `/v3/projects/3938a89250d746778d4da015b5f552af` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:00.482149 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27fda24-2e00-4e37-9348-de0d7dab2a0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3938a89250d746778d4da015b5f552af)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:00.484497 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27fda24-2e00-4e37-9348-de0d7dab2a0e admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:00.666808 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-c27fda24-2e00-4e37-9348-de0d7dab2a0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3938a89250d746778d4da015b5f552af', 'request_id': 'req-c27fda24-2e00-4e37-9348-de0d7dab2a0e'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:00.673758 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-c27fda24-2e00-4e37-9348-de0d7dab2a0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3938a89250d746778d4da015b5f552af', 'request_id': 'req-c27fda24-2e00-4e37-9348-de0d7dab2a0e'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:00.833304 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-c27fda24-2e00-4e37-9348-de0d7dab2a0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3938a89250d746778d4da015b5f552af', 'request_id': 'req-c27fda24-2e00-4e37-9348-de0d7dab2a0e'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:00.844587 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-c27fda24-2e00-4e37-9348-de0d7dab2a0e admin admin] The token cache is being invalidate because project 3938a89250d746778d4da015b5f552af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:08:00.844902 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-c27fda24-2e00-4e37-9348-de0d7dab2a0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:00.845515 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-c27fda24-2e00-4e37-9348-de0d7dab2a0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:00.846987 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1235/2474] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Oct 4 12:08:00 2022] DELETE /identity/v3/projects/3938a89250d746778d4da015b5f552af => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:08:00.852965 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695ca353-f39f-4b08-9d5b-51cbe27641eb None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:00.853255 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695ca353-f39f-4b08-9d5b-51cbe27641eb None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:00.853532 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695ca353-f39f-4b08-9d5b-51cbe27641eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:00.874746 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-695ca353-f39f-4b08-9d5b-51cbe27641eb None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:08:00.876106 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-695ca353-f39f-4b08-9d5b-51cbe27641eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:08:00.902372 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:08:00.941778 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1240/2475] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:08:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 12:08:00.947422 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c938ee6c-898d-4ed1-9557-18a69d7f4c4a None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:00.947728 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c938ee6c-898d-4ed1-9557-18a69d7f4c4a None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:00.947989 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c938ee6c-898d-4ed1-9557-18a69d7f4c4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:00.969255 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-c938ee6c-898d-4ed1-9557-18a69d7f4c4a None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:08:00.970520 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-c938ee6c-898d-4ed1-9557-18a69d7f4c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:08:00.984521 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1236/2476] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:08:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:08:00.989149 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695ca353-f39f-4b08-9d5b-51cbe27641eb None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:00.999707 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695ca353-f39f-4b08-9d5b-51cbe27641eb None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:01.004310 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7fb8dc-6038-4d88-8f75-841daa8228ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:01.004936 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7fb8dc-6038-4d88-8f75-841daa8228ba admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:01.010771 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7fb8dc-6038-4d88-8f75-841daa8228ba admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:01.010771 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7fb8dc-6038-4d88-8f75-841daa8228ba admin admin] PATH_INFO: `/v3/domains` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:01.010771 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7fb8dc-6038-4d88-8f75-841daa8228ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:08:01.010771 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7fb8dc-6038-4d88-8f75-841daa8228ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:01.010771 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7fb8dc-6038-4d88-8f75-841daa8228ba admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:01.020063 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1241/2477] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Oct 4 12:08:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:08:01.024537 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c938ee6c-898d-4ed1-9557-18a69d7f4c4a None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:01.033693 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c938ee6c-898d-4ed1-9557-18a69d7f4c4a None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:01.039403 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6344483d-26d8-4422-8c39-96976d554ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:01.040004 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6344483d-26d8-4422-8c39-96976d554ba5 admin admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:01.040284 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6344483d-26d8-4422-8c39-96976d554ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:01.040556 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6344483d-26d8-4422-8c39-96976d554ba5 admin admin] PATH_INFO: `/v3/projects` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:01.041219 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6344483d-26d8-4422-8c39-96976d554ba5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:01.043098 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6344483d-26d8-4422-8c39-96976d554ba5 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:01.215879 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1237/2478] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Oct 4 12:08:01 2022] POST /identity/v3/projects => generated 405 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:08:01.217321 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7fb8dc-6038-4d88-8f75-841daa8228ba admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:01.228694 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7fb8dc-6038-4d88-8f75-841daa8228ba admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:01.298363 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ff89c2-04fb-48e1-9426-99c967e648d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:01.298992 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ff89c2-04fb-48e1-9426-99c967e648d4 admin admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:01.299276 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ff89c2-04fb-48e1-9426-99c967e648d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:01.299554 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ff89c2-04fb-48e1-9426-99c967e648d4 admin admin] PATH_INFO: `/v3/users` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:01.300175 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ff89c2-04fb-48e1-9426-99c967e648d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:01.302107 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ff89c2-04fb-48e1-9426-99c967e648d4 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:01.387355 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1242/2479] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Oct 4 12:08:01 2022] POST /identity/v3/users => generated 303 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:08:01.391591 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6344483d-26d8-4422-8c39-96976d554ba5 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:01.402961 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6344483d-26d8-4422-8c39-96976d554ba5 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:01.408922 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694db4ac-787b-42fa-a0b0-081fd11d6ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:01.409533 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694db4ac-787b-42fa-a0b0-081fd11d6ee1 admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:01.409812 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694db4ac-787b-42fa-a0b0-081fd11d6ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:01.410086 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694db4ac-787b-42fa-a0b0-081fd11d6ee1 admin admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:01.410726 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694db4ac-787b-42fa-a0b0-081fd11d6ee1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:01.413359 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694db4ac-787b-42fa-a0b0-081fd11d6ee1 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:01.424752 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1238/2480] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:08:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 12:08:01.428769 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ff89c2-04fb-48e1-9426-99c967e648d4 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:01.439041 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ff89c2-04fb-48e1-9426-99c967e648d4 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:01.444688 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d342ff9c-96d8-4689-bfdf-bfd34f2fb62d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:01.445698 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d342ff9c-96d8-4689-bfdf-bfd34f2fb62d admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:01.446232 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d342ff9c-96d8-4689-bfdf-bfd34f2fb62d admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:01.446593 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d342ff9c-96d8-4689-bfdf-bfd34f2fb62d admin admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:01.447411 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d342ff9c-96d8-4689-bfdf-bfd34f2fb62d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:01.449292 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d342ff9c-96d8-4689-bfdf-bfd34f2fb62d admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:01.460732 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1243/2481] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:08:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:08:01.465123 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694db4ac-787b-42fa-a0b0-081fd11d6ee1 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:01.476176 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694db4ac-787b-42fa-a0b0-081fd11d6ee1 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:01.480980 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b87f9b-ec83-4e39-8da6-e325215b463a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:01.481637 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b87f9b-ec83-4e39-8da6-e325215b463a admin admin] REQUEST_METHOD: `PUT` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:01.481914 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b87f9b-ec83-4e39-8da6-e325215b463a admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:01.483059 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b87f9b-ec83-4e39-8da6-e325215b463a admin admin] PATH_INFO: `/v3/projects/223ae7d4b605404a8b46f4b6cb933c13/users/2979885c400146bc84ce578c7363b0e0/roles/ab4307f3b7994c1c80036fa7db93b6b9` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:01.499773 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b87f9b-ec83-4e39-8da6-e325215b463a admin admin] RBAC: Authorizing `identity:create_grant(project_id=223ae7d4b605404a8b46f4b6cb933c13, user_id=2979885c400146bc84ce578c7363b0e0, role_id=ab4307f3b7994c1c80036fa7db93b6b9)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:01.502499 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b87f9b-ec83-4e39-8da6-e325215b463a admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:01.577769 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1239/2482] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Oct 4 12:08:01 2022] PUT /identity/v3/projects/223ae7d4b605404a8b46f4b6cb933c13/users/2979885c400146bc84ce578c7363b0e0/roles/ab4307f3b7994c1c80036fa7db93b6b9 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:08:01.588985 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a3e22b-2f59-45fe-a87c-d49bed00e5d5 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:01.589265 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a3e22b-2f59-45fe-a87c-d49bed00e5d5 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:01.589727 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a3e22b-2f59-45fe-a87c-d49bed00e5d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:01.619494 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-a4a3e22b-2f59-45fe-a87c-d49bed00e5d5 None None] MFA Rules not processed for user `2979885c400146bc84ce578c7363b0e0`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:08:01.621035 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-a4a3e22b-2f59-45fe-a87c-d49bed00e5d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:08:01.691474 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1244/2483] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:08:01 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:08:01.695799 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b87f9b-ec83-4e39-8da6-e325215b463a admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:01.760377 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b87f9b-ec83-4e39-8da6-e325215b463a admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:01.765225 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef60fc53-24d2-4704-9af5-30c362af0979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:01.765814 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef60fc53-24d2-4704-9af5-30c362af0979 admin admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:01.766094 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef60fc53-24d2-4704-9af5-30c362af0979 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:01.766374 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef60fc53-24d2-4704-9af5-30c362af0979 admin admin] PATH_INFO: `/v3/projects` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:01.767006 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef60fc53-24d2-4704-9af5-30c362af0979 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:01.768930 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef60fc53-24d2-4704-9af5-30c362af0979 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:01.785086 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:08:01.939845 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1240/2484] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Oct 4 12:08:01 2022] POST /identity/v3/projects => generated 403 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 12:08:01.940325 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a3e22b-2f59-45fe-a87c-d49bed00e5d5 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:01.955275 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a3e22b-2f59-45fe-a87c-d49bed00e5d5 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:01.980824 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:08:02.022759 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554df56b-4396-4dab-96c8-f8594994f744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:02.023464 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554df56b-4396-4dab-96c8-f8594994f744 admin admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:02.023692 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554df56b-4396-4dab-96c8-f8594994f744 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:02.023913 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554df56b-4396-4dab-96c8-f8594994f744 admin admin] PATH_INFO: `/v3/users` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:02.024556 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554df56b-4396-4dab-96c8-f8594994f744 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:02.026543 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554df56b-4396-4dab-96c8-f8594994f744 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:02.185930 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1245/2485] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Oct 4 12:08:01 2022] POST /identity/v3/users => generated 308 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 12:08:02.189994 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef60fc53-24d2-4704-9af5-30c362af0979 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:02.201004 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef60fc53-24d2-4704-9af5-30c362af0979 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:02.205657 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e73ef0-9067-4843-96a9-ab14d15dce73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:02.206224 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e73ef0-9067-4843-96a9-ab14d15dce73 admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:02.206500 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e73ef0-9067-4843-96a9-ab14d15dce73 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:02.206773 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e73ef0-9067-4843-96a9-ab14d15dce73 admin admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:02.207427 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e73ef0-9067-4843-96a9-ab14d15dce73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:02.209667 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e73ef0-9067-4843-96a9-ab14d15dce73 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:02.221788 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1241/2486] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:08:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 12:08:02.226247 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554df56b-4396-4dab-96c8-f8594994f744 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:02.237320 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554df56b-4396-4dab-96c8-f8594994f744 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:02.242172 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f11b2a-8cd6-42ac-b024-184b23f470b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:02.242843 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f11b2a-8cd6-42ac-b024-184b23f470b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:02.243120 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f11b2a-8cd6-42ac-b024-184b23f470b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:02.243389 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f11b2a-8cd6-42ac-b024-184b23f470b0 admin admin] PATH_INFO: `/v3/projects/f92196fb311349439337cdb25730de9a/users/66c0b9aeb76c4caf9a23071aa53300ae/roles/d6e7421d1ff9451c808004b818354550` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:02.261339 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f11b2a-8cd6-42ac-b024-184b23f470b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f92196fb311349439337cdb25730de9a, user_id=66c0b9aeb76c4caf9a23071aa53300ae, role_id=d6e7421d1ff9451c808004b818354550)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:02.264088 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f11b2a-8cd6-42ac-b024-184b23f470b0 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:02.334967 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1246/2487] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Oct 4 12:08:02 2022] PUT /identity/v3/projects/f92196fb311349439337cdb25730de9a/users/66c0b9aeb76c4caf9a23071aa53300ae/roles/d6e7421d1ff9451c808004b818354550 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:08:02.339121 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e73ef0-9067-4843-96a9-ab14d15dce73 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:02.349995 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e73ef0-9067-4843-96a9-ab14d15dce73 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:02.409331 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f880f39-98e4-4e7e-bb32-8f7600cfbd49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:02.410055 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f880f39-98e4-4e7e-bb32-8f7600cfbd49 admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:02.410415 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f880f39-98e4-4e7e-bb32-8f7600cfbd49 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:02.410760 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f880f39-98e4-4e7e-bb32-8f7600cfbd49 admin admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:02.411483 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f880f39-98e4-4e7e-bb32-8f7600cfbd49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:02.413337 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f880f39-98e4-4e7e-bb32-8f7600cfbd49 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:02.423840 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1242/2488] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:08:02 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:08:02.428085 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f11b2a-8cd6-42ac-b024-184b23f470b0 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:02.438766 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f11b2a-8cd6-42ac-b024-184b23f470b0 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:02.443883 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4140475e-9f43-4443-ae75-1e9b97b027e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:02.444678 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4140475e-9f43-4443-ae75-1e9b97b027e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:02.447589 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4140475e-9f43-4443-ae75-1e9b97b027e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:02.447589 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4140475e-9f43-4443-ae75-1e9b97b027e4 admin admin] PATH_INFO: `/v3/projects/f92196fb311349439337cdb25730de9a/users/66c0b9aeb76c4caf9a23071aa53300ae/roles/d6e7421d1ff9451c808004b818354550` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:02.447589 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4140475e-9f43-4443-ae75-1e9b97b027e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f92196fb311349439337cdb25730de9a, user_id=66c0b9aeb76c4caf9a23071aa53300ae, role_id=d6e7421d1ff9451c808004b818354550)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:02.450089 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4140475e-9f43-4443-ae75-1e9b97b027e4 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:02.461673 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1247/2489] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Oct 4 12:08:02 2022] PUT /identity/v3/projects/f92196fb311349439337cdb25730de9a/users/66c0b9aeb76c4caf9a23071aa53300ae/roles/d6e7421d1ff9451c808004b818354550 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:08:02.473782 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a649288-4f05-4cb0-856d-9a2e206aa45a None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:02.474079 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a649288-4f05-4cb0-856d-9a2e206aa45a None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:02.474746 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a649288-4f05-4cb0-856d-9a2e206aa45a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:02.503685 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-8a649288-4f05-4cb0-856d-9a2e206aa45a None None] MFA Rules not processed for user `66c0b9aeb76c4caf9a23071aa53300ae`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:08:02.504929 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-8a649288-4f05-4cb0-856d-9a2e206aa45a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:08:02.580332 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1243/2490] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:08:02 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:08:02.590564 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4140475e-9f43-4443-ae75-1e9b97b027e4 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:02.592313 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-4140475e-9f43-4443-ae75-1e9b97b027e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:08:02.667371 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4140475e-9f43-4443-ae75-1e9b97b027e4 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:02.671265 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff703ec-10d0-415e-8cc1-cfb53aa011ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e2a05b782424ab2928b5864f1bfd556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:02.671876 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff703ec-10d0-415e-8cc1-cfb53aa011ee service cinder] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:02.672158 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff703ec-10d0-415e-8cc1-cfb53aa011ee service cinder] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:02.672433 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff703ec-10d0-415e-8cc1-cfb53aa011ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:02.682024 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff703ec-10d0-415e-8cc1-cfb53aa011ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:02.683461 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff703ec-10d0-415e-8cc1-cfb53aa011ee service cinder] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:02.693080 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1248/2491] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:08:02 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:08:02.837698 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a649288-4f05-4cb0-856d-9a2e206aa45a None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:02.913027 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a649288-4f05-4cb0-856d-9a2e206aa45a None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:02.917499 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864a8606-16d2-4349-9df0-00f9cd586534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:02.919245 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864a8606-16d2-4349-9df0-00f9cd586534 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:02.919546 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864a8606-16d2-4349-9df0-00f9cd586534 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:02.921689 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864a8606-16d2-4349-9df0-00f9cd586534 admin admin] PATH_INFO: `/v3/users/2979885c400146bc84ce578c7363b0e0` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:02.922830 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864a8606-16d2-4349-9df0-00f9cd586534 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2979885c400146bc84ce578c7363b0e0)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:02.925382 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864a8606-16d2-4349-9df0-00f9cd586534 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:02.934135 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:08:03.179523 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-864a8606-16d2-4349-9df0-00f9cd586534 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2979885c400146bc84ce578c7363b0e0'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:03.187650 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-864a8606-16d2-4349-9df0-00f9cd586534 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2979885c400146bc84ce578c7363b0e0'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:03.188368 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-864a8606-16d2-4349-9df0-00f9cd586534 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2979885c400146bc84ce578c7363b0e0'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:03.189020 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-864a8606-16d2-4349-9df0-00f9cd586534 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2979885c400146bc84ce578c7363b0e0'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:03.293080 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-864a8606-16d2-4349-9df0-00f9cd586534 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2979885c400146bc84ce578c7363b0e0'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:03.316105 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1244/2492] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Oct 4 12:08:02 2022] DELETE /identity/v3/users/2979885c400146bc84ce578c7363b0e0 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:08:03.320935 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc9dcf2-9214-4d27-abde-7abbb3b48185 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:03.321436 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc9dcf2-9214-4d27-abde-7abbb3b48185 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:03.321533 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc9dcf2-9214-4d27-abde-7abbb3b48185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:03.341669 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-efc9dcf2-9214-4d27-abde-7abbb3b48185 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:08:03.343104 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-efc9dcf2-9214-4d27-abde-7abbb3b48185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:08:03.406728 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1249/2493] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:08:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:08:03.419498 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864a8606-16d2-4349-9df0-00f9cd586534 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:03.420973 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-864a8606-16d2-4349-9df0-00f9cd586534 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:08:03.479068 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864a8606-16d2-4349-9df0-00f9cd586534 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:03.482591 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0c37ad-2523-456e-bfc0-51672d8b09ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7289515c5c44914a19daa439de98cb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:03.483194 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0c37ad-2523-456e-bfc0-51672d8b09ee service neutron] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:03.483467 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0c37ad-2523-456e-bfc0-51672d8b09ee service neutron] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:03.483739 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0c37ad-2523-456e-bfc0-51672d8b09ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:03.492758 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0c37ad-2523-456e-bfc0-51672d8b09ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:03.494161 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0c37ad-2523-456e-bfc0-51672d8b09ee service neutron] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:03.503308 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1245/2494] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:08:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:08:04.292627 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc9dcf2-9214-4d27-abde-7abbb3b48185 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:04.294170 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-efc9dcf2-9214-4d27-abde-7abbb3b48185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:08:04.306691 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc9dcf2-9214-4d27-abde-7abbb3b48185 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:04.321499 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae34d9f2-4ec8-4267-9984-c6fc63d11c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:04.325062 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae34d9f2-4ec8-4267-9984-c6fc63d11c59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:04.325062 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae34d9f2-4ec8-4267-9984-c6fc63d11c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:04.325062 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae34d9f2-4ec8-4267-9984-c6fc63d11c59 admin admin] PATH_INFO: `/v3/projects/223ae7d4b605404a8b46f4b6cb933c13` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:04.326675 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae34d9f2-4ec8-4267-9984-c6fc63d11c59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=223ae7d4b605404a8b46f4b6cb933c13)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:04.329107 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae34d9f2-4ec8-4267-9984-c6fc63d11c59 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:04.352758 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:08:04.462220 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-ae34d9f2-4ec8-4267-9984-c6fc63d11c59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '223ae7d4b605404a8b46f4b6cb933c13', 'request_id': 'req-ae34d9f2-4ec8-4267-9984-c6fc63d11c59'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:04.554124 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-ae34d9f2-4ec8-4267-9984-c6fc63d11c59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '223ae7d4b605404a8b46f4b6cb933c13', 'request_id': 'req-ae34d9f2-4ec8-4267-9984-c6fc63d11c59'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:04.563395 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-ae34d9f2-4ec8-4267-9984-c6fc63d11c59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '223ae7d4b605404a8b46f4b6cb933c13', 'request_id': 'req-ae34d9f2-4ec8-4267-9984-c6fc63d11c59'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:04.574798 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-ae34d9f2-4ec8-4267-9984-c6fc63d11c59 admin admin] The token cache is being invalidate because project 223ae7d4b605404a8b46f4b6cb933c13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:08:04.575147 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-ae34d9f2-4ec8-4267-9984-c6fc63d11c59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:04.575852 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-ae34d9f2-4ec8-4267-9984-c6fc63d11c59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:04.577472 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1250/2495] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Oct 4 12:08:04 2022] DELETE /identity/v3/projects/223ae7d4b605404a8b46f4b6cb933c13 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:08:04.581570 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0c37ad-2523-456e-bfc0-51672d8b09ee service neutron] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:04.592450 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0c37ad-2523-456e-bfc0-51672d8b09ee service neutron] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:04.654206 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a0efdf-58e0-478a-ba36-7af28cf29648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:04.654868 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a0efdf-58e0-478a-ba36-7af28cf29648 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:04.655149 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a0efdf-58e0-478a-ba36-7af28cf29648 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:04.655424 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a0efdf-58e0-478a-ba36-7af28cf29648 admin admin] PATH_INFO: `/v3/users/66c0b9aeb76c4caf9a23071aa53300ae` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:04.657247 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a0efdf-58e0-478a-ba36-7af28cf29648 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66c0b9aeb76c4caf9a23071aa53300ae)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:04.659354 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a0efdf-58e0-478a-ba36-7af28cf29648 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:04.903998 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:08:04.919006 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-67a0efdf-58e0-478a-ba36-7af28cf29648 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66c0b9aeb76c4caf9a23071aa53300ae'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:04.926669 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-67a0efdf-58e0-478a-ba36-7af28cf29648 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66c0b9aeb76c4caf9a23071aa53300ae'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:04.928015 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-67a0efdf-58e0-478a-ba36-7af28cf29648 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66c0b9aeb76c4caf9a23071aa53300ae'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:04.928643 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-67a0efdf-58e0-478a-ba36-7af28cf29648 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66c0b9aeb76c4caf9a23071aa53300ae'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:05.027634 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-67a0efdf-58e0-478a-ba36-7af28cf29648 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66c0b9aeb76c4caf9a23071aa53300ae'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:05.049156 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1246/2496] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Oct 4 12:08:04 2022] DELETE /identity/v3/users/66c0b9aeb76c4caf9a23071aa53300ae => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:08:05.577306 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae34d9f2-4ec8-4267-9984-c6fc63d11c59 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:05.579038 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-ae34d9f2-4ec8-4267-9984-c6fc63d11c59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:08:05.608069 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae34d9f2-4ec8-4267-9984-c6fc63d11c59 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:05.670698 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6d5194-6d4e-4a16-8d98-9800b1a82e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:05.671286 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6d5194-6d4e-4a16-8d98-9800b1a82e34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:05.671519 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6d5194-6d4e-4a16-8d98-9800b1a82e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:05.671785 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6d5194-6d4e-4a16-8d98-9800b1a82e34 admin admin] PATH_INFO: `/v3/projects/f92196fb311349439337cdb25730de9a` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:05.672961 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6d5194-6d4e-4a16-8d98-9800b1a82e34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f92196fb311349439337cdb25730de9a)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:05.674996 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6d5194-6d4e-4a16-8d98-9800b1a82e34 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:05.798429 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-bc6d5194-6d4e-4a16-8d98-9800b1a82e34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f92196fb311349439337cdb25730de9a', 'request_id': 'req-bc6d5194-6d4e-4a16-8d98-9800b1a82e34'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:05.872642 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-bc6d5194-6d4e-4a16-8d98-9800b1a82e34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f92196fb311349439337cdb25730de9a', 'request_id': 'req-bc6d5194-6d4e-4a16-8d98-9800b1a82e34'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:05.880903 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-bc6d5194-6d4e-4a16-8d98-9800b1a82e34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f92196fb311349439337cdb25730de9a', 'request_id': 'req-bc6d5194-6d4e-4a16-8d98-9800b1a82e34'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:05.893975 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-bc6d5194-6d4e-4a16-8d98-9800b1a82e34 admin admin] The token cache is being invalidate because project f92196fb311349439337cdb25730de9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:08:05.894429 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-bc6d5194-6d4e-4a16-8d98-9800b1a82e34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:05.895084 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-bc6d5194-6d4e-4a16-8d98-9800b1a82e34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:05.904242 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1251/2497] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Oct 4 12:08:05 2022] DELETE /identity/v3/projects/f92196fb311349439337cdb25730de9a => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:08:05.904350 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7701ed2f-521c-43d8-b6e3-9357ebf444d6 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:05.904350 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7701ed2f-521c-43d8-b6e3-9357ebf444d6 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:05.904350 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7701ed2f-521c-43d8-b6e3-9357ebf444d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:05.926844 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-7701ed2f-521c-43d8-b6e3-9357ebf444d6 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:08:05.928255 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-7701ed2f-521c-43d8-b6e3-9357ebf444d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:08:06.007377 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1247/2498] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:08:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:08:06.009946 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0572d6-7e44-4e91-878d-cbf5b53acd92 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:06.010224 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0572d6-7e44-4e91-878d-cbf5b53acd92 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:06.010493 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0572d6-7e44-4e91-878d-cbf5b53acd92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:06.032617 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-5b0572d6-7e44-4e91-878d-cbf5b53acd92 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:08:06.033852 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-5b0572d6-7e44-4e91-878d-cbf5b53acd92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:08:06.042351 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1252/2499] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:08:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 12:08:06.046014 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7701ed2f-521c-43d8-b6e3-9357ebf444d6 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:06.055943 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7701ed2f-521c-43d8-b6e3-9357ebf444d6 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:06.060628 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da90f2f6-d47d-4492-8aed-45c6ae642ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:06.061236 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da90f2f6-d47d-4492-8aed-45c6ae642ce1 admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:06.061515 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da90f2f6-d47d-4492-8aed-45c6ae642ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:06.061789 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da90f2f6-d47d-4492-8aed-45c6ae642ce1 admin admin] PATH_INFO: `/v3/domains` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:06.062425 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da90f2f6-d47d-4492-8aed-45c6ae642ce1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:08:06.062725 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da90f2f6-d47d-4492-8aed-45c6ae642ce1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:06.064312 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da90f2f6-d47d-4492-8aed-45c6ae642ce1 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:06.076575 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1248/2500] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Oct 4 12:08:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:08:06.080881 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0572d6-7e44-4e91-878d-cbf5b53acd92 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:06.091864 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0572d6-7e44-4e91-878d-cbf5b53acd92 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:06.097364 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda689e5-e238-4de8-aa5b-86f23f26dd16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:06.097980 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda689e5-e238-4de8-aa5b-86f23f26dd16 admin admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:06.098722 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda689e5-e238-4de8-aa5b-86f23f26dd16 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:06.099483 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda689e5-e238-4de8-aa5b-86f23f26dd16 admin admin] PATH_INFO: `/v3/projects` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:06.100173 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda689e5-e238-4de8-aa5b-86f23f26dd16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:06.102155 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda689e5-e238-4de8-aa5b-86f23f26dd16 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:06.212975 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1253/2501] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Oct 4 12:08:06 2022] POST /identity/v3/projects => generated 373 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:08:06.217198 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da90f2f6-d47d-4492-8aed-45c6ae642ce1 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:06.228351 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da90f2f6-d47d-4492-8aed-45c6ae642ce1 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:06.293312 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a775260-8021-497c-8e00-7cdb8c8d614e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:06.293931 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a775260-8021-497c-8e00-7cdb8c8d614e admin admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:06.294214 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a775260-8021-497c-8e00-7cdb8c8d614e admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:06.294490 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a775260-8021-497c-8e00-7cdb8c8d614e admin admin] PATH_INFO: `/v3/users` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:06.295139 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a775260-8021-497c-8e00-7cdb8c8d614e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:06.297098 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a775260-8021-497c-8e00-7cdb8c8d614e admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:06.425577 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1249/2502] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Oct 4 12:08:06 2022] POST /identity/v3/users => generated 287 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 12:08:06.426832 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda689e5-e238-4de8-aa5b-86f23f26dd16 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:06.436705 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:08:06.440807 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda689e5-e238-4de8-aa5b-86f23f26dd16 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:06.447445 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b6153b-d2e4-4bc5-b1ca-ca3276f2e069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:06.448068 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b6153b-d2e4-4bc5-b1ca-ca3276f2e069 admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:06.448348 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b6153b-d2e4-4bc5-b1ca-ca3276f2e069 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:06.448682 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b6153b-d2e4-4bc5-b1ca-ca3276f2e069 admin admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:06.449308 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b6153b-d2e4-4bc5-b1ca-ca3276f2e069 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:06.450969 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b6153b-d2e4-4bc5-b1ca-ca3276f2e069 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:06.463666 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1254/2503] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:08:06 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:08:06.467850 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a775260-8021-497c-8e00-7cdb8c8d614e admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:06.482015 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a775260-8021-497c-8e00-7cdb8c8d614e admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:06.487723 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2a06bc-6bd2-4422-96b0-0e91c1b29e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:06.488316 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2a06bc-6bd2-4422-96b0-0e91c1b29e32 admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:06.488622 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2a06bc-6bd2-4422-96b0-0e91c1b29e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:06.493228 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2a06bc-6bd2-4422-96b0-0e91c1b29e32 admin admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:06.493228 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2a06bc-6bd2-4422-96b0-0e91c1b29e32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:06.493228 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2a06bc-6bd2-4422-96b0-0e91c1b29e32 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:06.506506 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1250/2504] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:08:06 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:08:06.515293 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b6153b-d2e4-4bc5-b1ca-ca3276f2e069 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:06.530906 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b6153b-d2e4-4bc5-b1ca-ca3276f2e069 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:06.539182 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290f7f4b-2fd1-423c-b226-6e2bdbb62a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:06.540528 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290f7f4b-2fd1-423c-b226-6e2bdbb62a49 admin admin] REQUEST_METHOD: `PUT` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:06.541250 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290f7f4b-2fd1-423c-b226-6e2bdbb62a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:06.541883 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290f7f4b-2fd1-423c-b226-6e2bdbb62a49 admin admin] PATH_INFO: `/v3/projects/3b1572b9b2a9472d81b2c5c19d95e37b/users/c98c2975dac946e7b119d36386eaf293/roles/ab4307f3b7994c1c80036fa7db93b6b9` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:06.562889 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290f7f4b-2fd1-423c-b226-6e2bdbb62a49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b1572b9b2a9472d81b2c5c19d95e37b, user_id=c98c2975dac946e7b119d36386eaf293, role_id=ab4307f3b7994c1c80036fa7db93b6b9)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:06.566063 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290f7f4b-2fd1-423c-b226-6e2bdbb62a49 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:07.119902 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1255/2505] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Oct 4 12:08:06 2022] PUT /identity/v3/projects/3b1572b9b2a9472d81b2c5c19d95e37b/users/c98c2975dac946e7b119d36386eaf293/roles/ab4307f3b7994c1c80036fa7db93b6b9 => generated 0 bytes in 605 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:08:07.130185 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3f8130-7961-4944-9940-781e414865e9 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:07.130856 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3f8130-7961-4944-9940-781e414865e9 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:07.130856 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3f8130-7961-4944-9940-781e414865e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:07.159967 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:08:07.164087 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-9e3f8130-7961-4944-9940-781e414865e9 None None] MFA Rules not processed for user `c98c2975dac946e7b119d36386eaf293`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:08:07.166156 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-9e3f8130-7961-4944-9940-781e414865e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:08:07.233627 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1251/2506] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:08:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:08:07.238408 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290f7f4b-2fd1-423c-b226-6e2bdbb62a49 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:07.314057 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290f7f4b-2fd1-423c-b226-6e2bdbb62a49 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:07.319040 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba614ae-9d12-4bc7-a31b-9eeab52f1ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:07.319731 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba614ae-9d12-4bc7-a31b-9eeab52f1ce7 admin admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:07.320111 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba614ae-9d12-4bc7-a31b-9eeab52f1ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:07.320451 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba614ae-9d12-4bc7-a31b-9eeab52f1ce7 admin admin] PATH_INFO: `/v3/projects` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:07.321180 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba614ae-9d12-4bc7-a31b-9eeab52f1ce7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:07.323280 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba614ae-9d12-4bc7-a31b-9eeab52f1ce7 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:07.451451 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1256/2507] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Oct 4 12:08:07 2022] POST /identity/v3/projects => generated 371 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 12:08:07.460297 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3f8130-7961-4944-9940-781e414865e9 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:07.466531 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3f8130-7961-4944-9940-781e414865e9 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:07.538049 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50576e0-ec5b-4ce6-b5a3-e8d9c46214ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:07.538704 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50576e0-ec5b-4ce6-b5a3-e8d9c46214ed admin admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:07.538977 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50576e0-ec5b-4ce6-b5a3-e8d9c46214ed admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:07.539251 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50576e0-ec5b-4ce6-b5a3-e8d9c46214ed admin admin] PATH_INFO: `/v3/users` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:07.539892 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50576e0-ec5b-4ce6-b5a3-e8d9c46214ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:07.541864 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50576e0-ec5b-4ce6-b5a3-e8d9c46214ed admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:07.671314 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1252/2508] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Oct 4 12:08:07 2022] POST /identity/v3/users => generated 292 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:08:07.675371 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba614ae-9d12-4bc7-a31b-9eeab52f1ce7 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:07.686781 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba614ae-9d12-4bc7-a31b-9eeab52f1ce7 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:07.691368 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecb132f-09bf-459a-8be1-1b4fe2b5b67f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:07.691961 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecb132f-09bf-459a-8be1-1b4fe2b5b67f admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:07.692236 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecb132f-09bf-459a-8be1-1b4fe2b5b67f admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:07.692546 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecb132f-09bf-459a-8be1-1b4fe2b5b67f admin admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:07.693828 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecb132f-09bf-459a-8be1-1b4fe2b5b67f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:07.695451 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecb132f-09bf-459a-8be1-1b4fe2b5b67f admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:07.708059 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1257/2509] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:08:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:08:07.711856 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50576e0-ec5b-4ce6-b5a3-e8d9c46214ed admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:07.722187 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50576e0-ec5b-4ce6-b5a3-e8d9c46214ed admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:07.726822 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91850294-9961-4489-942b-d72e4116ed3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:07.727484 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91850294-9961-4489-942b-d72e4116ed3c admin admin] REQUEST_METHOD: `PUT` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:07.727810 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91850294-9961-4489-942b-d72e4116ed3c admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:07.728088 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91850294-9961-4489-942b-d72e4116ed3c admin admin] PATH_INFO: `/v3/projects/0a34f8387b31425baba48805c70b02e8/users/6bf6bd847de148fe993b0549ae593d2c/roles/d6e7421d1ff9451c808004b818354550` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:07.745817 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91850294-9961-4489-942b-d72e4116ed3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a34f8387b31425baba48805c70b02e8, user_id=6bf6bd847de148fe993b0549ae593d2c, role_id=d6e7421d1ff9451c808004b818354550)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:07.748692 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91850294-9961-4489-942b-d72e4116ed3c admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:07.917265 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1253/2510] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Oct 4 12:08:07 2022] PUT /identity/v3/projects/0a34f8387b31425baba48805c70b02e8/users/6bf6bd847de148fe993b0549ae593d2c/roles/d6e7421d1ff9451c808004b818354550 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:08:07.921228 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecb132f-09bf-459a-8be1-1b4fe2b5b67f admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:07.932885 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecb132f-09bf-459a-8be1-1b4fe2b5b67f admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:07.991174 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3d7186-0f87-44aa-a165-8ebb87c9de83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:07.991916 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3d7186-0f87-44aa-a165-8ebb87c9de83 admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:07.992199 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3d7186-0f87-44aa-a165-8ebb87c9de83 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:07.992472 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3d7186-0f87-44aa-a165-8ebb87c9de83 admin admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:07.993174 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3d7186-0f87-44aa-a165-8ebb87c9de83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:07.994887 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3d7186-0f87-44aa-a165-8ebb87c9de83 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:08.005081 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1258/2511] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:08:07 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:08:08.009811 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91850294-9961-4489-942b-d72e4116ed3c admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:08.020143 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91850294-9961-4489-942b-d72e4116ed3c admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:08.025493 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff46ea7c-de5f-4f64-8b33-47c2a705990f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:08.026158 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff46ea7c-de5f-4f64-8b33-47c2a705990f admin admin] REQUEST_METHOD: `PUT` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:08.026435 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff46ea7c-de5f-4f64-8b33-47c2a705990f admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:08.026705 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff46ea7c-de5f-4f64-8b33-47c2a705990f admin admin] PATH_INFO: `/v3/projects/0a34f8387b31425baba48805c70b02e8/users/6bf6bd847de148fe993b0549ae593d2c/roles/d6e7421d1ff9451c808004b818354550` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:08.028639 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff46ea7c-de5f-4f64-8b33-47c2a705990f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a34f8387b31425baba48805c70b02e8, user_id=6bf6bd847de148fe993b0549ae593d2c, role_id=d6e7421d1ff9451c808004b818354550)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:08.031298 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff46ea7c-de5f-4f64-8b33-47c2a705990f admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:08.041641 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1254/2512] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Oct 4 12:08:08 2022] PUT /identity/v3/projects/0a34f8387b31425baba48805c70b02e8/users/6bf6bd847de148fe993b0549ae593d2c/roles/d6e7421d1ff9451c808004b818354550 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:08:08.054656 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34391f72-6eba-4e16-b8e3-f933f1341e7b None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:08.055089 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34391f72-6eba-4e16-b8e3-f933f1341e7b None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:08.055343 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34391f72-6eba-4e16-b8e3-f933f1341e7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:08.087002 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-34391f72-6eba-4e16-b8e3-f933f1341e7b None None] MFA Rules not processed for user `6bf6bd847de148fe993b0549ae593d2c`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:08:08.088199 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-34391f72-6eba-4e16-b8e3-f933f1341e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:08:08.123819 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:08:08.159841 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1259/2513] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:08:08 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:08:08.171985 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff46ea7c-de5f-4f64-8b33-47c2a705990f admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:08.174050 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-ff46ea7c-de5f-4f64-8b33-47c2a705990f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:08:08.256120 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff46ea7c-de5f-4f64-8b33-47c2a705990f admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:08.261304 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca27e338-cd4b-4d21-a1fe-edb679375a4d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e2a05b782424ab2928b5864f1bfd556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:08.263336 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca27e338-cd4b-4d21-a1fe-edb679375a4d service cinder] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:08.263651 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca27e338-cd4b-4d21-a1fe-edb679375a4d service cinder] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:08.263928 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca27e338-cd4b-4d21-a1fe-edb679375a4d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:08.276876 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca27e338-cd4b-4d21-a1fe-edb679375a4d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:08.278447 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca27e338-cd4b-4d21-a1fe-edb679375a4d service cinder] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:08.282774 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:08:08.289389 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1255/2514] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:08:08 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:08:09.286847 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34391f72-6eba-4e16-b8e3-f933f1341e7b None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:09.287993 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-34391f72-6eba-4e16-b8e3-f933f1341e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:08:09.353978 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34391f72-6eba-4e16-b8e3-f933f1341e7b None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:09.358550 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bffa4b-618a-4b0c-af5d-3fe55299b142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:09.359179 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bffa4b-618a-4b0c-af5d-3fe55299b142 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:09.359460 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bffa4b-618a-4b0c-af5d-3fe55299b142 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:09.359736 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bffa4b-618a-4b0c-af5d-3fe55299b142 admin admin] PATH_INFO: `/v3/users/5be08c643ebf4bf99f3c6dfe239fc9d5` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:09.360963 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bffa4b-618a-4b0c-af5d-3fe55299b142 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5be08c643ebf4bf99f3c6dfe239fc9d5)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:09.363156 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bffa4b-618a-4b0c-af5d-3fe55299b142 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:09.516058 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca27e338-cd4b-4d21-a1fe-edb679375a4d service cinder] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:09.527196 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca27e338-cd4b-4d21-a1fe-edb679375a4d service cinder] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:09.532220 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f39d5b-f063-4c04-a259-9d4391b26005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:09.532836 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f39d5b-f063-4c04-a259-9d4391b26005 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:09.533182 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f39d5b-f063-4c04-a259-9d4391b26005 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:09.533455 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f39d5b-f063-4c04-a259-9d4391b26005 admin admin] PATH_INFO: `/v3/users/c98c2975dac946e7b119d36386eaf293` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:09.534647 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f39d5b-f063-4c04-a259-9d4391b26005 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c98c2975dac946e7b119d36386eaf293)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:09.537076 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f39d5b-f063-4c04-a259-9d4391b26005 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:09.592718 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-f8bffa4b-618a-4b0c-af5d-3fe55299b142 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5be08c643ebf4bf99f3c6dfe239fc9d5'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:09.599732 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-f8bffa4b-618a-4b0c-af5d-3fe55299b142 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5be08c643ebf4bf99f3c6dfe239fc9d5'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:09.600543 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-f8bffa4b-618a-4b0c-af5d-3fe55299b142 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5be08c643ebf4bf99f3c6dfe239fc9d5'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:09.601240 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-f8bffa4b-618a-4b0c-af5d-3fe55299b142 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5be08c643ebf4bf99f3c6dfe239fc9d5'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:09.704730 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-f8bffa4b-618a-4b0c-af5d-3fe55299b142 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5be08c643ebf4bf99f3c6dfe239fc9d5'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:09.726361 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1260/2515] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Oct 4 12:08:09 2022] DELETE /identity/v3/users/5be08c643ebf4bf99f3c6dfe239fc9d5 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:08:09.790213 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-75f39d5b-f063-4c04-a259-9d4391b26005 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c98c2975dac946e7b119d36386eaf293'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:09.805677 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-75f39d5b-f063-4c04-a259-9d4391b26005 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c98c2975dac946e7b119d36386eaf293'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:09.805677 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-75f39d5b-f063-4c04-a259-9d4391b26005 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c98c2975dac946e7b119d36386eaf293'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:09.805677 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-75f39d5b-f063-4c04-a259-9d4391b26005 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c98c2975dac946e7b119d36386eaf293'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:09.895142 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-75f39d5b-f063-4c04-a259-9d4391b26005 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c98c2975dac946e7b119d36386eaf293'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:09.917174 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1256/2516] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Oct 4 12:08:09 2022] DELETE /identity/v3/users/c98c2975dac946e7b119d36386eaf293 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:08:09.921537 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6377b503-6647-4e15-abe9-ba3cb42da995 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:09.921898 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6377b503-6647-4e15-abe9-ba3cb42da995 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:09.922316 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6377b503-6647-4e15-abe9-ba3cb42da995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:09.942973 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-6377b503-6647-4e15-abe9-ba3cb42da995 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:08:09.944219 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-6377b503-6647-4e15-abe9-ba3cb42da995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:08:09.993208 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f39d5b-f063-4c04-a259-9d4391b26005 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:09.994878 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-75f39d5b-f063-4c04-a259-9d4391b26005 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:08:10.002889 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:08:10.026378 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1261/2517] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:08:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:08:10.043608 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6377b503-6647-4e15-abe9-ba3cb42da995 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:10.045273 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-6377b503-6647-4e15-abe9-ba3cb42da995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:08:10.082601 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f39d5b-f063-4c04-a259-9d4391b26005 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:10.088006 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32dd256-0f09-4a41-b63f-23a36c975792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:10.088823 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32dd256-0f09-4a41-b63f-23a36c975792 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:10.089217 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32dd256-0f09-4a41-b63f-23a36c975792 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:10.089726 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32dd256-0f09-4a41-b63f-23a36c975792 admin admin] PATH_INFO: `/v3/projects/a1ea3836fdc647eda9302d8b79984d14` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:10.090990 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32dd256-0f09-4a41-b63f-23a36c975792 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1ea3836fdc647eda9302d8b79984d14)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:10.092945 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32dd256-0f09-4a41-b63f-23a36c975792 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:10.108180 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6377b503-6647-4e15-abe9-ba3cb42da995 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:10.112307 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084cba1c-d3af-443f-a9b3-cf30e70c7b3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7289515c5c44914a19daa439de98cb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:10.112928 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084cba1c-d3af-443f-a9b3-cf30e70c7b3b service neutron] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:10.113206 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084cba1c-d3af-443f-a9b3-cf30e70c7b3b service neutron] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:10.113479 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084cba1c-d3af-443f-a9b3-cf30e70c7b3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:10.123866 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084cba1c-d3af-443f-a9b3-cf30e70c7b3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:10.125326 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084cba1c-d3af-443f-a9b3-cf30e70c7b3b service neutron] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:10.135456 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1262/2518] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:08:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 12:08:10.311379 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-a32dd256-0f09-4a41-b63f-23a36c975792 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1ea3836fdc647eda9302d8b79984d14', 'request_id': 'req-a32dd256-0f09-4a41-b63f-23a36c975792'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:10.317853 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-a32dd256-0f09-4a41-b63f-23a36c975792 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1ea3836fdc647eda9302d8b79984d14', 'request_id': 'req-a32dd256-0f09-4a41-b63f-23a36c975792'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:10.478544 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-a32dd256-0f09-4a41-b63f-23a36c975792 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1ea3836fdc647eda9302d8b79984d14', 'request_id': 'req-a32dd256-0f09-4a41-b63f-23a36c975792'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:10.489550 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:08:10.494157 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-a32dd256-0f09-4a41-b63f-23a36c975792 admin admin] The token cache is being invalidate because project a1ea3836fdc647eda9302d8b79984d14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:08:10.494567 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-a32dd256-0f09-4a41-b63f-23a36c975792 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:10.495312 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-a32dd256-0f09-4a41-b63f-23a36c975792 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:10.497164 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1257/2519] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Oct 4 12:08:09 2022] DELETE /identity/v3/projects/a1ea3836fdc647eda9302d8b79984d14 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:08:10.501003 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084cba1c-d3af-443f-a9b3-cf30e70c7b3b service neutron] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:10.513779 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084cba1c-d3af-443f-a9b3-cf30e70c7b3b service neutron] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:10.580514 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5010599a-1e05-4ce6-ba29-7864219213e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:10.581178 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5010599a-1e05-4ce6-ba29-7864219213e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:10.581455 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5010599a-1e05-4ce6-ba29-7864219213e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:10.581733 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5010599a-1e05-4ce6-ba29-7864219213e9 admin admin] PATH_INFO: `/v3/users/64c0d124a98a43abb8b964995f97c252` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:10.582854 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5010599a-1e05-4ce6-ba29-7864219213e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64c0d124a98a43abb8b964995f97c252)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:10.585475 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5010599a-1e05-4ce6-ba29-7864219213e9 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:10.794814 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32dd256-0f09-4a41-b63f-23a36c975792 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:10.796327 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-a32dd256-0f09-4a41-b63f-23a36c975792 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:08:10.812823 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32dd256-0f09-4a41-b63f-23a36c975792 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:10.817984 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6fb7e1-6b88-4f52-9c6f-65f1bfb63fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:10.819524 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6fb7e1-6b88-4f52-9c6f-65f1bfb63fe1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:10.819842 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6fb7e1-6b88-4f52-9c6f-65f1bfb63fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:10.820170 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6fb7e1-6b88-4f52-9c6f-65f1bfb63fe1 admin admin] PATH_INFO: `/v3/projects/3b1572b9b2a9472d81b2c5c19d95e37b` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:10.821866 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6fb7e1-6b88-4f52-9c6f-65f1bfb63fe1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b1572b9b2a9472d81b2c5c19d95e37b)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:10.823713 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6fb7e1-6b88-4f52-9c6f-65f1bfb63fe1 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:10.841441 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-5010599a-1e05-4ce6-ba29-7864219213e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64c0d124a98a43abb8b964995f97c252'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:10.849945 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-5010599a-1e05-4ce6-ba29-7864219213e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64c0d124a98a43abb8b964995f97c252'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:10.856144 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-5010599a-1e05-4ce6-ba29-7864219213e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64c0d124a98a43abb8b964995f97c252'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:10.856144 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-5010599a-1e05-4ce6-ba29-7864219213e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64c0d124a98a43abb8b964995f97c252'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:10.965867 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-3c6fb7e1-6b88-4f52-9c6f-65f1bfb63fe1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b1572b9b2a9472d81b2c5c19d95e37b', 'request_id': 'req-3c6fb7e1-6b88-4f52-9c6f-65f1bfb63fe1'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:10.967209 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-5010599a-1e05-4ce6-ba29-7864219213e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64c0d124a98a43abb8b964995f97c252'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:10.973590 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-3c6fb7e1-6b88-4f52-9c6f-65f1bfb63fe1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b1572b9b2a9472d81b2c5c19d95e37b', 'request_id': 'req-3c6fb7e1-6b88-4f52-9c6f-65f1bfb63fe1'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:10.986644 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1263/2520] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Oct 4 12:08:10 2022] DELETE /identity/v3/users/64c0d124a98a43abb8b964995f97c252 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:08:11.061979 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-3c6fb7e1-6b88-4f52-9c6f-65f1bfb63fe1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b1572b9b2a9472d81b2c5c19d95e37b', 'request_id': 'req-3c6fb7e1-6b88-4f52-9c6f-65f1bfb63fe1'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:11.077286 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-3c6fb7e1-6b88-4f52-9c6f-65f1bfb63fe1 admin admin] The token cache is being invalidate because project 3b1572b9b2a9472d81b2c5c19d95e37b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:08:11.077574 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-3c6fb7e1-6b88-4f52-9c6f-65f1bfb63fe1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:11.078228 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-3c6fb7e1-6b88-4f52-9c6f-65f1bfb63fe1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:11.079974 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1258/2521] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Oct 4 12:08:10 2022] DELETE /identity/v3/projects/3b1572b9b2a9472d81b2c5c19d95e37b => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:08:11.084120 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5010599a-1e05-4ce6-ba29-7864219213e9 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:11.085861 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-5010599a-1e05-4ce6-ba29-7864219213e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:08:11.097791 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:08:11.158746 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5010599a-1e05-4ce6-ba29-7864219213e9 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:11.164242 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccaff7e-e4a7-4f4b-ad7c-06f99b4b0221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:11.165356 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccaff7e-e4a7-4f4b-ad7c-06f99b4b0221 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:11.165356 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccaff7e-e4a7-4f4b-ad7c-06f99b4b0221 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:11.165593 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccaff7e-e4a7-4f4b-ad7c-06f99b4b0221 admin admin] PATH_INFO: `/v3/users/6bf6bd847de148fe993b0549ae593d2c` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:11.166605 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccaff7e-e4a7-4f4b-ad7c-06f99b4b0221 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6bf6bd847de148fe993b0549ae593d2c)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:11.168538 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccaff7e-e4a7-4f4b-ad7c-06f99b4b0221 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:11.352573 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6fb7e1-6b88-4f52-9c6f-65f1bfb63fe1 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:11.354704 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-3c6fb7e1-6b88-4f52-9c6f-65f1bfb63fe1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:08:11.433943 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6fb7e1-6b88-4f52-9c6f-65f1bfb63fe1 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:11.439520 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014e5168-1e4d-4dde-adc2-918fab4b3da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:11.440190 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014e5168-1e4d-4dde-adc2-918fab4b3da5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:11.440469 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014e5168-1e4d-4dde-adc2-918fab4b3da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:11.440773 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014e5168-1e4d-4dde-adc2-918fab4b3da5 admin admin] PATH_INFO: `/v3/projects/e350fc6312a14853838c9d0953aeaf00` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:11.441917 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014e5168-1e4d-4dde-adc2-918fab4b3da5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e350fc6312a14853838c9d0953aeaf00)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:11.444790 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014e5168-1e4d-4dde-adc2-918fab4b3da5 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:11.466830 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-cccaff7e-e4a7-4f4b-ad7c-06f99b4b0221 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6bf6bd847de148fe993b0549ae593d2c'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:11.475332 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-cccaff7e-e4a7-4f4b-ad7c-06f99b4b0221 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6bf6bd847de148fe993b0549ae593d2c'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:11.476665 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-cccaff7e-e4a7-4f4b-ad7c-06f99b4b0221 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6bf6bd847de148fe993b0549ae593d2c'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:11.477477 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-cccaff7e-e4a7-4f4b-ad7c-06f99b4b0221 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6bf6bd847de148fe993b0549ae593d2c'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:11.575093 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-cccaff7e-e4a7-4f4b-ad7c-06f99b4b0221 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6bf6bd847de148fe993b0549ae593d2c'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:11.580200 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-014e5168-1e4d-4dde-adc2-918fab4b3da5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e350fc6312a14853838c9d0953aeaf00', 'request_id': 'req-014e5168-1e4d-4dde-adc2-918fab4b3da5'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:11.587272 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-014e5168-1e4d-4dde-adc2-918fab4b3da5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e350fc6312a14853838c9d0953aeaf00', 'request_id': 'req-014e5168-1e4d-4dde-adc2-918fab4b3da5'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:11.595167 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1264/2522] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Oct 4 12:08:11 2022] DELETE /identity/v3/users/6bf6bd847de148fe993b0549ae593d2c => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:08:11.681661 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-014e5168-1e4d-4dde-adc2-918fab4b3da5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e350fc6312a14853838c9d0953aeaf00', 'request_id': 'req-014e5168-1e4d-4dde-adc2-918fab4b3da5'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:11.703172 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-014e5168-1e4d-4dde-adc2-918fab4b3da5 admin admin] The token cache is being invalidate because project e350fc6312a14853838c9d0953aeaf00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:08:11.708999 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-014e5168-1e4d-4dde-adc2-918fab4b3da5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:11.708999 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-014e5168-1e4d-4dde-adc2-918fab4b3da5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:11.708999 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1259/2523] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Oct 4 12:08:11 2022] DELETE /identity/v3/projects/e350fc6312a14853838c9d0953aeaf00 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:08:12.303232 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccaff7e-e4a7-4f4b-ad7c-06f99b4b0221 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:12.305010 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-cccaff7e-e4a7-4f4b-ad7c-06f99b4b0221 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:08:12.371672 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccaff7e-e4a7-4f4b-ad7c-06f99b4b0221 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:12.376268 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a137091-cc16-4559-9cf1-aa6d4806710c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:12.376920 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a137091-cc16-4559-9cf1-aa6d4806710c admin admin] REQUEST_METHOD: `DELETE` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:12.377204 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a137091-cc16-4559-9cf1-aa6d4806710c admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:12.377461 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a137091-cc16-4559-9cf1-aa6d4806710c admin admin] PATH_INFO: `/v3/projects/0a34f8387b31425baba48805c70b02e8` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:12.378643 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a137091-cc16-4559-9cf1-aa6d4806710c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a34f8387b31425baba48805c70b02e8)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:12.380647 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a137091-cc16-4559-9cf1-aa6d4806710c admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:12.521888 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:08:12.537198 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-3a137091-cc16-4559-9cf1-aa6d4806710c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a34f8387b31425baba48805c70b02e8', 'request_id': 'req-3a137091-cc16-4559-9cf1-aa6d4806710c'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:12.661387 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-3a137091-cc16-4559-9cf1-aa6d4806710c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a34f8387b31425baba48805c70b02e8', 'request_id': 'req-3a137091-cc16-4559-9cf1-aa6d4806710c'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:12.669436 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-3a137091-cc16-4559-9cf1-aa6d4806710c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a34f8387b31425baba48805c70b02e8', 'request_id': 'req-3a137091-cc16-4559-9cf1-aa6d4806710c'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:12.681184 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-3a137091-cc16-4559-9cf1-aa6d4806710c admin admin] The token cache is being invalidate because project 0a34f8387b31425baba48805c70b02e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:08:12.681470 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-3a137091-cc16-4559-9cf1-aa6d4806710c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:12.682152 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-3a137091-cc16-4559-9cf1-aa6d4806710c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:12.683635 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1265/2524] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Oct 4 12:08:12 2022] DELETE /identity/v3/projects/0a34f8387b31425baba48805c70b02e8 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:08:12.688554 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52857300-0fd5-4373-8560-b81ae39e6576 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:12.689107 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52857300-0fd5-4373-8560-b81ae39e6576 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:12.689209 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52857300-0fd5-4373-8560-b81ae39e6576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:12.710080 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-52857300-0fd5-4373-8560-b81ae39e6576 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:08:12.711267 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-52857300-0fd5-4373-8560-b81ae39e6576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:08:12.719401 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:08:12.768056 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1260/2525] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:08:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:08:12.776425 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9285698a-dda8-43bb-bec1-37b13c86b98f None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:12.776815 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9285698a-dda8-43bb-bec1-37b13c86b98f None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:12.777166 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9285698a-dda8-43bb-bec1-37b13c86b98f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:12.797350 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-9285698a-dda8-43bb-bec1-37b13c86b98f None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:08:12.798544 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-9285698a-dda8-43bb-bec1-37b13c86b98f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:08:12.807190 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1266/2526] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:08:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:08:12.811181 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52857300-0fd5-4373-8560-b81ae39e6576 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:12.821886 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52857300-0fd5-4373-8560-b81ae39e6576 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:12.826451 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ec5beb-3f37-4ec0-b407-2bf16bd58b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:12.828757 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ec5beb-3f37-4ec0-b407-2bf16bd58b72 admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:12.828757 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ec5beb-3f37-4ec0-b407-2bf16bd58b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:12.828757 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ec5beb-3f37-4ec0-b407-2bf16bd58b72 admin admin] PATH_INFO: `/v3/domains` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:12.828757 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ec5beb-3f37-4ec0-b407-2bf16bd58b72 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:08:12.828757 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ec5beb-3f37-4ec0-b407-2bf16bd58b72 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:12.830144 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ec5beb-3f37-4ec0-b407-2bf16bd58b72 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:12.842600 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1261/2527] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Oct 4 12:08:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:08:12.847134 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9285698a-dda8-43bb-bec1-37b13c86b98f None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:12.856537 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9285698a-dda8-43bb-bec1-37b13c86b98f None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:12.863251 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42ef7d2-fd58-4e72-90f2-c0ffd3ace64a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:12.863251 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42ef7d2-fd58-4e72-90f2-c0ffd3ace64a admin admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:12.863251 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42ef7d2-fd58-4e72-90f2-c0ffd3ace64a admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:12.863251 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42ef7d2-fd58-4e72-90f2-c0ffd3ace64a admin admin] PATH_INFO: `/v3/projects` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:12.863676 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42ef7d2-fd58-4e72-90f2-c0ffd3ace64a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:12.865180 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42ef7d2-fd58-4e72-90f2-c0ffd3ace64a admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:12.951935 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1267/2528] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Oct 4 12:08:12 2022] POST /identity/v3/projects => generated 369 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:08:12.956059 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ec5beb-3f37-4ec0-b407-2bf16bd58b72 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:12.968290 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ec5beb-3f37-4ec0-b407-2bf16bd58b72 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:13.026073 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b489823-80a6-47e3-aed6-5b5bdb06d840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:13.026683 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b489823-80a6-47e3-aed6-5b5bdb06d840 admin admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:13.026964 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b489823-80a6-47e3-aed6-5b5bdb06d840 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:13.027237 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b489823-80a6-47e3-aed6-5b5bdb06d840 admin admin] PATH_INFO: `/v3/users` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:13.027867 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b489823-80a6-47e3-aed6-5b5bdb06d840 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:13.029859 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b489823-80a6-47e3-aed6-5b5bdb06d840 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:13.122399 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1262/2529] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Oct 4 12:08:12 2022] POST /identity/v3/users => generated 285 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:08:13.126444 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42ef7d2-fd58-4e72-90f2-c0ffd3ace64a admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:13.137895 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42ef7d2-fd58-4e72-90f2-c0ffd3ace64a admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:13.142488 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16513b2-cf28-4452-80ae-28c6cab66ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:13.143080 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16513b2-cf28-4452-80ae-28c6cab66ca2 admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:13.143359 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16513b2-cf28-4452-80ae-28c6cab66ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:13.143630 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16513b2-cf28-4452-80ae-28c6cab66ca2 admin admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:13.144273 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16513b2-cf28-4452-80ae-28c6cab66ca2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:13.146932 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16513b2-cf28-4452-80ae-28c6cab66ca2 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:13.157505 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1268/2530] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:08:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:08:13.162046 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b489823-80a6-47e3-aed6-5b5bdb06d840 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:13.172387 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b489823-80a6-47e3-aed6-5b5bdb06d840 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:13.176973 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172201fc-ec7c-483d-9438-5401e21d44cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:13.177728 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172201fc-ec7c-483d-9438-5401e21d44cc admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:13.178007 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172201fc-ec7c-483d-9438-5401e21d44cc admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:13.178276 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172201fc-ec7c-483d-9438-5401e21d44cc admin admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:13.178910 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172201fc-ec7c-483d-9438-5401e21d44cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:13.180482 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172201fc-ec7c-483d-9438-5401e21d44cc admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:13.190827 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1263/2531] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:08:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:08:13.195222 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16513b2-cf28-4452-80ae-28c6cab66ca2 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:13.205325 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16513b2-cf28-4452-80ae-28c6cab66ca2 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:13.210761 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1341137-2be0-41d6-b5f9-787879539f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:13.211432 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1341137-2be0-41d6-b5f9-787879539f09 admin admin] REQUEST_METHOD: `PUT` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:13.211711 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1341137-2be0-41d6-b5f9-787879539f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:13.212006 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1341137-2be0-41d6-b5f9-787879539f09 admin admin] PATH_INFO: `/v3/projects/221423bb78844709bf58bbe0d89cefe7/users/693066bc9ee24f71a5026e46a0fd69b0/roles/ab4307f3b7994c1c80036fa7db93b6b9` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:13.227614 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1341137-2be0-41d6-b5f9-787879539f09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=221423bb78844709bf58bbe0d89cefe7, user_id=693066bc9ee24f71a5026e46a0fd69b0, role_id=ab4307f3b7994c1c80036fa7db93b6b9)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:13.230301 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1341137-2be0-41d6-b5f9-787879539f09 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:13.339316 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1269/2532] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Oct 4 12:08:13 2022] PUT /identity/v3/projects/221423bb78844709bf58bbe0d89cefe7/users/693066bc9ee24f71a5026e46a0fd69b0/roles/ab4307f3b7994c1c80036fa7db93b6b9 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:08:13.351368 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad038bda-d1f8-47d5-aa2f-71091ac42a3e None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:13.351658 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad038bda-d1f8-47d5-aa2f-71091ac42a3e None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:13.351936 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad038bda-d1f8-47d5-aa2f-71091ac42a3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:13.379709 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-ad038bda-d1f8-47d5-aa2f-71091ac42a3e None None] MFA Rules not processed for user `693066bc9ee24f71a5026e46a0fd69b0`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:08:13.380960 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-ad038bda-d1f8-47d5-aa2f-71091ac42a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:08:13.444348 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1264/2533] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:08:13 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:08:13.448873 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1341137-2be0-41d6-b5f9-787879539f09 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:13.511002 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1341137-2be0-41d6-b5f9-787879539f09 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:13.515638 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26407f30-1e2d-41f8-b803-6aa3a8a75860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:13.516236 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26407f30-1e2d-41f8-b803-6aa3a8a75860 admin admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:13.516516 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26407f30-1e2d-41f8-b803-6aa3a8a75860 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:13.516817 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26407f30-1e2d-41f8-b803-6aa3a8a75860 admin admin] PATH_INFO: `/v3/projects` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:13.517456 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26407f30-1e2d-41f8-b803-6aa3a8a75860 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:13.519349 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26407f30-1e2d-41f8-b803-6aa3a8a75860 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:13.651072 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1270/2534] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Oct 4 12:08:13 2022] POST /identity/v3/projects => generated 367 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:08:13.655142 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad038bda-d1f8-47d5-aa2f-71091ac42a3e None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:13.668501 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad038bda-d1f8-47d5-aa2f-71091ac42a3e None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:13.672986 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:08:13.727295 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7047b9da-645b-4bd6-b392-25262ae10362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:13.727945 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7047b9da-645b-4bd6-b392-25262ae10362 admin admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:13.728173 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7047b9da-645b-4bd6-b392-25262ae10362 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:13.728444 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7047b9da-645b-4bd6-b392-25262ae10362 admin admin] PATH_INFO: `/v3/users` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:13.729111 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7047b9da-645b-4bd6-b392-25262ae10362 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:13.731041 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7047b9da-645b-4bd6-b392-25262ae10362 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:13.848003 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1265/2535] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Oct 4 12:08:13 2022] POST /identity/v3/users => generated 290 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:08:13.852467 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26407f30-1e2d-41f8-b803-6aa3a8a75860 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:13.863203 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26407f30-1e2d-41f8-b803-6aa3a8a75860 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:13.868226 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8189358c-9082-4a86-b9db-620e5098573b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:13.868851 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8189358c-9082-4a86-b9db-620e5098573b admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:13.869129 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8189358c-9082-4a86-b9db-620e5098573b admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:13.869397 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8189358c-9082-4a86-b9db-620e5098573b admin admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:13.870032 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8189358c-9082-4a86-b9db-620e5098573b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:13.871603 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8189358c-9082-4a86-b9db-620e5098573b admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:13.883362 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1271/2536] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:08:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:08:13.887523 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7047b9da-645b-4bd6-b392-25262ae10362 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:13.899240 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7047b9da-645b-4bd6-b392-25262ae10362 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:13.903920 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53089618-8fa8-4940-b30f-000d6cea8285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:13.904588 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53089618-8fa8-4940-b30f-000d6cea8285 admin admin] REQUEST_METHOD: `PUT` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:13.904893 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53089618-8fa8-4940-b30f-000d6cea8285 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:13.905165 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53089618-8fa8-4940-b30f-000d6cea8285 admin admin] PATH_INFO: `/v3/projects/61712df3139a4ff9bf12c4329c11f80c/users/69214d1b168d48faa4ef6a61606e10e2/roles/d6e7421d1ff9451c808004b818354550` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:13.921922 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53089618-8fa8-4940-b30f-000d6cea8285 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61712df3139a4ff9bf12c4329c11f80c, user_id=69214d1b168d48faa4ef6a61606e10e2, role_id=d6e7421d1ff9451c808004b818354550)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:13.924570 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53089618-8fa8-4940-b30f-000d6cea8285 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:13.990593 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1266/2537] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Oct 4 12:08:13 2022] PUT /identity/v3/projects/61712df3139a4ff9bf12c4329c11f80c/users/69214d1b168d48faa4ef6a61606e10e2/roles/d6e7421d1ff9451c808004b818354550 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:08:13.994584 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8189358c-9082-4a86-b9db-620e5098573b admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:14.004756 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8189358c-9082-4a86-b9db-620e5098573b admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:14.030112 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:08:14.063945 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c9e2e9-9c12-4be2-aacf-241aecf0fb54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:14.064943 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c9e2e9-9c12-4be2-aacf-241aecf0fb54 admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:14.065593 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c9e2e9-9c12-4be2-aacf-241aecf0fb54 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:14.065924 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c9e2e9-9c12-4be2-aacf-241aecf0fb54 admin admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:14.066569 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c9e2e9-9c12-4be2-aacf-241aecf0fb54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:14.068398 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c9e2e9-9c12-4be2-aacf-241aecf0fb54 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:14.078241 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1272/2538] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:08:13 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:08:14.082314 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53089618-8fa8-4940-b30f-000d6cea8285 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:14.093167 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53089618-8fa8-4940-b30f-000d6cea8285 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:14.097659 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d7d29e-dd34-48db-96c3-fe707e644fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:14.098398 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d7d29e-dd34-48db-96c3-fe707e644fb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:14.098619 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d7d29e-dd34-48db-96c3-fe707e644fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:14.098981 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d7d29e-dd34-48db-96c3-fe707e644fb2 admin admin] PATH_INFO: `/v3/projects/61712df3139a4ff9bf12c4329c11f80c/users/69214d1b168d48faa4ef6a61606e10e2/roles/d6e7421d1ff9451c808004b818354550` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:14.101102 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d7d29e-dd34-48db-96c3-fe707e644fb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61712df3139a4ff9bf12c4329c11f80c, user_id=69214d1b168d48faa4ef6a61606e10e2, role_id=d6e7421d1ff9451c808004b818354550)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:14.103735 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d7d29e-dd34-48db-96c3-fe707e644fb2 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:14.115644 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1267/2539] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Oct 4 12:08:14 2022] PUT /identity/v3/projects/61712df3139a4ff9bf12c4329c11f80c/users/69214d1b168d48faa4ef6a61606e10e2/roles/d6e7421d1ff9451c808004b818354550 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:08:14.131141 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568dca5e-890b-4747-bb08-240614b43825 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:14.131429 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568dca5e-890b-4747-bb08-240614b43825 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:14.131724 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568dca5e-890b-4747-bb08-240614b43825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:14.159917 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-568dca5e-890b-4747-bb08-240614b43825 None None] MFA Rules not processed for user `69214d1b168d48faa4ef6a61606e10e2`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:08:14.161152 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-568dca5e-890b-4747-bb08-240614b43825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:08:14.229803 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1273/2540] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:08:14 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 12:08:14.241219 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d7d29e-dd34-48db-96c3-fe707e644fb2 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:14.242878 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-04d7d29e-dd34-48db-96c3-fe707e644fb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:08:14.315931 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d7d29e-dd34-48db-96c3-fe707e644fb2 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:14.320292 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbf4a9b-82d5-4078-b8f3-50a0434f319b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e2a05b782424ab2928b5864f1bfd556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:14.320942 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbf4a9b-82d5-4078-b8f3-50a0434f319b service cinder] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:14.321220 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbf4a9b-82d5-4078-b8f3-50a0434f319b service cinder] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:14.321490 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbf4a9b-82d5-4078-b8f3-50a0434f319b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:14.330386 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbf4a9b-82d5-4078-b8f3-50a0434f319b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:14.331835 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbf4a9b-82d5-4078-b8f3-50a0434f319b service cinder] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:14.342116 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1268/2541] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:08:14 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:08:17.621537 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568dca5e-890b-4747-bb08-240614b43825 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:17.684151 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568dca5e-890b-4747-bb08-240614b43825 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:17.688589 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28d6af5-24fd-4efc-9a9c-e88c52f6f71e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:17.689237 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28d6af5-24fd-4efc-9a9c-e88c52f6f71e admin admin] REQUEST_METHOD: `DELETE` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:17.689514 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28d6af5-24fd-4efc-9a9c-e88c52f6f71e admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:17.689784 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28d6af5-24fd-4efc-9a9c-e88c52f6f71e admin admin] PATH_INFO: `/v3/users/693066bc9ee24f71a5026e46a0fd69b0` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:17.690884 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28d6af5-24fd-4efc-9a9c-e88c52f6f71e admin admin] RBAC: Authorizing `identity:delete_user(user_id=693066bc9ee24f71a5026e46a0fd69b0)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:17.693480 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28d6af5-24fd-4efc-9a9c-e88c52f6f71e admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:17.928125 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-f28d6af5-24fd-4efc-9a9c-e88c52f6f71e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '693066bc9ee24f71a5026e46a0fd69b0'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:17.930222 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:08:17.936055 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-f28d6af5-24fd-4efc-9a9c-e88c52f6f71e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '693066bc9ee24f71a5026e46a0fd69b0'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:17.936784 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-f28d6af5-24fd-4efc-9a9c-e88c52f6f71e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '693066bc9ee24f71a5026e46a0fd69b0'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:17.937387 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-f28d6af5-24fd-4efc-9a9c-e88c52f6f71e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '693066bc9ee24f71a5026e46a0fd69b0'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:18.043436 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-f28d6af5-24fd-4efc-9a9c-e88c52f6f71e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '693066bc9ee24f71a5026e46a0fd69b0'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:18.062215 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1274/2542] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Oct 4 12:08:17 2022] DELETE /identity/v3/users/693066bc9ee24f71a5026e46a0fd69b0 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:08:18.066842 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20b563f-d3ad-4f58-ac52-855d4547517b None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:18.067330 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20b563f-d3ad-4f58-ac52-855d4547517b None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:18.067430 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20b563f-d3ad-4f58-ac52-855d4547517b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:18.086051 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-f20b563f-d3ad-4f58-ac52-855d4547517b None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:08:18.087261 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-f20b563f-d3ad-4f58-ac52-855d4547517b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:08:18.145883 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1269/2543] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:08:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:08:18.155781 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28d6af5-24fd-4efc-9a9c-e88c52f6f71e admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:18.157148 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-f28d6af5-24fd-4efc-9a9c-e88c52f6f71e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:08:18.214342 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28d6af5-24fd-4efc-9a9c-e88c52f6f71e admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:18.217885 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5255b07-261f-42ad-bd21-3cc0f653fe2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7289515c5c44914a19daa439de98cb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:18.218482 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5255b07-261f-42ad-bd21-3cc0f653fe2e service neutron] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:18.218767 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5255b07-261f-42ad-bd21-3cc0f653fe2e service neutron] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:18.219032 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5255b07-261f-42ad-bd21-3cc0f653fe2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:18.227888 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5255b07-261f-42ad-bd21-3cc0f653fe2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:18.229335 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5255b07-261f-42ad-bd21-3cc0f653fe2e service neutron] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:18.238829 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1275/2544] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:08:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:08:18.712327 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20b563f-d3ad-4f58-ac52-855d4547517b None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:18.713887 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-f20b563f-d3ad-4f58-ac52-855d4547517b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:08:18.723413 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:08:18.737501 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20b563f-d3ad-4f58-ac52-855d4547517b None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:18.743179 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44918300-231e-4d9b-9748-8fb6dea99de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:18.743819 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44918300-231e-4d9b-9748-8fb6dea99de8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:18.744100 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44918300-231e-4d9b-9748-8fb6dea99de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:18.744374 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44918300-231e-4d9b-9748-8fb6dea99de8 admin admin] PATH_INFO: `/v3/projects/221423bb78844709bf58bbe0d89cefe7` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:18.745573 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44918300-231e-4d9b-9748-8fb6dea99de8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=221423bb78844709bf58bbe0d89cefe7)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:18.747435 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44918300-231e-4d9b-9748-8fb6dea99de8 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:18.896329 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-44918300-231e-4d9b-9748-8fb6dea99de8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '221423bb78844709bf58bbe0d89cefe7', 'request_id': 'req-44918300-231e-4d9b-9748-8fb6dea99de8'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:18.899622 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-44918300-231e-4d9b-9748-8fb6dea99de8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '221423bb78844709bf58bbe0d89cefe7', 'request_id': 'req-44918300-231e-4d9b-9748-8fb6dea99de8'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:18.981164 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-44918300-231e-4d9b-9748-8fb6dea99de8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '221423bb78844709bf58bbe0d89cefe7', 'request_id': 'req-44918300-231e-4d9b-9748-8fb6dea99de8'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:18.991772 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-44918300-231e-4d9b-9748-8fb6dea99de8 admin admin] The token cache is being invalidate because project 221423bb78844709bf58bbe0d89cefe7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:08:18.992061 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-44918300-231e-4d9b-9748-8fb6dea99de8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:18.992713 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-44918300-231e-4d9b-9748-8fb6dea99de8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:18.994202 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1270/2545] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Oct 4 12:08:18 2022] DELETE /identity/v3/projects/221423bb78844709bf58bbe0d89cefe7 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:08:18.998141 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5255b07-261f-42ad-bd21-3cc0f653fe2e service neutron] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:19.008210 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5255b07-261f-42ad-bd21-3cc0f653fe2e service neutron] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:19.065065 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eab7ac0-f2c7-4263-a2ba-1b7400110125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:19.065698 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eab7ac0-f2c7-4263-a2ba-1b7400110125 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:19.065972 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eab7ac0-f2c7-4263-a2ba-1b7400110125 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:19.066307 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eab7ac0-f2c7-4263-a2ba-1b7400110125 admin admin] PATH_INFO: `/v3/users/69214d1b168d48faa4ef6a61606e10e2` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:19.068112 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eab7ac0-f2c7-4263-a2ba-1b7400110125 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69214d1b168d48faa4ef6a61606e10e2)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:19.070116 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eab7ac0-f2c7-4263-a2ba-1b7400110125 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:19.327013 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-2eab7ac0-f2c7-4263-a2ba-1b7400110125 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69214d1b168d48faa4ef6a61606e10e2'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:19.334562 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-2eab7ac0-f2c7-4263-a2ba-1b7400110125 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69214d1b168d48faa4ef6a61606e10e2'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:19.335227 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-2eab7ac0-f2c7-4263-a2ba-1b7400110125 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69214d1b168d48faa4ef6a61606e10e2'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:19.335821 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-2eab7ac0-f2c7-4263-a2ba-1b7400110125 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69214d1b168d48faa4ef6a61606e10e2'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:19.426571 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-2eab7ac0-f2c7-4263-a2ba-1b7400110125 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69214d1b168d48faa4ef6a61606e10e2'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:19.434958 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:08:19.445128 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1276/2546] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Oct 4 12:08:18 2022] DELETE /identity/v3/users/69214d1b168d48faa4ef6a61606e10e2 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:08:19.948898 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44918300-231e-4d9b-9748-8fb6dea99de8 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:19.950967 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-44918300-231e-4d9b-9748-8fb6dea99de8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:08:19.976712 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44918300-231e-4d9b-9748-8fb6dea99de8 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:20.044671 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3272dc-8dcb-4ce1-af02-42a7e5679cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:20.045635 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3272dc-8dcb-4ce1-af02-42a7e5679cde admin admin] REQUEST_METHOD: `DELETE` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:20.045920 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3272dc-8dcb-4ce1-af02-42a7e5679cde admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:20.046198 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3272dc-8dcb-4ce1-af02-42a7e5679cde admin admin] PATH_INFO: `/v3/projects/61712df3139a4ff9bf12c4329c11f80c` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:20.047361 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3272dc-8dcb-4ce1-af02-42a7e5679cde admin admin] RBAC: Authorizing `identity:delete_project(project_id=61712df3139a4ff9bf12c4329c11f80c)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:20.049327 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3272dc-8dcb-4ce1-af02-42a7e5679cde admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:20.271132 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-9e3272dc-8dcb-4ce1-af02-42a7e5679cde admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61712df3139a4ff9bf12c4329c11f80c', 'request_id': 'req-9e3272dc-8dcb-4ce1-af02-42a7e5679cde'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:20.277688 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-9e3272dc-8dcb-4ce1-af02-42a7e5679cde admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61712df3139a4ff9bf12c4329c11f80c', 'request_id': 'req-9e3272dc-8dcb-4ce1-af02-42a7e5679cde'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:20.340802 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-9e3272dc-8dcb-4ce1-af02-42a7e5679cde admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61712df3139a4ff9bf12c4329c11f80c', 'request_id': 'req-9e3272dc-8dcb-4ce1-af02-42a7e5679cde'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:20.352734 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-9e3272dc-8dcb-4ce1-af02-42a7e5679cde admin admin] The token cache is being invalidate because project 61712df3139a4ff9bf12c4329c11f80c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:08:20.357872 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-9e3272dc-8dcb-4ce1-af02-42a7e5679cde admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:20.357872 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-9e3272dc-8dcb-4ce1-af02-42a7e5679cde admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:20.357872 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1271/2547] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Oct 4 12:08:19 2022] DELETE /identity/v3/projects/61712df3139a4ff9bf12c4329c11f80c => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:08:20.360055 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0e2f2f-42df-4276-8df8-176aea9a4fa1 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:20.360524 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0e2f2f-42df-4276-8df8-176aea9a4fa1 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:20.360666 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0e2f2f-42df-4276-8df8-176aea9a4fa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:20.381817 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-2a0e2f2f-42df-4276-8df8-176aea9a4fa1 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:08:20.383021 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-2a0e2f2f-42df-4276-8df8-176aea9a4fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:08:20.443224 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1277/2548] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:08:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:08:20.451431 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6085f81d-4f65-4579-8e8e-25fded20e461 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:20.451806 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6085f81d-4f65-4579-8e8e-25fded20e461 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:20.452182 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6085f81d-4f65-4579-8e8e-25fded20e461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:20.472553 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-6085f81d-4f65-4579-8e8e-25fded20e461 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:08:20.474861 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-6085f81d-4f65-4579-8e8e-25fded20e461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:08:20.483090 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1272/2549] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:08:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:08:20.492548 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0e2f2f-42df-4276-8df8-176aea9a4fa1 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:20.502396 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0e2f2f-42df-4276-8df8-176aea9a4fa1 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:20.507214 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5a6b48-b569-4135-9cac-f3fb60aaaadf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:20.507812 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5a6b48-b569-4135-9cac-f3fb60aaaadf admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:20.511008 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5a6b48-b569-4135-9cac-f3fb60aaaadf admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:20.511008 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5a6b48-b569-4135-9cac-f3fb60aaaadf admin admin] PATH_INFO: `/v3/domains` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:20.511008 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5a6b48-b569-4135-9cac-f3fb60aaaadf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:08:20.511008 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5a6b48-b569-4135-9cac-f3fb60aaaadf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:20.511008 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5a6b48-b569-4135-9cac-f3fb60aaaadf admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:20.523737 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1278/2550] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Oct 4 12:08:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:08:20.528180 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6085f81d-4f65-4579-8e8e-25fded20e461 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:20.538478 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6085f81d-4f65-4579-8e8e-25fded20e461 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:20.543057 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c60864-a1a9-43c0-9847-2a426a676d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:20.543656 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c60864-a1a9-43c0-9847-2a426a676d79 admin admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:20.543936 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c60864-a1a9-43c0-9847-2a426a676d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:20.544210 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c60864-a1a9-43c0-9847-2a426a676d79 admin admin] PATH_INFO: `/v3/projects` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:20.544888 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c60864-a1a9-43c0-9847-2a426a676d79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:20.546786 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c60864-a1a9-43c0-9847-2a426a676d79 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:20.557406 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:08:20.674042 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1273/2551] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Oct 4 12:08:20 2022] POST /identity/v3/projects => generated 385 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:08:20.679608 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5a6b48-b569-4135-9cac-f3fb60aaaadf admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:20.689532 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5a6b48-b569-4135-9cac-f3fb60aaaadf admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:20.747568 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a0a5ac-188d-4ec1-be64-4f432ca0acd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:20.748174 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a0a5ac-188d-4ec1-be64-4f432ca0acd9 admin admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:20.748461 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a0a5ac-188d-4ec1-be64-4f432ca0acd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:20.748794 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a0a5ac-188d-4ec1-be64-4f432ca0acd9 admin admin] PATH_INFO: `/v3/users` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:20.749437 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a0a5ac-188d-4ec1-be64-4f432ca0acd9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:20.751359 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a0a5ac-188d-4ec1-be64-4f432ca0acd9 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:20.870094 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1279/2552] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Oct 4 12:08:20 2022] POST /identity/v3/users => generated 293 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:08:20.874381 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c60864-a1a9-43c0-9847-2a426a676d79 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:20.884801 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c60864-a1a9-43c0-9847-2a426a676d79 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:20.889651 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca96da76-99ac-42ad-b78b-2ef23bdd5812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:20.890277 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca96da76-99ac-42ad-b78b-2ef23bdd5812 admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:20.890556 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca96da76-99ac-42ad-b78b-2ef23bdd5812 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:20.890838 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca96da76-99ac-42ad-b78b-2ef23bdd5812 admin admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:20.891500 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca96da76-99ac-42ad-b78b-2ef23bdd5812 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:20.893164 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca96da76-99ac-42ad-b78b-2ef23bdd5812 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:20.903579 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1274/2553] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:08:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:08:20.907389 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a0a5ac-188d-4ec1-be64-4f432ca0acd9 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:20.918047 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a0a5ac-188d-4ec1-be64-4f432ca0acd9 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:20.922639 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a01d49-7d5a-4cbd-b814-83577f8de057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:20.923231 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a01d49-7d5a-4cbd-b814-83577f8de057 admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:20.923510 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a01d49-7d5a-4cbd-b814-83577f8de057 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:20.923781 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a01d49-7d5a-4cbd-b814-83577f8de057 admin admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:20.924414 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a01d49-7d5a-4cbd-b814-83577f8de057 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:20.926053 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a01d49-7d5a-4cbd-b814-83577f8de057 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:20.936101 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1280/2554] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:08:20 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:08:20.940078 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca96da76-99ac-42ad-b78b-2ef23bdd5812 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:20.951855 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca96da76-99ac-42ad-b78b-2ef23bdd5812 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:20.956571 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fbb3cd-5755-4ec6-8905-62ec262a0e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:20.957252 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fbb3cd-5755-4ec6-8905-62ec262a0e75 admin admin] REQUEST_METHOD: `PUT` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:20.957535 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fbb3cd-5755-4ec6-8905-62ec262a0e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:20.957976 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fbb3cd-5755-4ec6-8905-62ec262a0e75 admin admin] PATH_INFO: `/v3/projects/5d6e82df835443099d4c698fc588ed54/users/b31ae12725154715a82793ce0147d0b8/roles/ab4307f3b7994c1c80036fa7db93b6b9` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:20.974382 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fbb3cd-5755-4ec6-8905-62ec262a0e75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d6e82df835443099d4c698fc588ed54, user_id=b31ae12725154715a82793ce0147d0b8, role_id=ab4307f3b7994c1c80036fa7db93b6b9)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:20.977107 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fbb3cd-5755-4ec6-8905-62ec262a0e75 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:21.107644 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1275/2555] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Oct 4 12:08:20 2022] PUT /identity/v3/projects/5d6e82df835443099d4c698fc588ed54/users/b31ae12725154715a82793ce0147d0b8/roles/ab4307f3b7994c1c80036fa7db93b6b9 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:08:21.126488 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c331c1-5685-428c-afbe-94b34a213cce None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:21.126833 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c331c1-5685-428c-afbe-94b34a213cce None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:21.127118 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c331c1-5685-428c-afbe-94b34a213cce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:21.157703 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-60c331c1-5685-428c-afbe-94b34a213cce None None] MFA Rules not processed for user `b31ae12725154715a82793ce0147d0b8`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:08:21.158960 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-60c331c1-5685-428c-afbe-94b34a213cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:08:21.204841 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:08:21.225872 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1281/2556] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:08:21 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:08:21.230400 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fbb3cd-5755-4ec6-8905-62ec262a0e75 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:21.298600 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fbb3cd-5755-4ec6-8905-62ec262a0e75 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:21.303768 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1a6e74-af71-4f4d-af1e-b62f4053443b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:21.305290 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1a6e74-af71-4f4d-af1e-b62f4053443b admin admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:21.305936 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1a6e74-af71-4f4d-af1e-b62f4053443b admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:21.306212 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1a6e74-af71-4f4d-af1e-b62f4053443b admin admin] PATH_INFO: `/v3/projects` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:21.306859 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1a6e74-af71-4f4d-af1e-b62f4053443b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:21.308813 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1a6e74-af71-4f4d-af1e-b62f4053443b admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:21.422748 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1276/2557] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Oct 4 12:08:21 2022] POST /identity/v3/projects => generated 383 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:08:21.433916 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c331c1-5685-428c-afbe-94b34a213cce None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:21.445440 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c331c1-5685-428c-afbe-94b34a213cce None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:21.502615 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f073e0e3-6c86-475e-bb49-916a61ac5839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:21.503226 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f073e0e3-6c86-475e-bb49-916a61ac5839 admin admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:21.503507 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f073e0e3-6c86-475e-bb49-916a61ac5839 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:21.503778 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f073e0e3-6c86-475e-bb49-916a61ac5839 admin admin] PATH_INFO: `/v3/users` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:21.504413 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f073e0e3-6c86-475e-bb49-916a61ac5839 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:21.507108 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f073e0e3-6c86-475e-bb49-916a61ac5839 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:21.613729 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1282/2558] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Oct 4 12:08:21 2022] POST /identity/v3/users => generated 298 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:08:21.618237 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1a6e74-af71-4f4d-af1e-b62f4053443b admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:21.628435 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1a6e74-af71-4f4d-af1e-b62f4053443b admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:21.633943 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbf528f-a12a-4f1f-9ef2-9fc8e38b1b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:21.634559 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbf528f-a12a-4f1f-9ef2-9fc8e38b1b84 admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:21.634826 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbf528f-a12a-4f1f-9ef2-9fc8e38b1b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:21.635102 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbf528f-a12a-4f1f-9ef2-9fc8e38b1b84 admin admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:21.635855 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbf528f-a12a-4f1f-9ef2-9fc8e38b1b84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:21.637540 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbf528f-a12a-4f1f-9ef2-9fc8e38b1b84 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:21.651592 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1277/2559] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:08:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:08:21.652838 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f073e0e3-6c86-475e-bb49-916a61ac5839 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:21.663744 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f073e0e3-6c86-475e-bb49-916a61ac5839 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:21.668730 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a2a12e-6534-4a31-b258-86fbdaaba7cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:21.669401 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a2a12e-6534-4a31-b258-86fbdaaba7cf admin admin] REQUEST_METHOD: `PUT` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:21.672382 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a2a12e-6534-4a31-b258-86fbdaaba7cf admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:21.672382 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a2a12e-6534-4a31-b258-86fbdaaba7cf admin admin] PATH_INFO: `/v3/projects/72497dbf85284d5db7f9d5d61d25e52c/users/2d840a5e463e4dc0a05ebcfaa2749edf/roles/d6e7421d1ff9451c808004b818354550` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:21.685823 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a2a12e-6534-4a31-b258-86fbdaaba7cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=72497dbf85284d5db7f9d5d61d25e52c, user_id=2d840a5e463e4dc0a05ebcfaa2749edf, role_id=d6e7421d1ff9451c808004b818354550)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:21.688492 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a2a12e-6534-4a31-b258-86fbdaaba7cf admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:21.773250 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1283/2560] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Oct 4 12:08:21 2022] PUT /identity/v3/projects/72497dbf85284d5db7f9d5d61d25e52c/users/2d840a5e463e4dc0a05ebcfaa2749edf/roles/d6e7421d1ff9451c808004b818354550 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:08:21.777243 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbf528f-a12a-4f1f-9ef2-9fc8e38b1b84 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:21.787651 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbf528f-a12a-4f1f-9ef2-9fc8e38b1b84 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:21.848059 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a3d6c9-9079-4edc-8b47-71a7510fd55f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:21.849266 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a3d6c9-9079-4edc-8b47-71a7510fd55f admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:21.849544 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a3d6c9-9079-4edc-8b47-71a7510fd55f admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:21.849919 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a3d6c9-9079-4edc-8b47-71a7510fd55f admin admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:21.850572 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a3d6c9-9079-4edc-8b47-71a7510fd55f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:21.852209 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a3d6c9-9079-4edc-8b47-71a7510fd55f admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:21.867471 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1278/2561] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:08:21 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:08:21.868919 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a2a12e-6534-4a31-b258-86fbdaaba7cf admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:21.881842 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a2a12e-6534-4a31-b258-86fbdaaba7cf admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:21.884888 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb729e7-3bd0-427a-9695-1d45cbb846a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:21.885650 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb729e7-3bd0-427a-9695-1d45cbb846a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:21.886002 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb729e7-3bd0-427a-9695-1d45cbb846a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:21.886347 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb729e7-3bd0-427a-9695-1d45cbb846a3 admin admin] PATH_INFO: `/v3/projects/72497dbf85284d5db7f9d5d61d25e52c/users/2d840a5e463e4dc0a05ebcfaa2749edf/roles/d6e7421d1ff9451c808004b818354550` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:21.888430 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb729e7-3bd0-427a-9695-1d45cbb846a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72497dbf85284d5db7f9d5d61d25e52c, user_id=2d840a5e463e4dc0a05ebcfaa2749edf, role_id=d6e7421d1ff9451c808004b818354550)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:21.891240 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb729e7-3bd0-427a-9695-1d45cbb846a3 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:21.913012 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1284/2562] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Oct 4 12:08:21 2022] PUT /identity/v3/projects/72497dbf85284d5db7f9d5d61d25e52c/users/2d840a5e463e4dc0a05ebcfaa2749edf/roles/d6e7421d1ff9451c808004b818354550 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:08:21.913729 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386b01e8-4088-4b67-b4f0-5d43c6bb929d None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:21.914013 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386b01e8-4088-4b67-b4f0-5d43c6bb929d None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:21.914288 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386b01e8-4088-4b67-b4f0-5d43c6bb929d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:21.945512 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-386b01e8-4088-4b67-b4f0-5d43c6bb929d None None] MFA Rules not processed for user `2d840a5e463e4dc0a05ebcfaa2749edf`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:08:21.946668 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-386b01e8-4088-4b67-b4f0-5d43c6bb929d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:08:21.960173 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:08:22.021958 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1279/2563] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:08:21 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:08:22.033417 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb729e7-3bd0-427a-9695-1d45cbb846a3 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:22.038907 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-ffb729e7-3bd0-427a-9695-1d45cbb846a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:08:22.097689 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb729e7-3bd0-427a-9695-1d45cbb846a3 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:22.101880 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2974c671-2c10-4f92-b04b-09ea53cab1ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e2a05b782424ab2928b5864f1bfd556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:22.102561 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2974c671-2c10-4f92-b04b-09ea53cab1ec service cinder] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:22.102905 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2974c671-2c10-4f92-b04b-09ea53cab1ec service cinder] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:22.103242 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2974c671-2c10-4f92-b04b-09ea53cab1ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:22.152381 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:08:22.161127 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2974c671-2c10-4f92-b04b-09ea53cab1ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:22.162601 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2974c671-2c10-4f92-b04b-09ea53cab1ec service cinder] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:22.171467 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1285/2564] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:08:22 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:08:28.108266 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386b01e8-4088-4b67-b4f0-5d43c6bb929d None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:28.119127 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386b01e8-4088-4b67-b4f0-5d43c6bb929d None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:28.122937 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f030e6fc-1ab9-4599-9b76-b030c0511714 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e2a05b782424ab2928b5864f1bfd556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:28.123549 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f030e6fc-1ab9-4599-9b76-b030c0511714 service cinder] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:28.123836 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f030e6fc-1ab9-4599-9b76-b030c0511714 service cinder] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:28.124109 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f030e6fc-1ab9-4599-9b76-b030c0511714 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:28.134320 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f030e6fc-1ab9-4599-9b76-b030c0511714 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:28.135762 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f030e6fc-1ab9-4599-9b76-b030c0511714 service cinder] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:28.145737 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1280/2565] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:08:28 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:08:28.465380 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2974c671-2c10-4f92-b04b-09ea53cab1ec service cinder] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:28.466826 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-2974c671-2c10-4f92-b04b-09ea53cab1ec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:08:28.528284 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2974c671-2c10-4f92-b04b-09ea53cab1ec service cinder] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:28.532162 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e23f21-c535-45cc-99b4-7bffc6b490ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7289515c5c44914a19daa439de98cb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:28.532800 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e23f21-c535-45cc-99b4-7bffc6b490ef service neutron] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:28.533180 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e23f21-c535-45cc-99b4-7bffc6b490ef service neutron] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:28.533469 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e23f21-c535-45cc-99b4-7bffc6b490ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:28.535259 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-74e23f21-c535-45cc-99b4-7bffc6b490ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:08:28.611731 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e23f21-c535-45cc-99b4-7bffc6b490ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:28.613470 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e23f21-c535-45cc-99b4-7bffc6b490ef service neutron] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:28.623810 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1286/2566] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:08:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:08:32.351418 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f030e6fc-1ab9-4599-9b76-b030c0511714 service cinder] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:32.353245 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-f030e6fc-1ab9-4599-9b76-b030c0511714 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:08:32.369340 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f030e6fc-1ab9-4599-9b76-b030c0511714 service cinder] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:32.373887 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1e170b-721f-4c5f-9a1d-463af5e1f535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:32.374510 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e170b-721f-4c5f-9a1d-463af5e1f535 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:32.374788 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e170b-721f-4c5f-9a1d-463af5e1f535 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:32.375059 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e170b-721f-4c5f-9a1d-463af5e1f535 admin admin] PATH_INFO: `/v3/users/6c95a1206a4a4788b47882c7bb3e7a61` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:32.376166 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1e170b-721f-4c5f-9a1d-463af5e1f535 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c95a1206a4a4788b47882c7bb3e7a61)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:32.378131 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1e170b-721f-4c5f-9a1d-463af5e1f535 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:32.580851 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-fc1e170b-721f-4c5f-9a1d-463af5e1f535 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c95a1206a4a4788b47882c7bb3e7a61'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:32.588381 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-fc1e170b-721f-4c5f-9a1d-463af5e1f535 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c95a1206a4a4788b47882c7bb3e7a61'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:32.589013 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-fc1e170b-721f-4c5f-9a1d-463af5e1f535 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c95a1206a4a4788b47882c7bb3e7a61'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:32.589633 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-fc1e170b-721f-4c5f-9a1d-463af5e1f535 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c95a1206a4a4788b47882c7bb3e7a61'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:32.695363 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-fc1e170b-721f-4c5f-9a1d-463af5e1f535 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c95a1206a4a4788b47882c7bb3e7a61'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:32.714181 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1281/2567] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Oct 4 12:08:32 2022] DELETE /identity/v3/users/6c95a1206a4a4788b47882c7bb3e7a61 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:08:32.996985 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e23f21-c535-45cc-99b4-7bffc6b490ef service neutron] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:33.007544 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e23f21-c535-45cc-99b4-7bffc6b490ef service neutron] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:33.064234 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4942d2-84dc-4048-a841-2942c850a593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:33.064889 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4942d2-84dc-4048-a841-2942c850a593 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:33.065169 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4942d2-84dc-4048-a841-2942c850a593 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:33.065491 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4942d2-84dc-4048-a841-2942c850a593 admin admin] PATH_INFO: `/v3/projects/bca736825afb4888a203f4ef789835b9` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:33.066547 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4942d2-84dc-4048-a841-2942c850a593 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bca736825afb4888a203f4ef789835b9)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:33.068988 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4942d2-84dc-4048-a841-2942c850a593 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:33.224753 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:08:33.228526 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-8f4942d2-84dc-4048-a841-2942c850a593 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bca736825afb4888a203f4ef789835b9', 'request_id': 'req-8f4942d2-84dc-4048-a841-2942c850a593'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:33.466104 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-8f4942d2-84dc-4048-a841-2942c850a593 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bca736825afb4888a203f4ef789835b9', 'request_id': 'req-8f4942d2-84dc-4048-a841-2942c850a593'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:33.474826 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-8f4942d2-84dc-4048-a841-2942c850a593 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bca736825afb4888a203f4ef789835b9', 'request_id': 'req-8f4942d2-84dc-4048-a841-2942c850a593'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:33.485847 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-8f4942d2-84dc-4048-a841-2942c850a593 admin admin] The token cache is being invalidate because project bca736825afb4888a203f4ef789835b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:08:33.486140 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-8f4942d2-84dc-4048-a841-2942c850a593 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:33.486825 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-8f4942d2-84dc-4048-a841-2942c850a593 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:33.488638 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1287/2568] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Oct 4 12:08:32 2022] DELETE /identity/v3/projects/bca736825afb4888a203f4ef789835b9 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:08:33.497756 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737cf5d3-979a-4ab4-b5ef-22c074ab58fd None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:33.498238 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737cf5d3-979a-4ab4-b5ef-22c074ab58fd None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:33.498326 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737cf5d3-979a-4ab4-b5ef-22c074ab58fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:33.519035 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-737cf5d3-979a-4ab4-b5ef-22c074ab58fd None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:08:33.521021 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-737cf5d3-979a-4ab4-b5ef-22c074ab58fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:08:33.584831 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1282/2569] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:08:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:08:33.592991 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eec5e41-5da7-4ce0-9b27-83602655d591 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:33.593279 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eec5e41-5da7-4ce0-9b27-83602655d591 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:33.593558 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eec5e41-5da7-4ce0-9b27-83602655d591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:33.614285 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-5eec5e41-5da7-4ce0-9b27-83602655d591 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:08:33.615526 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-5eec5e41-5da7-4ce0-9b27-83602655d591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:08:33.623438 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1288/2570] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:08:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:08:33.627826 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737cf5d3-979a-4ab4-b5ef-22c074ab58fd None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:33.639662 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737cf5d3-979a-4ab4-b5ef-22c074ab58fd None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:33.644302 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e8655a-ff9f-4498-a399-e27649775adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:33.645736 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e8655a-ff9f-4498-a399-e27649775adb admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:33.646020 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e8655a-ff9f-4498-a399-e27649775adb admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:33.646292 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e8655a-ff9f-4498-a399-e27649775adb admin admin] PATH_INFO: `/v3/domains` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:33.647679 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e8655a-ff9f-4498-a399-e27649775adb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:08:33.648001 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e8655a-ff9f-4498-a399-e27649775adb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:33.649865 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e8655a-ff9f-4498-a399-e27649775adb admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:33.653116 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:08:33.664102 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1283/2571] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Oct 4 12:08:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:08:33.668626 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eec5e41-5da7-4ce0-9b27-83602655d591 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:33.678253 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eec5e41-5da7-4ce0-9b27-83602655d591 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:33.683007 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ccf2cb-5128-4bc3-a9d3-973026dfcc7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:33.683602 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ccf2cb-5128-4bc3-a9d3-973026dfcc7a admin admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:33.693432 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ccf2cb-5128-4bc3-a9d3-973026dfcc7a admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:33.693432 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ccf2cb-5128-4bc3-a9d3-973026dfcc7a admin admin] PATH_INFO: `/v3/projects` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:33.693432 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ccf2cb-5128-4bc3-a9d3-973026dfcc7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:33.693432 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ccf2cb-5128-4bc3-a9d3-973026dfcc7a admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:33.796624 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1289/2572] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Oct 4 12:08:33 2022] POST /identity/v3/projects => generated 401 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:08:33.800744 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e8655a-ff9f-4498-a399-e27649775adb admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:33.810793 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e8655a-ff9f-4498-a399-e27649775adb admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:33.866505 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e79b278-fc3f-46dc-927d-aebfdb524e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:33.867170 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e79b278-fc3f-46dc-927d-aebfdb524e93 admin admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:33.867449 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e79b278-fc3f-46dc-927d-aebfdb524e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:33.867723 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e79b278-fc3f-46dc-927d-aebfdb524e93 admin admin] PATH_INFO: `/v3/users` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:33.868352 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e79b278-fc3f-46dc-927d-aebfdb524e93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:33.870279 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e79b278-fc3f-46dc-927d-aebfdb524e93 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:33.998554 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1284/2573] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Oct 4 12:08:33 2022] POST /identity/v3/users => generated 301 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 12:08:34.002790 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ccf2cb-5128-4bc3-a9d3-973026dfcc7a admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:34.013373 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ccf2cb-5128-4bc3-a9d3-973026dfcc7a admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:34.017876 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eca07d-4b59-486f-af5a-336005b99ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:34.018466 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eca07d-4b59-486f-af5a-336005b99ddf admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:34.018744 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eca07d-4b59-486f-af5a-336005b99ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:34.019018 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eca07d-4b59-486f-af5a-336005b99ddf admin admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:34.019654 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eca07d-4b59-486f-af5a-336005b99ddf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:34.022108 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eca07d-4b59-486f-af5a-336005b99ddf admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:34.031827 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1290/2574] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:08:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:08:34.036323 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e79b278-fc3f-46dc-927d-aebfdb524e93 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:34.047833 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e79b278-fc3f-46dc-927d-aebfdb524e93 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:34.053495 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41508399-a941-48e0-bb0c-7677a3e9423f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:34.054151 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41508399-a941-48e0-bb0c-7677a3e9423f admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:34.054429 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41508399-a941-48e0-bb0c-7677a3e9423f admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:34.062333 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41508399-a941-48e0-bb0c-7677a3e9423f admin admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:34.062333 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41508399-a941-48e0-bb0c-7677a3e9423f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:34.062333 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41508399-a941-48e0-bb0c-7677a3e9423f admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:34.069867 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1285/2575] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:08:34 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:08:34.074054 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eca07d-4b59-486f-af5a-336005b99ddf admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:34.084747 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eca07d-4b59-486f-af5a-336005b99ddf admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:34.089247 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6926f934-eee3-4268-850a-9ac6e3a0772a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:34.089875 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6926f934-eee3-4268-850a-9ac6e3a0772a admin admin] REQUEST_METHOD: `PUT` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:34.090149 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6926f934-eee3-4268-850a-9ac6e3a0772a admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:34.090423 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6926f934-eee3-4268-850a-9ac6e3a0772a admin admin] PATH_INFO: `/v3/projects/fc6016e37d9141e9bab6e57e30e8d610/users/71c06c74533f43b99e3b18d3e8c3cf9e/roles/ab4307f3b7994c1c80036fa7db93b6b9` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:34.105048 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6926f934-eee3-4268-850a-9ac6e3a0772a admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc6016e37d9141e9bab6e57e30e8d610, user_id=71c06c74533f43b99e3b18d3e8c3cf9e, role_id=ab4307f3b7994c1c80036fa7db93b6b9)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:34.107664 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6926f934-eee3-4268-850a-9ac6e3a0772a admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:34.261547 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1291/2576] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Oct 4 12:08:34 2022] PUT /identity/v3/projects/fc6016e37d9141e9bab6e57e30e8d610/users/71c06c74533f43b99e3b18d3e8c3cf9e/roles/ab4307f3b7994c1c80036fa7db93b6b9 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:08:34.266759 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd5c7b3-eaa5-42f9-8488-283a39135821 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:34.267050 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd5c7b3-eaa5-42f9-8488-283a39135821 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:34.267328 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd5c7b3-eaa5-42f9-8488-283a39135821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:34.286029 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-4bd5c7b3-eaa5-42f9-8488-283a39135821 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:08:34.287235 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-4bd5c7b3-eaa5-42f9-8488-283a39135821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:08:34.345927 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1286/2577] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:08:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 12:08:34.355557 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6926f934-eee3-4268-850a-9ac6e3a0772a admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:34.357350 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-6926f934-eee3-4268-850a-9ac6e3a0772a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:08:34.414745 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6926f934-eee3-4268-850a-9ac6e3a0772a admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:34.418421 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b8c3d0-e698-4058-a84e-b42994634447 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7289515c5c44914a19daa439de98cb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:34.419019 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b8c3d0-e698-4058-a84e-b42994634447 service neutron] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:34.419297 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b8c3d0-e698-4058-a84e-b42994634447 service neutron] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:34.419566 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b8c3d0-e698-4058-a84e-b42994634447 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:34.429105 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b8c3d0-e698-4058-a84e-b42994634447 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:34.430520 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b8c3d0-e698-4058-a84e-b42994634447 service neutron] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:34.439949 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1292/2578] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:08:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:08:34.554413 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd5c7b3-eaa5-42f9-8488-283a39135821 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:34.555834 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-4bd5c7b3-eaa5-42f9-8488-283a39135821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:08:34.567782 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd5c7b3-eaa5-42f9-8488-283a39135821 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:34.572369 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225db658-aae1-42d5-a0d7-a290dc3ea6bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:34.573091 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225db658-aae1-42d5-a0d7-a290dc3ea6bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:34.573382 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225db658-aae1-42d5-a0d7-a290dc3ea6bc admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:34.573658 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225db658-aae1-42d5-a0d7-a290dc3ea6bc admin admin] PATH_INFO: `/v3/users/b31ae12725154715a82793ce0147d0b8` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:34.574773 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225db658-aae1-42d5-a0d7-a290dc3ea6bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=b31ae12725154715a82793ce0147d0b8)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:34.576712 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225db658-aae1-42d5-a0d7-a290dc3ea6bc admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:34.866322 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-225db658-aae1-42d5-a0d7-a290dc3ea6bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b31ae12725154715a82793ce0147d0b8'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:34.874034 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-225db658-aae1-42d5-a0d7-a290dc3ea6bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b31ae12725154715a82793ce0147d0b8'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:34.874732 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-225db658-aae1-42d5-a0d7-a290dc3ea6bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b31ae12725154715a82793ce0147d0b8'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:34.875333 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-225db658-aae1-42d5-a0d7-a290dc3ea6bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b31ae12725154715a82793ce0147d0b8'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:34.975222 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-225db658-aae1-42d5-a0d7-a290dc3ea6bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b31ae12725154715a82793ce0147d0b8'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:34.981057 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:08:34.993813 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1287/2579] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Oct 4 12:08:34 2022] DELETE /identity/v3/users/b31ae12725154715a82793ce0147d0b8 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:08:34.998752 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd26a93d-c233-44d7-b21c-d87b09f6000a None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:34.999045 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd26a93d-c233-44d7-b21c-d87b09f6000a None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:34.999346 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd26a93d-c233-44d7-b21c-d87b09f6000a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:35.020468 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-bd26a93d-c233-44d7-b21c-d87b09f6000a None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:08:35.020468 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-bd26a93d-c233-44d7-b21c-d87b09f6000a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:08:35.083106 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1293/2580] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:08:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:08:35.095453 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225db658-aae1-42d5-a0d7-a290dc3ea6bc admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:35.095634 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-225db658-aae1-42d5-a0d7-a290dc3ea6bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:08:35.155709 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225db658-aae1-42d5-a0d7-a290dc3ea6bc admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:35.159601 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c430ffda-2b50-45c6-a76b-7d339d35d14a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7289515c5c44914a19daa439de98cb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:35.160254 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c430ffda-2b50-45c6-a76b-7d339d35d14a service neutron] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:35.160667 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c430ffda-2b50-45c6-a76b-7d339d35d14a service neutron] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:35.161021 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c430ffda-2b50-45c6-a76b-7d339d35d14a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:35.171363 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c430ffda-2b50-45c6-a76b-7d339d35d14a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:35.172829 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c430ffda-2b50-45c6-a76b-7d339d35d14a service neutron] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:35.183999 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1288/2581] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:08:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:08:35.702360 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd26a93d-c233-44d7-b21c-d87b09f6000a None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:35.704356 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-bd26a93d-c233-44d7-b21c-d87b09f6000a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:08:35.750189 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd26a93d-c233-44d7-b21c-d87b09f6000a None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:35.766002 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a0d7c8-813a-4c2c-8d8a-e6002e5812f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:35.766711 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a0d7c8-813a-4c2c-8d8a-e6002e5812f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:35.767060 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a0d7c8-813a-4c2c-8d8a-e6002e5812f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:35.767329 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a0d7c8-813a-4c2c-8d8a-e6002e5812f7 admin admin] PATH_INFO: `/v3/projects/5d6e82df835443099d4c698fc588ed54` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:35.768444 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a0d7c8-813a-4c2c-8d8a-e6002e5812f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d6e82df835443099d4c698fc588ed54)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:35.770776 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a0d7c8-813a-4c2c-8d8a-e6002e5812f7 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:35.777857 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:08:35.889949 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-d6a0d7c8-813a-4c2c-8d8a-e6002e5812f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d6e82df835443099d4c698fc588ed54', 'request_id': 'req-d6a0d7c8-813a-4c2c-8d8a-e6002e5812f7'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:35.986307 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-d6a0d7c8-813a-4c2c-8d8a-e6002e5812f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d6e82df835443099d4c698fc588ed54', 'request_id': 'req-d6a0d7c8-813a-4c2c-8d8a-e6002e5812f7'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:35.993848 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-d6a0d7c8-813a-4c2c-8d8a-e6002e5812f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d6e82df835443099d4c698fc588ed54', 'request_id': 'req-d6a0d7c8-813a-4c2c-8d8a-e6002e5812f7'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:36.005096 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-d6a0d7c8-813a-4c2c-8d8a-e6002e5812f7 admin admin] The token cache is being invalidate because project 5d6e82df835443099d4c698fc588ed54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:08:36.005465 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-d6a0d7c8-813a-4c2c-8d8a-e6002e5812f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:36.006287 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-d6a0d7c8-813a-4c2c-8d8a-e6002e5812f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:36.007965 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1294/2582] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Oct 4 12:08:35 2022] DELETE /identity/v3/projects/5d6e82df835443099d4c698fc588ed54 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:08:36.018828 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c430ffda-2b50-45c6-a76b-7d339d35d14a service neutron] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:36.019353 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463129b8-895f-4963-83ee-746e83cb3754 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:36.019671 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463129b8-895f-4963-83ee-746e83cb3754 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:36.020455 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463129b8-895f-4963-83ee-746e83cb3754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:36.031652 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c430ffda-2b50-45c6-a76b-7d339d35d14a service neutron] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:36.058212 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-463129b8-895f-4963-83ee-746e83cb3754 None None] MFA Rules not processed for user `71c06c74533f43b99e3b18d3e8c3cf9e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:08:36.060527 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-463129b8-895f-4963-83ee-746e83cb3754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:08:36.098846 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11268e74-f634-49fa-bf4f-d1dcb92546cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:36.099709 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11268e74-f634-49fa-bf4f-d1dcb92546cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:36.100257 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11268e74-f634-49fa-bf4f-d1dcb92546cd admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:36.100677 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11268e74-f634-49fa-bf4f-d1dcb92546cd admin admin] PATH_INFO: `/v3/users/2d840a5e463e4dc0a05ebcfaa2749edf` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:36.102182 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11268e74-f634-49fa-bf4f-d1dcb92546cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d840a5e463e4dc0a05ebcfaa2749edf)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:36.104380 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11268e74-f634-49fa-bf4f-d1dcb92546cd admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:36.152699 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1295/2583] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:08:36 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:08:36.157278 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463129b8-895f-4963-83ee-746e83cb3754 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:36.158544 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-463129b8-895f-4963-83ee-746e83cb3754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:08:36.172764 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463129b8-895f-4963-83ee-746e83cb3754 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:36.178214 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e794ce5c-5b4a-4225-9c56-1c827aaac652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:36.179007 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e794ce5c-5b4a-4225-9c56-1c827aaac652 admin admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:36.179396 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e794ce5c-5b4a-4225-9c56-1c827aaac652 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:36.179666 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e794ce5c-5b4a-4225-9c56-1c827aaac652 admin admin] PATH_INFO: `/v3/projects` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:36.180282 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e794ce5c-5b4a-4225-9c56-1c827aaac652 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:36.182206 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e794ce5c-5b4a-4225-9c56-1c827aaac652 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:36.352970 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1296/2584] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Oct 4 12:08:36 2022] POST /identity/v3/projects => generated 403 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 12:08:36.357009 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e794ce5c-5b4a-4225-9c56-1c827aaac652 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:36.436848 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e794ce5c-5b4a-4225-9c56-1c827aaac652 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:36.441850 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4154f2a0-f058-4303-a706-30ce010d1326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:36.442449 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4154f2a0-f058-4303-a706-30ce010d1326 admin admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:36.442726 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4154f2a0-f058-4303-a706-30ce010d1326 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:36.443204 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4154f2a0-f058-4303-a706-30ce010d1326 admin admin] PATH_INFO: `/v3/users` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:36.444035 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4154f2a0-f058-4303-a706-30ce010d1326 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:36.446186 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4154f2a0-f058-4303-a706-30ce010d1326 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:36.455638 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:08:36.472397 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-11268e74-f634-49fa-bf4f-d1dcb92546cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d840a5e463e4dc0a05ebcfaa2749edf'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:36.480100 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-11268e74-f634-49fa-bf4f-d1dcb92546cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d840a5e463e4dc0a05ebcfaa2749edf'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:36.480789 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-11268e74-f634-49fa-bf4f-d1dcb92546cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d840a5e463e4dc0a05ebcfaa2749edf'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:36.481385 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-11268e74-f634-49fa-bf4f-d1dcb92546cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d840a5e463e4dc0a05ebcfaa2749edf'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:36.544144 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1297/2585] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Oct 4 12:08:36 2022] POST /identity/v3/users => generated 308 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:08:36.547906 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4154f2a0-f058-4303-a706-30ce010d1326 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:36.553676 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-4154f2a0-f058-4303-a706-30ce010d1326 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:08:36.561446 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4154f2a0-f058-4303-a706-30ce010d1326 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:36.566202 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1913dc-447d-4d37-9818-9a0c6aeef264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:36.567072 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1913dc-447d-4d37-9818-9a0c6aeef264 admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:36.567072 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1913dc-447d-4d37-9818-9a0c6aeef264 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:36.567362 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1913dc-447d-4d37-9818-9a0c6aeef264 admin admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:36.567986 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1913dc-447d-4d37-9818-9a0c6aeef264 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:36.569600 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1913dc-447d-4d37-9818-9a0c6aeef264 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:36.579772 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1298/2586] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:08:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 12:08:36.581453 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-11268e74-f634-49fa-bf4f-d1dcb92546cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d840a5e463e4dc0a05ebcfaa2749edf'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:36.584319 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1913dc-447d-4d37-9818-9a0c6aeef264 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:36.594955 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1913dc-447d-4d37-9818-9a0c6aeef264 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:36.600462 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5fd639-7d43-4f27-b70e-b69e01462825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:36.601138 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5fd639-7d43-4f27-b70e-b69e01462825 admin admin] REQUEST_METHOD: `PUT` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:36.601430 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5fd639-7d43-4f27-b70e-b69e01462825 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:36.601720 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5fd639-7d43-4f27-b70e-b69e01462825 admin admin] PATH_INFO: `/v3/projects/aedfd3f27cf34880b5c21f875a3e533f/users/3bb31b6d00124d018dea61d3b51d21d0/roles/d6e7421d1ff9451c808004b818354550` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:36.602183 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1289/2587] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Oct 4 12:08:36 2022] DELETE /identity/v3/users/2d840a5e463e4dc0a05ebcfaa2749edf => generated 0 bytes in 584 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:08:36.617104 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5fd639-7d43-4f27-b70e-b69e01462825 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aedfd3f27cf34880b5c21f875a3e533f, user_id=3bb31b6d00124d018dea61d3b51d21d0, role_id=d6e7421d1ff9451c808004b818354550)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:36.619798 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5fd639-7d43-4f27-b70e-b69e01462825 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:36.727170 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1299/2588] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Oct 4 12:08:36 2022] PUT /identity/v3/projects/aedfd3f27cf34880b5c21f875a3e533f/users/3bb31b6d00124d018dea61d3b51d21d0/roles/d6e7421d1ff9451c808004b818354550 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:08:36.731787 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11268e74-f634-49fa-bf4f-d1dcb92546cd admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:36.743003 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:08:36.795239 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11268e74-f634-49fa-bf4f-d1dcb92546cd admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:36.857943 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5e3f2d-b5be-4020-b16d-0a71ffe18f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:36.858564 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5e3f2d-b5be-4020-b16d-0a71ffe18f7e admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:36.858961 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5e3f2d-b5be-4020-b16d-0a71ffe18f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:36.860886 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5e3f2d-b5be-4020-b16d-0a71ffe18f7e admin admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:36.861708 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5e3f2d-b5be-4020-b16d-0a71ffe18f7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:36.864211 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5e3f2d-b5be-4020-b16d-0a71ffe18f7e admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:36.875645 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1290/2589] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:08:36 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:08:36.880538 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5fd639-7d43-4f27-b70e-b69e01462825 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:36.891764 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5fd639-7d43-4f27-b70e-b69e01462825 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:36.897704 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d2a236-e6b5-4f18-ad6e-9c07d30654a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:36.898611 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d2a236-e6b5-4f18-ad6e-9c07d30654a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:36.898749 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d2a236-e6b5-4f18-ad6e-9c07d30654a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:36.898953 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d2a236-e6b5-4f18-ad6e-9c07d30654a4 admin admin] PATH_INFO: `/v3/projects/aedfd3f27cf34880b5c21f875a3e533f/users/3bb31b6d00124d018dea61d3b51d21d0/roles/d6e7421d1ff9451c808004b818354550` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:36.901403 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d2a236-e6b5-4f18-ad6e-9c07d30654a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aedfd3f27cf34880b5c21f875a3e533f, user_id=3bb31b6d00124d018dea61d3b51d21d0, role_id=d6e7421d1ff9451c808004b818354550)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:36.905042 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d2a236-e6b5-4f18-ad6e-9c07d30654a4 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:36.915403 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1300/2590] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Oct 4 12:08:36 2022] PUT /identity/v3/projects/aedfd3f27cf34880b5c21f875a3e533f/users/3bb31b6d00124d018dea61d3b51d21d0/roles/d6e7421d1ff9451c808004b818354550 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:08:37.187000 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5e3f2d-b5be-4020-b16d-0a71ffe18f7e admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:37.189390 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-4a5e3f2d-b5be-4020-b16d-0a71ffe18f7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:08:37.206072 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5e3f2d-b5be-4020-b16d-0a71ffe18f7e admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:37.281286 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae38045b-f0ce-4d40-b43d-b5004b1f4ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:37.281924 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae38045b-f0ce-4d40-b43d-b5004b1f4ad8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:37.282202 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae38045b-f0ce-4d40-b43d-b5004b1f4ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:37.282474 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae38045b-f0ce-4d40-b43d-b5004b1f4ad8 admin admin] PATH_INFO: `/v3/projects/72497dbf85284d5db7f9d5d61d25e52c` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:37.283759 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae38045b-f0ce-4d40-b43d-b5004b1f4ad8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72497dbf85284d5db7f9d5d61d25e52c)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:37.286039 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae38045b-f0ce-4d40-b43d-b5004b1f4ad8 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:37.410905 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-ae38045b-f0ce-4d40-b43d-b5004b1f4ad8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72497dbf85284d5db7f9d5d61d25e52c', 'request_id': 'req-ae38045b-f0ce-4d40-b43d-b5004b1f4ad8'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:37.418641 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-ae38045b-f0ce-4d40-b43d-b5004b1f4ad8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72497dbf85284d5db7f9d5d61d25e52c', 'request_id': 'req-ae38045b-f0ce-4d40-b43d-b5004b1f4ad8'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:37.421834 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:08:37.506521 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-ae38045b-f0ce-4d40-b43d-b5004b1f4ad8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72497dbf85284d5db7f9d5d61d25e52c', 'request_id': 'req-ae38045b-f0ce-4d40-b43d-b5004b1f4ad8'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:37.519326 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-ae38045b-f0ce-4d40-b43d-b5004b1f4ad8 admin admin] The token cache is being invalidate because project 72497dbf85284d5db7f9d5d61d25e52c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:08:37.519794 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-ae38045b-f0ce-4d40-b43d-b5004b1f4ad8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:37.520742 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-ae38045b-f0ce-4d40-b43d-b5004b1f4ad8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:37.522620 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1291/2591] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Oct 4 12:08:37 2022] DELETE /identity/v3/projects/72497dbf85284d5db7f9d5d61d25e52c => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:08:37.528684 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da974354-1a9a-4bf4-8d7f-4ebee8de1842 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:37.528684 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da974354-1a9a-4bf4-8d7f-4ebee8de1842 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:37.529174 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da974354-1a9a-4bf4-8d7f-4ebee8de1842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:37.549407 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-da974354-1a9a-4bf4-8d7f-4ebee8de1842 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:08:37.551558 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-da974354-1a9a-4bf4-8d7f-4ebee8de1842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:08:37.622114 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1301/2592] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:08:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:08:37.633584 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeddf27-61fc-45f8-9d6c-7e8efa4bd377 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:37.633974 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeddf27-61fc-45f8-9d6c-7e8efa4bd377 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:37.634196 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeddf27-61fc-45f8-9d6c-7e8efa4bd377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:37.655664 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-afeddf27-61fc-45f8-9d6c-7e8efa4bd377 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:08:37.656939 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-afeddf27-61fc-45f8-9d6c-7e8efa4bd377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:08:37.667286 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1292/2593] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:08:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:08:37.672545 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da974354-1a9a-4bf4-8d7f-4ebee8de1842 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:37.683787 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da974354-1a9a-4bf4-8d7f-4ebee8de1842 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:37.688868 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b770ab-9c7a-4502-b7fe-75fbcd6a8fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:37.689578 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b770ab-9c7a-4502-b7fe-75fbcd6a8fa5 admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:37.690046 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b770ab-9c7a-4502-b7fe-75fbcd6a8fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:37.690361 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b770ab-9c7a-4502-b7fe-75fbcd6a8fa5 admin admin] PATH_INFO: `/v3/domains` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:37.691049 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b770ab-9c7a-4502-b7fe-75fbcd6a8fa5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:08:37.691967 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b770ab-9c7a-4502-b7fe-75fbcd6a8fa5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:37.693655 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b770ab-9c7a-4502-b7fe-75fbcd6a8fa5 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:37.706352 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1302/2594] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Oct 4 12:08:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:08:37.711858 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeddf27-61fc-45f8-9d6c-7e8efa4bd377 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:37.721099 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeddf27-61fc-45f8-9d6c-7e8efa4bd377 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:37.725992 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39bcf9d-5450-4f1e-aa0f-e1e3b242543c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:37.761072 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39bcf9d-5450-4f1e-aa0f-e1e3b242543c admin admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:37.761072 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39bcf9d-5450-4f1e-aa0f-e1e3b242543c admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:37.761072 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39bcf9d-5450-4f1e-aa0f-e1e3b242543c admin admin] PATH_INFO: `/v3/projects` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:37.761072 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39bcf9d-5450-4f1e-aa0f-e1e3b242543c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:37.761072 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39bcf9d-5450-4f1e-aa0f-e1e3b242543c admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:37.900007 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1293/2595] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Oct 4 12:08:37 2022] POST /identity/v3/projects => generated 385 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 12:08:37.904176 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b770ab-9c7a-4502-b7fe-75fbcd6a8fa5 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:37.914510 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b770ab-9c7a-4502-b7fe-75fbcd6a8fa5 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:37.975311 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b6a6f1-884f-434b-878a-eac124c0e0dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:37.975923 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b6a6f1-884f-434b-878a-eac124c0e0dc admin admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:37.976208 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b6a6f1-884f-434b-878a-eac124c0e0dc admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:37.976480 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b6a6f1-884f-434b-878a-eac124c0e0dc admin admin] PATH_INFO: `/v3/users` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:37.977155 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b6a6f1-884f-434b-878a-eac124c0e0dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:37.979080 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b6a6f1-884f-434b-878a-eac124c0e0dc admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:38.112522 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1303/2596] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Oct 4 12:08:37 2022] POST /identity/v3/users => generated 293 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:08:38.117258 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39bcf9d-5450-4f1e-aa0f-e1e3b242543c admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:38.128316 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39bcf9d-5450-4f1e-aa0f-e1e3b242543c admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:38.133711 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3550ff1-6965-4588-b7b1-b0ad741e0798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:38.134331 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3550ff1-6965-4588-b7b1-b0ad741e0798 admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:38.134592 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3550ff1-6965-4588-b7b1-b0ad741e0798 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:38.134858 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3550ff1-6965-4588-b7b1-b0ad741e0798 admin admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:38.135505 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3550ff1-6965-4588-b7b1-b0ad741e0798 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:38.137138 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3550ff1-6965-4588-b7b1-b0ad741e0798 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:38.148031 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1294/2597] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:08:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:08:38.152181 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b6a6f1-884f-434b-878a-eac124c0e0dc admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:38.163040 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b6a6f1-884f-434b-878a-eac124c0e0dc admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:38.167592 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a349cce-abf1-4687-b5b9-243306dba7ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:38.168179 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a349cce-abf1-4687-b5b9-243306dba7ac admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:38.168470 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a349cce-abf1-4687-b5b9-243306dba7ac admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:38.168776 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a349cce-abf1-4687-b5b9-243306dba7ac admin admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:38.169406 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a349cce-abf1-4687-b5b9-243306dba7ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:38.170989 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a349cce-abf1-4687-b5b9-243306dba7ac admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:38.182300 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1304/2598] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:08:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:08:38.186391 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3550ff1-6965-4588-b7b1-b0ad741e0798 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:38.196338 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3550ff1-6965-4588-b7b1-b0ad741e0798 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:38.201155 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34db17d4-8980-4774-900e-477c942087ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:38.202997 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34db17d4-8980-4774-900e-477c942087ef admin admin] REQUEST_METHOD: `PUT` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:38.202997 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34db17d4-8980-4774-900e-477c942087ef admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:38.202997 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34db17d4-8980-4774-900e-477c942087ef admin admin] PATH_INFO: `/v3/projects/f1292cf88d3047158e12b3d3c58a467d/users/94867f491ffe45659a298c8d9e8f0143/roles/ab4307f3b7994c1c80036fa7db93b6b9` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:38.217028 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34db17d4-8980-4774-900e-477c942087ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1292cf88d3047158e12b3d3c58a467d, user_id=94867f491ffe45659a298c8d9e8f0143, role_id=ab4307f3b7994c1c80036fa7db93b6b9)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:38.219651 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34db17d4-8980-4774-900e-477c942087ef admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:38.330030 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1295/2599] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Oct 4 12:08:38 2022] PUT /identity/v3/projects/f1292cf88d3047158e12b3d3c58a467d/users/94867f491ffe45659a298c8d9e8f0143/roles/ab4307f3b7994c1c80036fa7db93b6b9 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:08:38.341993 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6662ac1-adbb-45d5-add2-2cad6d068287 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:38.342361 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6662ac1-adbb-45d5-add2-2cad6d068287 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:38.342633 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6662ac1-adbb-45d5-add2-2cad6d068287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:38.362877 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:08:38.372762 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-b6662ac1-adbb-45d5-add2-2cad6d068287 None None] MFA Rules not processed for user `94867f491ffe45659a298c8d9e8f0143`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:08:38.374017 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-b6662ac1-adbb-45d5-add2-2cad6d068287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:08:38.444586 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1305/2600] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:08:38 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:08:38.455992 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34db17d4-8980-4774-900e-477c942087ef admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:38.458552 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-34db17d4-8980-4774-900e-477c942087ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:08:38.519295 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34db17d4-8980-4774-900e-477c942087ef admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:38.524548 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ae6cc7-3ad8-4844-af63-0d4f03892c76 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e2a05b782424ab2928b5864f1bfd556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:38.525176 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ae6cc7-3ad8-4844-af63-0d4f03892c76 service cinder] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:38.525455 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ae6cc7-3ad8-4844-af63-0d4f03892c76 service cinder] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:38.525730 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ae6cc7-3ad8-4844-af63-0d4f03892c76 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:38.534724 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ae6cc7-3ad8-4844-af63-0d4f03892c76 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:38.536984 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ae6cc7-3ad8-4844-af63-0d4f03892c76 service cinder] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:38.546893 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1296/2601] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:08:38 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:08:38.636019 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792cf8fd-ccd8-474d-bb10-724d042f3d85 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:38.636515 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792cf8fd-ccd8-474d-bb10-724d042f3d85 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:38.636515 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792cf8fd-ccd8-474d-bb10-724d042f3d85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:38.666954 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-792cf8fd-ccd8-474d-bb10-724d042f3d85 None None] MFA Rules not processed for user `3bb31b6d00124d018dea61d3b51d21d0`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:08:38.668196 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-792cf8fd-ccd8-474d-bb10-724d042f3d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:08:38.741354 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1306/2602] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:08:38 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:08:40.579505 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ae6cc7-3ad8-4844-af63-0d4f03892c76 service cinder] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:40.581053 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-07ae6cc7-3ad8-4844-af63-0d4f03892c76 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:08:40.654826 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ae6cc7-3ad8-4844-af63-0d4f03892c76 service cinder] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:40.659364 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b168eed6-3e7c-4398-a48c-8dae1ef57c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:40.664454 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b168eed6-3e7c-4398-a48c-8dae1ef57c16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:40.664454 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b168eed6-3e7c-4398-a48c-8dae1ef57c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:40.664454 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b168eed6-3e7c-4398-a48c-8dae1ef57c16 admin admin] PATH_INFO: `/v3/users/71c06c74533f43b99e3b18d3e8c3cf9e` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:40.664454 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b168eed6-3e7c-4398-a48c-8dae1ef57c16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71c06c74533f43b99e3b18d3e8c3cf9e)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:40.664454 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b168eed6-3e7c-4398-a48c-8dae1ef57c16 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:40.685538 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:INSERT=3,keystone:DELETE=7,keystone:SELECT=90 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:08:40.928808 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-b168eed6-3e7c-4398-a48c-8dae1ef57c16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71c06c74533f43b99e3b18d3e8c3cf9e'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:40.935892 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-b168eed6-3e7c-4398-a48c-8dae1ef57c16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71c06c74533f43b99e3b18d3e8c3cf9e'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:40.936626 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-b168eed6-3e7c-4398-a48c-8dae1ef57c16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71c06c74533f43b99e3b18d3e8c3cf9e'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:40.937251 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-b168eed6-3e7c-4398-a48c-8dae1ef57c16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71c06c74533f43b99e3b18d3e8c3cf9e'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:41.048908 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-b168eed6-3e7c-4398-a48c-8dae1ef57c16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71c06c74533f43b99e3b18d3e8c3cf9e'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:41.068326 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1297/2603] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Oct 4 12:08:40 2022] DELETE /identity/v3/users/71c06c74533f43b99e3b18d3e8c3cf9e => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:08:41.337014 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792cf8fd-ccd8-474d-bb10-724d042f3d85 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:41.349228 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792cf8fd-ccd8-474d-bb10-724d042f3d85 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:41.408806 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883ce225-d5b0-4e20-b32f-6289ffd5c51d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:41.409439 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883ce225-d5b0-4e20-b32f-6289ffd5c51d admin admin] REQUEST_METHOD: `DELETE` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:41.409765 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883ce225-d5b0-4e20-b32f-6289ffd5c51d admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:41.410689 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883ce225-d5b0-4e20-b32f-6289ffd5c51d admin admin] PATH_INFO: `/v3/projects/fc6016e37d9141e9bab6e57e30e8d610` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:41.412345 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883ce225-d5b0-4e20-b32f-6289ffd5c51d admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc6016e37d9141e9bab6e57e30e8d610)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:41.414285 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883ce225-d5b0-4e20-b32f-6289ffd5c51d admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:41.565225 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:08:41.582439 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-883ce225-d5b0-4e20-b32f-6289ffd5c51d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc6016e37d9141e9bab6e57e30e8d610', 'request_id': 'req-883ce225-d5b0-4e20-b32f-6289ffd5c51d'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:41.711762 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-883ce225-d5b0-4e20-b32f-6289ffd5c51d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc6016e37d9141e9bab6e57e30e8d610', 'request_id': 'req-883ce225-d5b0-4e20-b32f-6289ffd5c51d'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:41.718951 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-883ce225-d5b0-4e20-b32f-6289ffd5c51d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc6016e37d9141e9bab6e57e30e8d610', 'request_id': 'req-883ce225-d5b0-4e20-b32f-6289ffd5c51d'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:41.730040 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-883ce225-d5b0-4e20-b32f-6289ffd5c51d admin admin] The token cache is being invalidate because project fc6016e37d9141e9bab6e57e30e8d610 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:08:41.730353 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-883ce225-d5b0-4e20-b32f-6289ffd5c51d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:41.731003 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-883ce225-d5b0-4e20-b32f-6289ffd5c51d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:41.732533 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1307/2604] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Oct 4 12:08:41 2022] DELETE /identity/v3/projects/fc6016e37d9141e9bab6e57e30e8d610 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:08:41.736573 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b168eed6-3e7c-4398-a48c-8dae1ef57c16 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:41.738270 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-b168eed6-3e7c-4398-a48c-8dae1ef57c16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:08:41.751223 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b168eed6-3e7c-4398-a48c-8dae1ef57c16 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:41.807574 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c38b1f2-3ac2-4514-86cf-bb025389fd99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:41.808218 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c38b1f2-3ac2-4514-86cf-bb025389fd99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:41.808501 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c38b1f2-3ac2-4514-86cf-bb025389fd99 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:41.808803 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c38b1f2-3ac2-4514-86cf-bb025389fd99 admin admin] PATH_INFO: `/v3/users/3bb31b6d00124d018dea61d3b51d21d0` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:41.809943 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c38b1f2-3ac2-4514-86cf-bb025389fd99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bb31b6d00124d018dea61d3b51d21d0)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:41.811872 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c38b1f2-3ac2-4514-86cf-bb025389fd99 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:42.133481 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-7c38b1f2-3ac2-4514-86cf-bb025389fd99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bb31b6d00124d018dea61d3b51d21d0'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:42.140309 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-7c38b1f2-3ac2-4514-86cf-bb025389fd99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bb31b6d00124d018dea61d3b51d21d0'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:42.140995 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-7c38b1f2-3ac2-4514-86cf-bb025389fd99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bb31b6d00124d018dea61d3b51d21d0'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:42.141598 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-7c38b1f2-3ac2-4514-86cf-bb025389fd99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bb31b6d00124d018dea61d3b51d21d0'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:42.292359 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-7c38b1f2-3ac2-4514-86cf-bb025389fd99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bb31b6d00124d018dea61d3b51d21d0'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:42.311397 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1298/2605] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Oct 4 12:08:41 2022] DELETE /identity/v3/users/3bb31b6d00124d018dea61d3b51d21d0 => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:08:42.574947 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883ce225-d5b0-4e20-b32f-6289ffd5c51d admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:42.576447 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-883ce225-d5b0-4e20-b32f-6289ffd5c51d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:08:42.589213 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883ce225-d5b0-4e20-b32f-6289ffd5c51d admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:42.647999 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b62df6e-f5e5-4ed6-a95e-7fb18d28aa06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:42.648646 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b62df6e-f5e5-4ed6-a95e-7fb18d28aa06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:42.648909 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b62df6e-f5e5-4ed6-a95e-7fb18d28aa06 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:42.649181 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b62df6e-f5e5-4ed6-a95e-7fb18d28aa06 admin admin] PATH_INFO: `/v3/projects/aedfd3f27cf34880b5c21f875a3e533f` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:42.650270 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b62df6e-f5e5-4ed6-a95e-7fb18d28aa06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aedfd3f27cf34880b5c21f875a3e533f)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:42.652196 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b62df6e-f5e5-4ed6-a95e-7fb18d28aa06 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:42.898768 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-6b62df6e-f5e5-4ed6-a95e-7fb18d28aa06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aedfd3f27cf34880b5c21f875a3e533f', 'request_id': 'req-6b62df6e-f5e5-4ed6-a95e-7fb18d28aa06'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:42.983485 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-6b62df6e-f5e5-4ed6-a95e-7fb18d28aa06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aedfd3f27cf34880b5c21f875a3e533f', 'request_id': 'req-6b62df6e-f5e5-4ed6-a95e-7fb18d28aa06'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:42.991366 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-6b62df6e-f5e5-4ed6-a95e-7fb18d28aa06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aedfd3f27cf34880b5c21f875a3e533f', 'request_id': 'req-6b62df6e-f5e5-4ed6-a95e-7fb18d28aa06'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:43.001583 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-6b62df6e-f5e5-4ed6-a95e-7fb18d28aa06 admin admin] The token cache is being invalidate because project aedfd3f27cf34880b5c21f875a3e533f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:08:43.001864 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-6b62df6e-f5e5-4ed6-a95e-7fb18d28aa06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:43.002492 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-6b62df6e-f5e5-4ed6-a95e-7fb18d28aa06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:43.003985 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1308/2606] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Oct 4 12:08:42 2022] DELETE /identity/v3/projects/aedfd3f27cf34880b5c21f875a3e533f => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:08:43.008849 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b94b54-e6fd-4175-a9de-fab0e56618cd None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:43.009347 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b94b54-e6fd-4175-a9de-fab0e56618cd None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:43.009455 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b94b54-e6fd-4175-a9de-fab0e56618cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:43.028325 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-01b94b54-e6fd-4175-a9de-fab0e56618cd None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:08:43.029538 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-01b94b54-e6fd-4175-a9de-fab0e56618cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:08:43.042806 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:08:43.090885 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1299/2607] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:08:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:08:43.099798 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a634f295-31c2-433f-8c00-87a3357ad8b0 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:43.100084 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a634f295-31c2-433f-8c00-87a3357ad8b0 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:43.100359 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a634f295-31c2-433f-8c00-87a3357ad8b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:43.141677 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-a634f295-31c2-433f-8c00-87a3357ad8b0 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:08:43.143022 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-a634f295-31c2-433f-8c00-87a3357ad8b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:08:43.152732 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1309/2608] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:08:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:08:43.157207 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b94b54-e6fd-4175-a9de-fab0e56618cd None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:43.167710 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b94b54-e6fd-4175-a9de-fab0e56618cd None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:43.172677 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd953d5-0e84-4fd9-a86c-a7f0f0ab3723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:43.173297 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd953d5-0e84-4fd9-a86c-a7f0f0ab3723 admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:43.175723 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd953d5-0e84-4fd9-a86c-a7f0f0ab3723 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:43.175723 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd953d5-0e84-4fd9-a86c-a7f0f0ab3723 admin admin] PATH_INFO: `/v3/domains` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:43.175723 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd953d5-0e84-4fd9-a86c-a7f0f0ab3723 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:08:43.175723 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd953d5-0e84-4fd9-a86c-a7f0f0ab3723 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:43.176665 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd953d5-0e84-4fd9-a86c-a7f0f0ab3723 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:43.189169 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1300/2609] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Oct 4 12:08:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:08:43.193405 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a634f295-31c2-433f-8c00-87a3357ad8b0 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:43.202984 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a634f295-31c2-433f-8c00-87a3357ad8b0 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:43.208352 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9db1dc-8a06-4c89-be15-f84448952149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:43.209017 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9db1dc-8a06-4c89-be15-f84448952149 admin admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:43.209299 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9db1dc-8a06-4c89-be15-f84448952149 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:43.209574 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9db1dc-8a06-4c89-be15-f84448952149 admin admin] PATH_INFO: `/v3/projects` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:43.210251 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9db1dc-8a06-4c89-be15-f84448952149 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:43.212224 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9db1dc-8a06-4c89-be15-f84448952149 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:43.329327 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1310/2610] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Oct 4 12:08:43 2022] POST /identity/v3/projects => generated 381 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:08:43.330133 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd953d5-0e84-4fd9-a86c-a7f0f0ab3723 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:43.341286 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd953d5-0e84-4fd9-a86c-a7f0f0ab3723 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:43.401686 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc84fa9-cd31-43c0-92f1-741f71d22d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:43.402293 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc84fa9-cd31-43c0-92f1-741f71d22d06 admin admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:43.402573 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc84fa9-cd31-43c0-92f1-741f71d22d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:43.402896 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc84fa9-cd31-43c0-92f1-741f71d22d06 admin admin] PATH_INFO: `/v3/users` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:43.403470 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc84fa9-cd31-43c0-92f1-741f71d22d06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:43.405417 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc84fa9-cd31-43c0-92f1-741f71d22d06 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:43.487819 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1301/2611] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Oct 4 12:08:43 2022] POST /identity/v3/users => generated 291 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:08:43.491570 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9db1dc-8a06-4c89-be15-f84448952149 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:43.502002 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9db1dc-8a06-4c89-be15-f84448952149 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:43.507334 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d29945-2aae-4617-b17f-3990cfe10e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:43.507943 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d29945-2aae-4617-b17f-3990cfe10e48 admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:43.508259 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d29945-2aae-4617-b17f-3990cfe10e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:43.508515 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d29945-2aae-4617-b17f-3990cfe10e48 admin admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:43.509199 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d29945-2aae-4617-b17f-3990cfe10e48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:43.510780 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d29945-2aae-4617-b17f-3990cfe10e48 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:43.522460 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1311/2612] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:08:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 12:08:43.526349 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc84fa9-cd31-43c0-92f1-741f71d22d06 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:43.536936 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc84fa9-cd31-43c0-92f1-741f71d22d06 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:43.541583 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c545f519-b4a8-48ff-ab4a-e94c17fcd43d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:43.542180 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c545f519-b4a8-48ff-ab4a-e94c17fcd43d admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:43.542456 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c545f519-b4a8-48ff-ab4a-e94c17fcd43d admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:43.542726 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c545f519-b4a8-48ff-ab4a-e94c17fcd43d admin admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:43.543355 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c545f519-b4a8-48ff-ab4a-e94c17fcd43d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:43.544960 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c545f519-b4a8-48ff-ab4a-e94c17fcd43d admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:43.556548 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1302/2613] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:08:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:08:43.560785 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d29945-2aae-4617-b17f-3990cfe10e48 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:43.569133 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:08:43.573187 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d29945-2aae-4617-b17f-3990cfe10e48 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:43.577954 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d1e759-7185-4be8-98ef-c03b8cb1d62f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:43.578849 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d1e759-7185-4be8-98ef-c03b8cb1d62f admin admin] REQUEST_METHOD: `PUT` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:43.579115 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d1e759-7185-4be8-98ef-c03b8cb1d62f admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:43.579335 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d1e759-7185-4be8-98ef-c03b8cb1d62f admin admin] PATH_INFO: `/v3/projects/bea1889c950e41ca8f9138ddaa4ff296/users/84adf6a1e0744f168af2bc09d252b74f/roles/ab4307f3b7994c1c80036fa7db93b6b9` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:43.595079 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d1e759-7185-4be8-98ef-c03b8cb1d62f admin admin] RBAC: Authorizing `identity:create_grant(project_id=bea1889c950e41ca8f9138ddaa4ff296, user_id=84adf6a1e0744f168af2bc09d252b74f, role_id=ab4307f3b7994c1c80036fa7db93b6b9)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:43.597790 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d1e759-7185-4be8-98ef-c03b8cb1d62f admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:43.667626 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1312/2614] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Oct 4 12:08:43 2022] PUT /identity/v3/projects/bea1889c950e41ca8f9138ddaa4ff296/users/84adf6a1e0744f168af2bc09d252b74f/roles/ab4307f3b7994c1c80036fa7db93b6b9 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:08:43.678304 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f2c8b7-225a-4a5d-90ae-e4e733d1a6d4 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:43.681045 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f2c8b7-225a-4a5d-90ae-e4e733d1a6d4 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:43.681045 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f2c8b7-225a-4a5d-90ae-e4e733d1a6d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:43.710037 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-f9f2c8b7-225a-4a5d-90ae-e4e733d1a6d4 None None] MFA Rules not processed for user `84adf6a1e0744f168af2bc09d252b74f`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:08:43.711248 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-f9f2c8b7-225a-4a5d-90ae-e4e733d1a6d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:08:43.780764 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1303/2615] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:08:43 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:08:43.785433 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d1e759-7185-4be8-98ef-c03b8cb1d62f admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:43.847658 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d1e759-7185-4be8-98ef-c03b8cb1d62f admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:43.852309 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054da679-8428-4c95-8cc5-f46bf4a7f667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:43.852940 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054da679-8428-4c95-8cc5-f46bf4a7f667 admin admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:43.853228 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054da679-8428-4c95-8cc5-f46bf4a7f667 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:43.853529 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054da679-8428-4c95-8cc5-f46bf4a7f667 admin admin] PATH_INFO: `/v3/projects` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:43.854165 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054da679-8428-4c95-8cc5-f46bf4a7f667 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:43.856060 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054da679-8428-4c95-8cc5-f46bf4a7f667 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:43.995147 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1313/2616] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Oct 4 12:08:43 2022] POST /identity/v3/projects => generated 379 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:08:43.996748 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f2c8b7-225a-4a5d-90ae-e4e733d1a6d4 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:44.009110 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f2c8b7-225a-4a5d-90ae-e4e733d1a6d4 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:44.022919 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:08:44.067122 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265f5de1-c3e9-4941-bafe-7ef212b82a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:44.067723 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265f5de1-c3e9-4941-bafe-7ef212b82a5f admin admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:44.068003 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265f5de1-c3e9-4941-bafe-7ef212b82a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:44.068275 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265f5de1-c3e9-4941-bafe-7ef212b82a5f admin admin] PATH_INFO: `/v3/users` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:44.068969 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265f5de1-c3e9-4941-bafe-7ef212b82a5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:44.070881 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265f5de1-c3e9-4941-bafe-7ef212b82a5f admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:44.161010 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1304/2617] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Oct 4 12:08:43 2022] POST /identity/v3/users => generated 296 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:08:44.165960 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054da679-8428-4c95-8cc5-f46bf4a7f667 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:44.177732 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054da679-8428-4c95-8cc5-f46bf4a7f667 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:44.182467 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb724a6-e7b5-4042-9a6e-805baccabb62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:44.183074 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb724a6-e7b5-4042-9a6e-805baccabb62 admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:44.183350 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb724a6-e7b5-4042-9a6e-805baccabb62 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:44.183616 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb724a6-e7b5-4042-9a6e-805baccabb62 admin admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:44.184260 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb724a6-e7b5-4042-9a6e-805baccabb62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:44.185939 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb724a6-e7b5-4042-9a6e-805baccabb62 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:44.197916 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1314/2618] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:08:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:08:44.202330 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265f5de1-c3e9-4941-bafe-7ef212b82a5f admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:44.212356 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265f5de1-c3e9-4941-bafe-7ef212b82a5f admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:44.217149 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c930d5-ce66-4564-997e-390dddea1b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:44.217804 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c930d5-ce66-4564-997e-390dddea1b6f admin admin] REQUEST_METHOD: `PUT` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:44.218075 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c930d5-ce66-4564-997e-390dddea1b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:44.218869 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c930d5-ce66-4564-997e-390dddea1b6f admin admin] PATH_INFO: `/v3/projects/b061702b1e1d4a9ead6df3eac4ea028f/users/245142ede7374328a6d56f397a31dae4/roles/d6e7421d1ff9451c808004b818354550` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:44.234509 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c930d5-ce66-4564-997e-390dddea1b6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b061702b1e1d4a9ead6df3eac4ea028f, user_id=245142ede7374328a6d56f397a31dae4, role_id=d6e7421d1ff9451c808004b818354550)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:44.237525 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c930d5-ce66-4564-997e-390dddea1b6f admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:44.352959 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1305/2619] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Oct 4 12:08:44 2022] PUT /identity/v3/projects/b061702b1e1d4a9ead6df3eac4ea028f/users/245142ede7374328a6d56f397a31dae4/roles/d6e7421d1ff9451c808004b818354550 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:08:44.362527 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb724a6-e7b5-4042-9a6e-805baccabb62 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:44.368522 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb724a6-e7b5-4042-9a6e-805baccabb62 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:44.427622 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22894b95-5d98-4055-a45a-e01a7fdcdeb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:44.428139 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22894b95-5d98-4055-a45a-e01a7fdcdeb1 admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:44.428416 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22894b95-5d98-4055-a45a-e01a7fdcdeb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:44.428710 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22894b95-5d98-4055-a45a-e01a7fdcdeb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:44.429343 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22894b95-5d98-4055-a45a-e01a7fdcdeb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:44.431077 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22894b95-5d98-4055-a45a-e01a7fdcdeb1 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:44.444864 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1315/2620] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:08:44 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:08:44.446120 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c930d5-ce66-4564-997e-390dddea1b6f admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:44.459369 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c930d5-ce66-4564-997e-390dddea1b6f admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:44.464160 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170566f8-c03f-4869-8dd8-c4cc23fbe5bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:44.464966 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170566f8-c03f-4869-8dd8-c4cc23fbe5bc admin admin] REQUEST_METHOD: `PUT` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:44.465306 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170566f8-c03f-4869-8dd8-c4cc23fbe5bc admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:44.465781 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170566f8-c03f-4869-8dd8-c4cc23fbe5bc admin admin] PATH_INFO: `/v3/projects/b061702b1e1d4a9ead6df3eac4ea028f/users/245142ede7374328a6d56f397a31dae4/roles/d6e7421d1ff9451c808004b818354550` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:44.467771 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170566f8-c03f-4869-8dd8-c4cc23fbe5bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=b061702b1e1d4a9ead6df3eac4ea028f, user_id=245142ede7374328a6d56f397a31dae4, role_id=d6e7421d1ff9451c808004b818354550)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:44.470480 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170566f8-c03f-4869-8dd8-c4cc23fbe5bc admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:44.481460 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1306/2621] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Oct 4 12:08:44 2022] PUT /identity/v3/projects/b061702b1e1d4a9ead6df3eac4ea028f/users/245142ede7374328a6d56f397a31dae4/roles/d6e7421d1ff9451c808004b818354550 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:08:44.493653 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2713b79-a44d-4f03-af32-c74b64336505 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:44.493950 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2713b79-a44d-4f03-af32-c74b64336505 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:44.494302 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2713b79-a44d-4f03-af32-c74b64336505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:44.523238 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-f2713b79-a44d-4f03-af32-c74b64336505 None None] MFA Rules not processed for user `245142ede7374328a6d56f397a31dae4`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:08:44.524468 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-f2713b79-a44d-4f03-af32-c74b64336505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:08:44.563420 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:08:44.590225 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1316/2622] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:08:44 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:08:44.602550 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170566f8-c03f-4869-8dd8-c4cc23fbe5bc admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:44.604246 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-170566f8-c03f-4869-8dd8-c4cc23fbe5bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:08:44.780349 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170566f8-c03f-4869-8dd8-c4cc23fbe5bc admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:44.783911 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b3782b-1cfd-4d76-8742-5990acb1bcfb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e2a05b782424ab2928b5864f1bfd556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:44.784507 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b3782b-1cfd-4d76-8742-5990acb1bcfb service cinder] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:44.784842 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b3782b-1cfd-4d76-8742-5990acb1bcfb service cinder] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:44.785678 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b3782b-1cfd-4d76-8742-5990acb1bcfb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:44.794575 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b3782b-1cfd-4d76-8742-5990acb1bcfb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:44.795982 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b3782b-1cfd-4d76-8742-5990acb1bcfb service cinder] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:44.805711 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1307/2623] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:08:44 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:08:45.049862 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2713b79-a44d-4f03-af32-c74b64336505 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:45.051993 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-f2713b79-a44d-4f03-af32-c74b64336505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:08:45.063739 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2713b79-a44d-4f03-af32-c74b64336505 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:45.067339 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3da50a3-8841-495c-a1b4-12eed5fdacf9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e2a05b782424ab2928b5864f1bfd556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:45.067932 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3da50a3-8841-495c-a1b4-12eed5fdacf9 service cinder] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:45.068304 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3da50a3-8841-495c-a1b4-12eed5fdacf9 service cinder] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:45.068487 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3da50a3-8841-495c-a1b4-12eed5fdacf9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:45.125897 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3da50a3-8841-495c-a1b4-12eed5fdacf9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:45.127330 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3da50a3-8841-495c-a1b4-12eed5fdacf9 service cinder] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:45.136910 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1317/2624] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:08:45 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:08:46.305560 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b3782b-1cfd-4d76-8742-5990acb1bcfb service cinder] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:46.306962 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-f6b3782b-1cfd-4d76-8742-5990acb1bcfb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:08:46.370564 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b3782b-1cfd-4d76-8742-5990acb1bcfb service cinder] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:46.374903 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e1e784-48ba-4232-8e71-c973ffaa66f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:46.375519 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e1e784-48ba-4232-8e71-c973ffaa66f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:46.375796 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e1e784-48ba-4232-8e71-c973ffaa66f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:46.376065 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e1e784-48ba-4232-8e71-c973ffaa66f6 admin admin] PATH_INFO: `/v3/users/94867f491ffe45659a298c8d9e8f0143` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:46.377190 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e1e784-48ba-4232-8e71-c973ffaa66f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94867f491ffe45659a298c8d9e8f0143)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:46.379776 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e1e784-48ba-4232-8e71-c973ffaa66f6 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:46.391646 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:08:46.606066 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-20e1e784-48ba-4232-8e71-c973ffaa66f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94867f491ffe45659a298c8d9e8f0143'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:46.613094 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-20e1e784-48ba-4232-8e71-c973ffaa66f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94867f491ffe45659a298c8d9e8f0143'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:46.614865 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-20e1e784-48ba-4232-8e71-c973ffaa66f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94867f491ffe45659a298c8d9e8f0143'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:46.615474 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-20e1e784-48ba-4232-8e71-c973ffaa66f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94867f491ffe45659a298c8d9e8f0143'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:46.711907 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-20e1e784-48ba-4232-8e71-c973ffaa66f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94867f491ffe45659a298c8d9e8f0143'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:46.736247 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1308/2625] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Oct 4 12:08:46 2022] DELETE /identity/v3/users/94867f491ffe45659a298c8d9e8f0143 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:08:46.742117 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0051c40d-0494-4b7f-80b8-261b62c15149 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:46.742617 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0051c40d-0494-4b7f-80b8-261b62c15149 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:46.742715 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0051c40d-0494-4b7f-80b8-261b62c15149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:46.770230 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-0051c40d-0494-4b7f-80b8-261b62c15149 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:08:46.771486 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-0051c40d-0494-4b7f-80b8-261b62c15149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:08:46.838906 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1318/2626] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:08:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:08:46.850246 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e1e784-48ba-4232-8e71-c973ffaa66f6 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:46.851793 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-20e1e784-48ba-4232-8e71-c973ffaa66f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:08:46.914200 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e1e784-48ba-4232-8e71-c973ffaa66f6 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:46.920531 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2d5937-ad76-4025-ad43-561ce81ca5de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7289515c5c44914a19daa439de98cb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:46.920531 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2d5937-ad76-4025-ad43-561ce81ca5de service neutron] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:46.920531 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2d5937-ad76-4025-ad43-561ce81ca5de service neutron] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:46.920531 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2d5937-ad76-4025-ad43-561ce81ca5de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:46.928189 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2d5937-ad76-4025-ad43-561ce81ca5de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:46.929631 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2d5937-ad76-4025-ad43-561ce81ca5de service neutron] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:46.938954 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1309/2627] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:08:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:08:47.419936 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0051c40d-0494-4b7f-80b8-261b62c15149 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:47.421958 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-0051c40d-0494-4b7f-80b8-261b62c15149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:08:47.435822 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0051c40d-0494-4b7f-80b8-261b62c15149 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:47.440422 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510cc96e-f538-4a80-a345-a237f8ef0e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:47.441615 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510cc96e-f538-4a80-a345-a237f8ef0e6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:47.442084 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510cc96e-f538-4a80-a345-a237f8ef0e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:47.442578 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510cc96e-f538-4a80-a345-a237f8ef0e6b admin admin] PATH_INFO: `/v3/projects/f1292cf88d3047158e12b3d3c58a467d` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:47.443736 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510cc96e-f538-4a80-a345-a237f8ef0e6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1292cf88d3047158e12b3d3c58a467d)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:47.445715 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510cc96e-f538-4a80-a345-a237f8ef0e6b admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:47.565922 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-510cc96e-f538-4a80-a345-a237f8ef0e6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1292cf88d3047158e12b3d3c58a467d', 'request_id': 'req-510cc96e-f538-4a80-a345-a237f8ef0e6b'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:47.640776 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-510cc96e-f538-4a80-a345-a237f8ef0e6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1292cf88d3047158e12b3d3c58a467d', 'request_id': 'req-510cc96e-f538-4a80-a345-a237f8ef0e6b'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:47.649062 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-510cc96e-f538-4a80-a345-a237f8ef0e6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1292cf88d3047158e12b3d3c58a467d', 'request_id': 'req-510cc96e-f538-4a80-a345-a237f8ef0e6b'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:47.664880 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:08:47.673078 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-510cc96e-f538-4a80-a345-a237f8ef0e6b admin admin] The token cache is being invalidate because project f1292cf88d3047158e12b3d3c58a467d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:08:47.673367 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-510cc96e-f538-4a80-a345-a237f8ef0e6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:47.674016 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-510cc96e-f538-4a80-a345-a237f8ef0e6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:47.675599 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1319/2628] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Oct 4 12:08:47 2022] DELETE /identity/v3/projects/f1292cf88d3047158e12b3d3c58a467d => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:08:47.680504 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91911056-8bc9-4e9a-a94f-b501d51a019d None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:47.681006 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91911056-8bc9-4e9a-a94f-b501d51a019d None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:47.681145 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91911056-8bc9-4e9a-a94f-b501d51a019d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:47.701517 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-91911056-8bc9-4e9a-a94f-b501d51a019d None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:08:47.702713 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-91911056-8bc9-4e9a-a94f-b501d51a019d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:08:47.764374 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1310/2629] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:08:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:08:47.772289 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd8b19d-d9e6-47d3-ad37-e3ef90d5c09b None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:47.772782 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd8b19d-d9e6-47d3-ad37-e3ef90d5c09b None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:47.772906 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd8b19d-d9e6-47d3-ad37-e3ef90d5c09b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:47.792666 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-0bd8b19d-d9e6-47d3-ad37-e3ef90d5c09b None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:08:47.793869 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-0bd8b19d-d9e6-47d3-ad37-e3ef90d5c09b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:08:47.802909 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1320/2630] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:08:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:08:47.807408 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91911056-8bc9-4e9a-a94f-b501d51a019d None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:47.817517 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91911056-8bc9-4e9a-a94f-b501d51a019d None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:47.822149 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c9cdff-5b0d-4fc2-bc29-b74ae61d19a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:47.822744 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c9cdff-5b0d-4fc2-bc29-b74ae61d19a6 admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:47.823022 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c9cdff-5b0d-4fc2-bc29-b74ae61d19a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:47.823291 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c9cdff-5b0d-4fc2-bc29-b74ae61d19a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:47.823998 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c9cdff-5b0d-4fc2-bc29-b74ae61d19a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:08:47.824298 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c9cdff-5b0d-4fc2-bc29-b74ae61d19a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:47.826024 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c9cdff-5b0d-4fc2-bc29-b74ae61d19a6 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:47.838049 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1311/2631] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Oct 4 12:08:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 12:08:47.842463 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd8b19d-d9e6-47d3-ad37-e3ef90d5c09b None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:47.852579 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd8b19d-d9e6-47d3-ad37-e3ef90d5c09b None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:47.857364 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f338fdbb-829c-4a54-a499-c32f5e396b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:47.858125 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f338fdbb-829c-4a54-a499-c32f5e396b1d admin admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:47.858220 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f338fdbb-829c-4a54-a499-c32f5e396b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:47.858458 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f338fdbb-829c-4a54-a499-c32f5e396b1d admin admin] PATH_INFO: `/v3/projects` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:47.859096 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f338fdbb-829c-4a54-a499-c32f5e396b1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:47.861026 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f338fdbb-829c-4a54-a499-c32f5e396b1d admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:47.965589 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1321/2632] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Oct 4 12:08:47 2022] POST /identity/v3/projects => generated 383 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:08:47.971283 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c9cdff-5b0d-4fc2-bc29-b74ae61d19a6 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:47.980958 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c9cdff-5b0d-4fc2-bc29-b74ae61d19a6 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:47.999186 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:08:48.040556 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbef62d-5e27-4e02-8184-27ff6dead86c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:48.041198 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbef62d-5e27-4e02-8184-27ff6dead86c admin admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:48.041480 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbef62d-5e27-4e02-8184-27ff6dead86c admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:48.041750 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbef62d-5e27-4e02-8184-27ff6dead86c admin admin] PATH_INFO: `/v3/users` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:48.042395 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbef62d-5e27-4e02-8184-27ff6dead86c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:48.044295 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbef62d-5e27-4e02-8184-27ff6dead86c admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:48.140906 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1312/2633] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Oct 4 12:08:47 2022] POST /identity/v3/users => generated 292 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 12:08:48.146345 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f338fdbb-829c-4a54-a499-c32f5e396b1d admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:48.156622 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f338fdbb-829c-4a54-a499-c32f5e396b1d admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:48.161332 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e220e8a2-e0ef-4eda-9ca5-e882a3d04b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:48.161929 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e220e8a2-e0ef-4eda-9ca5-e882a3d04b82 admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:48.162202 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e220e8a2-e0ef-4eda-9ca5-e882a3d04b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:48.162467 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e220e8a2-e0ef-4eda-9ca5-e882a3d04b82 admin admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:48.163099 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e220e8a2-e0ef-4eda-9ca5-e882a3d04b82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:48.164699 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e220e8a2-e0ef-4eda-9ca5-e882a3d04b82 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:48.174522 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1322/2634] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:08:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:08:48.178547 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbef62d-5e27-4e02-8184-27ff6dead86c admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:48.188704 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbef62d-5e27-4e02-8184-27ff6dead86c admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:48.194295 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d3533d-4296-493d-88db-5d1ff6b064db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:48.195261 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d3533d-4296-493d-88db-5d1ff6b064db admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:48.195651 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d3533d-4296-493d-88db-5d1ff6b064db admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:48.196046 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d3533d-4296-493d-88db-5d1ff6b064db admin admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:48.197236 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d3533d-4296-493d-88db-5d1ff6b064db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:48.199469 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d3533d-4296-493d-88db-5d1ff6b064db admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:48.211147 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1313/2635] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:08:48 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:08:48.215344 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e220e8a2-e0ef-4eda-9ca5-e882a3d04b82 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:48.225655 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e220e8a2-e0ef-4eda-9ca5-e882a3d04b82 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:48.230252 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e837c5-2fb0-4f9b-a6c1-69410a99ddc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:48.230893 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e837c5-2fb0-4f9b-a6c1-69410a99ddc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:48.231166 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e837c5-2fb0-4f9b-a6c1-69410a99ddc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:48.231434 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e837c5-2fb0-4f9b-a6c1-69410a99ddc6 admin admin] PATH_INFO: `/v3/projects/9355f5b023644262b00f5791ea43fe87/users/061fde88cb8a4784872438840236ace4/roles/ab4307f3b7994c1c80036fa7db93b6b9` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:48.245984 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e837c5-2fb0-4f9b-a6c1-69410a99ddc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9355f5b023644262b00f5791ea43fe87, user_id=061fde88cb8a4784872438840236ace4, role_id=ab4307f3b7994c1c80036fa7db93b6b9)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:48.248592 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e837c5-2fb0-4f9b-a6c1-69410a99ddc6 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:48.350187 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1323/2636] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Oct 4 12:08:48 2022] PUT /identity/v3/projects/9355f5b023644262b00f5791ea43fe87/users/061fde88cb8a4784872438840236ace4/roles/ab4307f3b7994c1c80036fa7db93b6b9 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:08:48.418121 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cc8743-3585-4427-895f-c5f88a41ed92 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:48.418407 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cc8743-3585-4427-895f-c5f88a41ed92 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:48.418684 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cc8743-3585-4427-895f-c5f88a41ed92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:48.452696 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-32cc8743-3585-4427-895f-c5f88a41ed92 None None] MFA Rules not processed for user `061fde88cb8a4784872438840236ace4`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:08:48.454477 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-32cc8743-3585-4427-895f-c5f88a41ed92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:08:48.527653 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1314/2637] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:08:48 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:08:48.532099 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e837c5-2fb0-4f9b-a6c1-69410a99ddc6 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:48.596295 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e837c5-2fb0-4f9b-a6c1-69410a99ddc6 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:48.602111 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a23d08f-fe5c-4817-bd65-5285be4a6745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:48.602718 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a23d08f-fe5c-4817-bd65-5285be4a6745 admin admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:48.602994 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a23d08f-fe5c-4817-bd65-5285be4a6745 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:48.603266 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a23d08f-fe5c-4817-bd65-5285be4a6745 admin admin] PATH_INFO: `/v3/projects` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:48.603898 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a23d08f-fe5c-4817-bd65-5285be4a6745 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:48.605849 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a23d08f-fe5c-4817-bd65-5285be4a6745 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:48.704483 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1324/2638] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Oct 4 12:08:48 2022] POST /identity/v3/projects => generated 383 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 12:08:48.709074 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cc8743-3585-4427-895f-c5f88a41ed92 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:48.723281 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cc8743-3585-4427-895f-c5f88a41ed92 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:48.788789 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afa8ea9-b871-488f-a25e-dad6deda01d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:48.789407 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afa8ea9-b871-488f-a25e-dad6deda01d9 admin admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:48.789685 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afa8ea9-b871-488f-a25e-dad6deda01d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:48.789954 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afa8ea9-b871-488f-a25e-dad6deda01d9 admin admin] PATH_INFO: `/v3/users` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:48.790588 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afa8ea9-b871-488f-a25e-dad6deda01d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:48.792496 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afa8ea9-b871-488f-a25e-dad6deda01d9 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:48.935280 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1315/2639] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Oct 4 12:08:48 2022] POST /identity/v3/users => generated 292 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 12:08:48.939517 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a23d08f-fe5c-4817-bd65-5285be4a6745 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:48.954330 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a23d08f-fe5c-4817-bd65-5285be4a6745 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:48.962920 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42a2e13-a1a6-4471-ba91-5363c05afb92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:48.965682 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42a2e13-a1a6-4471-ba91-5363c05afb92 admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:48.965682 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42a2e13-a1a6-4471-ba91-5363c05afb92 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:48.965682 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42a2e13-a1a6-4471-ba91-5363c05afb92 admin admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:48.965682 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42a2e13-a1a6-4471-ba91-5363c05afb92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:48.966500 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42a2e13-a1a6-4471-ba91-5363c05afb92 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:48.978421 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1325/2640] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:08:48 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:08:48.982461 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afa8ea9-b871-488f-a25e-dad6deda01d9 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:48.993755 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afa8ea9-b871-488f-a25e-dad6deda01d9 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:48.998092 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53822b0b-b8a2-448e-80f9-159a4625a4e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:48.998697 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53822b0b-b8a2-448e-80f9-159a4625a4e4 admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:49.005493 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53822b0b-b8a2-448e-80f9-159a4625a4e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:49.005493 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53822b0b-b8a2-448e-80f9-159a4625a4e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:49.005493 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53822b0b-b8a2-448e-80f9-159a4625a4e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:49.005493 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53822b0b-b8a2-448e-80f9-159a4625a4e4 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:49.012670 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1316/2641] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:08:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:08:49.017073 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42a2e13-a1a6-4471-ba91-5363c05afb92 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:49.029586 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42a2e13-a1a6-4471-ba91-5363c05afb92 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:49.034272 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf111664-e60c-4248-8cad-e59b21c5e22e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:49.035489 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf111664-e60c-4248-8cad-e59b21c5e22e admin admin] REQUEST_METHOD: `PUT` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:49.035779 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf111664-e60c-4248-8cad-e59b21c5e22e admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:49.036056 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf111664-e60c-4248-8cad-e59b21c5e22e admin admin] PATH_INFO: `/v3/projects/1dc1327e2b15477393d93baa37533142/users/ad295c6d65a34a678d03bf7c3bc4ea39/roles/ab4307f3b7994c1c80036fa7db93b6b9` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:49.052877 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf111664-e60c-4248-8cad-e59b21c5e22e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1dc1327e2b15477393d93baa37533142, user_id=ad295c6d65a34a678d03bf7c3bc4ea39, role_id=ab4307f3b7994c1c80036fa7db93b6b9)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:49.055986 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf111664-e60c-4248-8cad-e59b21c5e22e admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:49.209826 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1326/2642] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Oct 4 12:08:49 2022] PUT /identity/v3/projects/1dc1327e2b15477393d93baa37533142/users/ad295c6d65a34a678d03bf7c3bc4ea39/roles/ab4307f3b7994c1c80036fa7db93b6b9 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:08:49.220711 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864d5f37-d95c-4abc-a56c-0afd5963044a None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:49.221000 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864d5f37-d95c-4abc-a56c-0afd5963044a None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:49.221283 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864d5f37-d95c-4abc-a56c-0afd5963044a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:49.235391 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:08:49.249352 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-864d5f37-d95c-4abc-a56c-0afd5963044a None None] MFA Rules not processed for user `ad295c6d65a34a678d03bf7c3bc4ea39`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:08:49.250556 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-864d5f37-d95c-4abc-a56c-0afd5963044a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:08:49.315756 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1317/2643] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:08:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:08:49.320581 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf111664-e60c-4248-8cad-e59b21c5e22e admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:49.366620 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:08:49.383350 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf111664-e60c-4248-8cad-e59b21c5e22e admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:49.388041 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae23d45-760c-4d1f-ae42-755316958911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:49.388670 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae23d45-760c-4d1f-ae42-755316958911 admin admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:49.388953 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae23d45-760c-4d1f-ae42-755316958911 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:49.389224 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae23d45-760c-4d1f-ae42-755316958911 admin admin] PATH_INFO: `/v3/projects` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:49.389849 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae23d45-760c-4d1f-ae42-755316958911 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:49.391746 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae23d45-760c-4d1f-ae42-755316958911 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:49.502325 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1327/2644] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Oct 4 12:08:49 2022] POST /identity/v3/projects => generated 383 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:08:49.506902 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864d5f37-d95c-4abc-a56c-0afd5963044a None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:49.526093 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864d5f37-d95c-4abc-a56c-0afd5963044a None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:49.590105 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44e877b-28ba-40cd-a67d-8f97ba764122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:49.590728 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44e877b-28ba-40cd-a67d-8f97ba764122 admin admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:49.591014 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44e877b-28ba-40cd-a67d-8f97ba764122 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:49.591362 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44e877b-28ba-40cd-a67d-8f97ba764122 admin admin] PATH_INFO: `/v3/users` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:49.592010 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44e877b-28ba-40cd-a67d-8f97ba764122 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:49.594098 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44e877b-28ba-40cd-a67d-8f97ba764122 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:49.694047 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1318/2645] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Oct 4 12:08:49 2022] POST /identity/v3/users => generated 298 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:08:49.698203 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae23d45-760c-4d1f-ae42-755316958911 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:49.709070 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae23d45-760c-4d1f-ae42-755316958911 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:49.713627 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c39b39-4b14-411d-b055-bc36c0d7fab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:49.714221 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c39b39-4b14-411d-b055-bc36c0d7fab6 admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:49.714498 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c39b39-4b14-411d-b055-bc36c0d7fab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:49.714812 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c39b39-4b14-411d-b055-bc36c0d7fab6 admin admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:49.715495 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c39b39-4b14-411d-b055-bc36c0d7fab6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:49.717126 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c39b39-4b14-411d-b055-bc36c0d7fab6 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:49.727074 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1328/2646] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:08:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:08:49.731377 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44e877b-28ba-40cd-a67d-8f97ba764122 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:49.742053 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44e877b-28ba-40cd-a67d-8f97ba764122 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:49.746676 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e06c192-315c-4c26-bba8-9804ef3efe12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:49.747331 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e06c192-315c-4c26-bba8-9804ef3efe12 admin admin] REQUEST_METHOD: `PUT` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:49.747606 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e06c192-315c-4c26-bba8-9804ef3efe12 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:49.747883 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e06c192-315c-4c26-bba8-9804ef3efe12 admin admin] PATH_INFO: `/v3/projects/a21f97c1230f4b90975d8d1b92c9c484/users/10cd1ad1a8944da7a45cc9e71365586a/roles/d6e7421d1ff9451c808004b818354550` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:49.763041 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e06c192-315c-4c26-bba8-9804ef3efe12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a21f97c1230f4b90975d8d1b92c9c484, user_id=10cd1ad1a8944da7a45cc9e71365586a, role_id=d6e7421d1ff9451c808004b818354550)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:49.765709 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e06c192-315c-4c26-bba8-9804ef3efe12 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:49.903972 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1319/2647] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Oct 4 12:08:49 2022] PUT /identity/v3/projects/a21f97c1230f4b90975d8d1b92c9c484/users/10cd1ad1a8944da7a45cc9e71365586a/roles/d6e7421d1ff9451c808004b818354550 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:08:49.908119 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c39b39-4b14-411d-b055-bc36c0d7fab6 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:49.918991 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c39b39-4b14-411d-b055-bc36c0d7fab6 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:49.977865 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7e9020-20cb-43a9-997d-baf7ce384c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:49.978631 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7e9020-20cb-43a9-997d-baf7ce384c7c admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:49.978744 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7e9020-20cb-43a9-997d-baf7ce384c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:49.979024 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7e9020-20cb-43a9-997d-baf7ce384c7c admin admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:49.979673 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7e9020-20cb-43a9-997d-baf7ce384c7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:49.981318 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7e9020-20cb-43a9-997d-baf7ce384c7c admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:49.992198 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1329/2648] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:08:49 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:08:49.996409 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e06c192-315c-4c26-bba8-9804ef3efe12 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:50.007766 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e06c192-315c-4c26-bba8-9804ef3efe12 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:50.012467 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91c9e1b-88b3-4fee-9551-e2ae5aafcecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:50.013210 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91c9e1b-88b3-4fee-9551-e2ae5aafcecf admin admin] REQUEST_METHOD: `PUT` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:50.013427 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91c9e1b-88b3-4fee-9551-e2ae5aafcecf admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:50.013696 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91c9e1b-88b3-4fee-9551-e2ae5aafcecf admin admin] PATH_INFO: `/v3/projects/a21f97c1230f4b90975d8d1b92c9c484/users/10cd1ad1a8944da7a45cc9e71365586a/roles/d6e7421d1ff9451c808004b818354550` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:50.015640 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91c9e1b-88b3-4fee-9551-e2ae5aafcecf admin admin] RBAC: Authorizing `identity:create_grant(project_id=a21f97c1230f4b90975d8d1b92c9c484, user_id=10cd1ad1a8944da7a45cc9e71365586a, role_id=d6e7421d1ff9451c808004b818354550)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:50.018268 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91c9e1b-88b3-4fee-9551-e2ae5aafcecf admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:50.029210 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1320/2649] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Oct 4 12:08:49 2022] PUT /identity/v3/projects/a21f97c1230f4b90975d8d1b92c9c484/users/10cd1ad1a8944da7a45cc9e71365586a/roles/d6e7421d1ff9451c808004b818354550 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:08:50.048385 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b68b88e-a836-4f0e-8a01-895ae84ecb02 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:50.048710 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b68b88e-a836-4f0e-8a01-895ae84ecb02 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:50.048990 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b68b88e-a836-4f0e-8a01-895ae84ecb02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:50.080889 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-5b68b88e-a836-4f0e-8a01-895ae84ecb02 None None] MFA Rules not processed for user `10cd1ad1a8944da7a45cc9e71365586a`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:08:50.082124 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-5b68b88e-a836-4f0e-8a01-895ae84ecb02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:08:50.152005 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1330/2650] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:08:50 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:08:50.164165 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91c9e1b-88b3-4fee-9551-e2ae5aafcecf admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:50.165923 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-f91c9e1b-88b3-4fee-9551-e2ae5aafcecf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:08:50.219112 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:08:50.223276 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91c9e1b-88b3-4fee-9551-e2ae5aafcecf admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:50.228165 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde8b1d3-7ce8-4b15-8079-bc3e8eac88fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e2a05b782424ab2928b5864f1bfd556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:50.229230 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde8b1d3-7ce8-4b15-8079-bc3e8eac88fe service cinder] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:50.229619 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde8b1d3-7ce8-4b15-8079-bc3e8eac88fe service cinder] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:50.229899 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde8b1d3-7ce8-4b15-8079-bc3e8eac88fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:50.287484 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde8b1d3-7ce8-4b15-8079-bc3e8eac88fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:50.288876 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde8b1d3-7ce8-4b15-8079-bc3e8eac88fe service cinder] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:50.304332 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1321/2651] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:08:50 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:08:52.615238 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b68b88e-a836-4f0e-8a01-895ae84ecb02 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:52.625043 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b68b88e-a836-4f0e-8a01-895ae84ecb02 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:52.628545 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6b0f95-a974-4616-b411-a7b6e2395574 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e2a05b782424ab2928b5864f1bfd556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:52.629492 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b0f95-a974-4616-b411-a7b6e2395574 service cinder] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:52.629774 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b0f95-a974-4616-b411-a7b6e2395574 service cinder] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:52.630045 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b0f95-a974-4616-b411-a7b6e2395574 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:52.668463 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:08:52.687599 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6b0f95-a974-4616-b411-a7b6e2395574 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:52.689138 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6b0f95-a974-4616-b411-a7b6e2395574 service cinder] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:52.698641 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1331/2652] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:08:52 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:08:54.296513 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde8b1d3-7ce8-4b15-8079-bc3e8eac88fe service cinder] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:54.309340 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde8b1d3-7ce8-4b15-8079-bc3e8eac88fe service cinder] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:54.313243 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab61d4e9-1d99-45bb-9196-7dafa79f9f64 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e2a05b782424ab2928b5864f1bfd556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:54.313900 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab61d4e9-1d99-45bb-9196-7dafa79f9f64 service cinder] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:54.314180 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab61d4e9-1d99-45bb-9196-7dafa79f9f64 service cinder] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:54.314592 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab61d4e9-1d99-45bb-9196-7dafa79f9f64 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:54.324135 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab61d4e9-1d99-45bb-9196-7dafa79f9f64 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:54.325672 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab61d4e9-1d99-45bb-9196-7dafa79f9f64 service cinder] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:54.336147 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1322/2653] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:08:54 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:08:54.460413 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6b0f95-a974-4616-b411-a7b6e2395574 service cinder] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:54.461884 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-eb6b0f95-a974-4616-b411-a7b6e2395574 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:08:54.533191 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6b0f95-a974-4616-b411-a7b6e2395574 service cinder] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:54.538927 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc688390-a2f3-4a84-963c-a8736748f9c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:54.539554 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc688390-a2f3-4a84-963c-a8736748f9c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:54.539831 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc688390-a2f3-4a84-963c-a8736748f9c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:54.540102 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc688390-a2f3-4a84-963c-a8736748f9c6 admin admin] PATH_INFO: `/v3/users/84adf6a1e0744f168af2bc09d252b74f` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:54.541243 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc688390-a2f3-4a84-963c-a8736748f9c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=84adf6a1e0744f168af2bc09d252b74f)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:54.543162 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc688390-a2f3-4a84-963c-a8736748f9c6 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:54.797713 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-cc688390-a2f3-4a84-963c-a8736748f9c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84adf6a1e0744f168af2bc09d252b74f'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:54.804623 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-cc688390-a2f3-4a84-963c-a8736748f9c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84adf6a1e0744f168af2bc09d252b74f'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:54.805300 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-cc688390-a2f3-4a84-963c-a8736748f9c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84adf6a1e0744f168af2bc09d252b74f'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:54.805882 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-cc688390-a2f3-4a84-963c-a8736748f9c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84adf6a1e0744f168af2bc09d252b74f'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:54.905647 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-cc688390-a2f3-4a84-963c-a8736748f9c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84adf6a1e0744f168af2bc09d252b74f'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:54.923817 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1332/2654] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Oct 4 12:08:54 2022] DELETE /identity/v3/users/84adf6a1e0744f168af2bc09d252b74f => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:08:54.929004 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7db19ca-c42b-43c2-bfa4-c1d42ba328d0 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:54.929328 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7db19ca-c42b-43c2-bfa4-c1d42ba328d0 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:54.929611 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7db19ca-c42b-43c2-bfa4-c1d42ba328d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:54.948904 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-d7db19ca-c42b-43c2-bfa4-c1d42ba328d0 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:08:54.950141 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-d7db19ca-c42b-43c2-bfa4-c1d42ba328d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:08:55.009629 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1323/2655] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:08:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:08:55.020247 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc688390-a2f3-4a84-963c-a8736748f9c6 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:55.021800 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-cc688390-a2f3-4a84-963c-a8736748f9c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:08:55.079532 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc688390-a2f3-4a84-963c-a8736748f9c6 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:55.083234 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b13444-3eab-4bbd-b614-60a5e8ada626 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7289515c5c44914a19daa439de98cb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:55.083839 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b13444-3eab-4bbd-b614-60a5e8ada626 service neutron] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:55.084121 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b13444-3eab-4bbd-b614-60a5e8ada626 service neutron] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:55.084393 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b13444-3eab-4bbd-b614-60a5e8ada626 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:55.093614 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b13444-3eab-4bbd-b614-60a5e8ada626 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:55.095042 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b13444-3eab-4bbd-b614-60a5e8ada626 service neutron] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:55.100249 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:08:55.105709 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1333/2656] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:08:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:08:55.768130 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7db19ca-c42b-43c2-bfa4-c1d42ba328d0 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:55.769742 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-d7db19ca-c42b-43c2-bfa4-c1d42ba328d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:08:55.783830 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7db19ca-c42b-43c2-bfa4-c1d42ba328d0 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:55.789622 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d602bc6-1912-44f3-82b4-c790a1c7d488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:55.790369 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d602bc6-1912-44f3-82b4-c790a1c7d488 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:55.790714 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d602bc6-1912-44f3-82b4-c790a1c7d488 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:55.791045 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d602bc6-1912-44f3-82b4-c790a1c7d488 admin admin] PATH_INFO: `/v3/projects/bea1889c950e41ca8f9138ddaa4ff296` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:55.792818 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d602bc6-1912-44f3-82b4-c790a1c7d488 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bea1889c950e41ca8f9138ddaa4ff296)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:55.795048 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d602bc6-1912-44f3-82b4-c790a1c7d488 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:55.921301 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-0d602bc6-1912-44f3-82b4-c790a1c7d488 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bea1889c950e41ca8f9138ddaa4ff296', 'request_id': 'req-0d602bc6-1912-44f3-82b4-c790a1c7d488'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:55.927957 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-0d602bc6-1912-44f3-82b4-c790a1c7d488 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bea1889c950e41ca8f9138ddaa4ff296', 'request_id': 'req-0d602bc6-1912-44f3-82b4-c790a1c7d488'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:56.023045 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-0d602bc6-1912-44f3-82b4-c790a1c7d488 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bea1889c950e41ca8f9138ddaa4ff296', 'request_id': 'req-0d602bc6-1912-44f3-82b4-c790a1c7d488'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:56.034162 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-0d602bc6-1912-44f3-82b4-c790a1c7d488 admin admin] The token cache is being invalidate because project bea1889c950e41ca8f9138ddaa4ff296 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:08:56.034426 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-0d602bc6-1912-44f3-82b4-c790a1c7d488 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:56.035593 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-0d602bc6-1912-44f3-82b4-c790a1c7d488 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:56.037181 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1324/2657] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Oct 4 12:08:55 2022] DELETE /identity/v3/projects/bea1889c950e41ca8f9138ddaa4ff296 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:08:56.041325 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b13444-3eab-4bbd-b614-60a5e8ada626 service neutron] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:56.051877 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b13444-3eab-4bbd-b614-60a5e8ada626 service neutron] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:56.112625 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b362cd4f-38b9-4bf4-bfc4-6239e7ceae59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:56.113677 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b362cd4f-38b9-4bf4-bfc4-6239e7ceae59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:56.113952 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b362cd4f-38b9-4bf4-bfc4-6239e7ceae59 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:56.114225 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b362cd4f-38b9-4bf4-bfc4-6239e7ceae59 admin admin] PATH_INFO: `/v3/users/245142ede7374328a6d56f397a31dae4` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:56.115397 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b362cd4f-38b9-4bf4-bfc4-6239e7ceae59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=245142ede7374328a6d56f397a31dae4)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:56.117417 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b362cd4f-38b9-4bf4-bfc4-6239e7ceae59 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:56.377023 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-b362cd4f-38b9-4bf4-bfc4-6239e7ceae59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '245142ede7374328a6d56f397a31dae4'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:56.384727 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-b362cd4f-38b9-4bf4-bfc4-6239e7ceae59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '245142ede7374328a6d56f397a31dae4'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:56.385419 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-b362cd4f-38b9-4bf4-bfc4-6239e7ceae59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '245142ede7374328a6d56f397a31dae4'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:56.386046 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-b362cd4f-38b9-4bf4-bfc4-6239e7ceae59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '245142ede7374328a6d56f397a31dae4'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:56.468850 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-b362cd4f-38b9-4bf4-bfc4-6239e7ceae59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '245142ede7374328a6d56f397a31dae4'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:56.488426 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1334/2658] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Oct 4 12:08:56 2022] DELETE /identity/v3/users/245142ede7374328a6d56f397a31dae4 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:08:56.988952 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d602bc6-1912-44f3-82b4-c790a1c7d488 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:56.990512 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-0d602bc6-1912-44f3-82b4-c790a1c7d488 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:08:57.008580 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d602bc6-1912-44f3-82b4-c790a1c7d488 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:57.019023 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:08:57.079512 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fcb764-2609-4360-b48a-f3fb7fd1fd88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:57.080157 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fcb764-2609-4360-b48a-f3fb7fd1fd88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:57.080435 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fcb764-2609-4360-b48a-f3fb7fd1fd88 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:57.080744 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fcb764-2609-4360-b48a-f3fb7fd1fd88 admin admin] PATH_INFO: `/v3/projects/b061702b1e1d4a9ead6df3eac4ea028f` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:57.082159 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fcb764-2609-4360-b48a-f3fb7fd1fd88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b061702b1e1d4a9ead6df3eac4ea028f)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:57.084057 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fcb764-2609-4360-b48a-f3fb7fd1fd88 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:57.224419 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-66fcb764-2609-4360-b48a-f3fb7fd1fd88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b061702b1e1d4a9ead6df3eac4ea028f', 'request_id': 'req-66fcb764-2609-4360-b48a-f3fb7fd1fd88'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:57.230656 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-66fcb764-2609-4360-b48a-f3fb7fd1fd88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b061702b1e1d4a9ead6df3eac4ea028f', 'request_id': 'req-66fcb764-2609-4360-b48a-f3fb7fd1fd88'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:57.328331 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-66fcb764-2609-4360-b48a-f3fb7fd1fd88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b061702b1e1d4a9ead6df3eac4ea028f', 'request_id': 'req-66fcb764-2609-4360-b48a-f3fb7fd1fd88'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:57.339942 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-66fcb764-2609-4360-b48a-f3fb7fd1fd88 admin admin] The token cache is being invalidate because project b061702b1e1d4a9ead6df3eac4ea028f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:08:57.340227 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-66fcb764-2609-4360-b48a-f3fb7fd1fd88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:57.340871 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-66fcb764-2609-4360-b48a-f3fb7fd1fd88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:57.342371 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1325/2659] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Oct 4 12:08:56 2022] DELETE /identity/v3/projects/b061702b1e1d4a9ead6df3eac4ea028f => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:08:57.348061 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2cb0b9-f576-43cb-93db-c7f8f07ca19b None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:57.348545 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2cb0b9-f576-43cb-93db-c7f8f07ca19b None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:57.348781 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2cb0b9-f576-43cb-93db-c7f8f07ca19b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:57.369869 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-ae2cb0b9-f576-43cb-93db-c7f8f07ca19b None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:08:57.371094 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-ae2cb0b9-f576-43cb-93db-c7f8f07ca19b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:08:57.431202 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1335/2660] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:08:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:08:57.439276 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2527d0f5-98f2-421c-b4e8-d003771a469a None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:57.440782 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2527d0f5-98f2-421c-b4e8-d003771a469a None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:57.440782 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2527d0f5-98f2-421c-b4e8-d003771a469a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:57.461235 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-2527d0f5-98f2-421c-b4e8-d003771a469a None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:08:57.462447 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-2527d0f5-98f2-421c-b4e8-d003771a469a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:08:57.470529 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1326/2661] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:08:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:08:57.475294 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2cb0b9-f576-43cb-93db-c7f8f07ca19b None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:57.485081 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2cb0b9-f576-43cb-93db-c7f8f07ca19b None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:57.490010 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8acff2d-e3da-4a49-b0c6-9a98799d5211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:57.490654 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8acff2d-e3da-4a49-b0c6-9a98799d5211 admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:57.490928 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8acff2d-e3da-4a49-b0c6-9a98799d5211 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:57.491195 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8acff2d-e3da-4a49-b0c6-9a98799d5211 admin admin] PATH_INFO: `/v3/domains` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:57.491880 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8acff2d-e3da-4a49-b0c6-9a98799d5211 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:08:57.492178 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8acff2d-e3da-4a49-b0c6-9a98799d5211 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:57.493838 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8acff2d-e3da-4a49-b0c6-9a98799d5211 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:57.505498 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1336/2662] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Oct 4 12:08:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:08:57.510012 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2527d0f5-98f2-421c-b4e8-d003771a469a None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:57.520378 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2527d0f5-98f2-421c-b4e8-d003771a469a None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:57.526884 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99c85ef-e97e-474f-aea0-05d400f2f4c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:57.526884 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99c85ef-e97e-474f-aea0-05d400f2f4c9 admin admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:57.526884 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99c85ef-e97e-474f-aea0-05d400f2f4c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:57.526884 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99c85ef-e97e-474f-aea0-05d400f2f4c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:57.527850 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99c85ef-e97e-474f-aea0-05d400f2f4c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:57.528868 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99c85ef-e97e-474f-aea0-05d400f2f4c9 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:57.624703 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1327/2663] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Oct 4 12:08:57 2022] POST /identity/v3/projects => generated 365 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:08:57.628885 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8acff2d-e3da-4a49-b0c6-9a98799d5211 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:57.640820 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8acff2d-e3da-4a49-b0c6-9a98799d5211 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:57.643130 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:08:57.698474 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d33606-d128-4c79-bab1-38a80ec2cf89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:57.699130 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d33606-d128-4c79-bab1-38a80ec2cf89 admin admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:57.699409 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d33606-d128-4c79-bab1-38a80ec2cf89 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:57.699680 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d33606-d128-4c79-bab1-38a80ec2cf89 admin admin] PATH_INFO: `/v3/users` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:57.700329 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d33606-d128-4c79-bab1-38a80ec2cf89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:57.702280 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d33606-d128-4c79-bab1-38a80ec2cf89 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:57.826539 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1337/2664] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Oct 4 12:08:57 2022] POST /identity/v3/users => generated 283 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:08:57.839544 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99c85ef-e97e-474f-aea0-05d400f2f4c9 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:57.854241 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99c85ef-e97e-474f-aea0-05d400f2f4c9 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:57.858875 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b37632a-254d-4a59-adb7-7038c113b173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:57.859539 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b37632a-254d-4a59-adb7-7038c113b173 admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:57.859882 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b37632a-254d-4a59-adb7-7038c113b173 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:57.860216 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b37632a-254d-4a59-adb7-7038c113b173 admin admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:57.860960 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b37632a-254d-4a59-adb7-7038c113b173 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:57.862995 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b37632a-254d-4a59-adb7-7038c113b173 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:57.873117 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1328/2665] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:08:57 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:08:57.883214 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d33606-d128-4c79-bab1-38a80ec2cf89 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:57.893127 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d33606-d128-4c79-bab1-38a80ec2cf89 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:57.899776 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8969e29-3cc0-4eed-b4e6-4017229867da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:57.900382 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8969e29-3cc0-4eed-b4e6-4017229867da admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:57.903344 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8969e29-3cc0-4eed-b4e6-4017229867da admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:57.903344 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8969e29-3cc0-4eed-b4e6-4017229867da admin admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:57.903344 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8969e29-3cc0-4eed-b4e6-4017229867da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:57.903344 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8969e29-3cc0-4eed-b4e6-4017229867da admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:57.913051 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1338/2666] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:08:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:08:57.917231 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b37632a-254d-4a59-adb7-7038c113b173 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:57.927587 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b37632a-254d-4a59-adb7-7038c113b173 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:57.932226 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13b49fe-47a6-4ec2-b4e6-dfb15bc25de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:57.932918 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13b49fe-47a6-4ec2-b4e6-dfb15bc25de2 admin admin] REQUEST_METHOD: `PUT` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:57.933190 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13b49fe-47a6-4ec2-b4e6-dfb15bc25de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:57.933459 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13b49fe-47a6-4ec2-b4e6-dfb15bc25de2 admin admin] PATH_INFO: `/v3/projects/98c714a02f914659800ee2acf245ecf2/users/0211720df394480ba23d9c33762cc7cb/roles/ab4307f3b7994c1c80036fa7db93b6b9` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:57.948228 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13b49fe-47a6-4ec2-b4e6-dfb15bc25de2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98c714a02f914659800ee2acf245ecf2, user_id=0211720df394480ba23d9c33762cc7cb, role_id=ab4307f3b7994c1c80036fa7db93b6b9)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:57.950961 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13b49fe-47a6-4ec2-b4e6-dfb15bc25de2 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:58.077888 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1329/2667] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Oct 4 12:08:57 2022] PUT /identity/v3/projects/98c714a02f914659800ee2acf245ecf2/users/0211720df394480ba23d9c33762cc7cb/roles/ab4307f3b7994c1c80036fa7db93b6b9 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:08:58.089517 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fa42d6-6bd6-483d-885c-471e2d6719da None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:58.089961 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fa42d6-6bd6-483d-885c-471e2d6719da None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:58.090238 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fa42d6-6bd6-483d-885c-471e2d6719da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:58.121420 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-e7fa42d6-6bd6-483d-885c-471e2d6719da None None] MFA Rules not processed for user `0211720df394480ba23d9c33762cc7cb`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:08:58.122628 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-e7fa42d6-6bd6-483d-885c-471e2d6719da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:08:58.199719 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1339/2668] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:08:58 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:08:58.204224 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13b49fe-47a6-4ec2-b4e6-dfb15bc25de2 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:58.246931 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:08:58.266337 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13b49fe-47a6-4ec2-b4e6-dfb15bc25de2 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:58.271377 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1212a90f-9ff8-47c1-8244-742417704d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:58.271958 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1212a90f-9ff8-47c1-8244-742417704d49 admin admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:58.272240 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1212a90f-9ff8-47c1-8244-742417704d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:58.272520 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1212a90f-9ff8-47c1-8244-742417704d49 admin admin] PATH_INFO: `/v3/projects` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:58.273413 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1212a90f-9ff8-47c1-8244-742417704d49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:58.275382 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1212a90f-9ff8-47c1-8244-742417704d49 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:58.396909 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1330/2669] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Oct 4 12:08:58 2022] POST /identity/v3/projects => generated 363 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:08:58.401760 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fa42d6-6bd6-483d-885c-471e2d6719da None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:58.413352 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fa42d6-6bd6-483d-885c-471e2d6719da None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:58.468773 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4acb8c-11f5-4840-a960-8a1b020ee0a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:58.469503 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4acb8c-11f5-4840-a960-8a1b020ee0a7 admin admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:58.469847 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4acb8c-11f5-4840-a960-8a1b020ee0a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:58.470128 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4acb8c-11f5-4840-a960-8a1b020ee0a7 admin admin] PATH_INFO: `/v3/users` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:58.470740 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4acb8c-11f5-4840-a960-8a1b020ee0a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:58.473364 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4acb8c-11f5-4840-a960-8a1b020ee0a7 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:58.569707 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1340/2670] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Oct 4 12:08:58 2022] POST /identity/v3/users => generated 288 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:08:58.573695 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1212a90f-9ff8-47c1-8244-742417704d49 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:58.584228 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1212a90f-9ff8-47c1-8244-742417704d49 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:58.588975 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebf1391-6f67-43d7-83fc-fb1adbcd37ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:58.589670 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebf1391-6f67-43d7-83fc-fb1adbcd37ba admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:58.589945 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebf1391-6f67-43d7-83fc-fb1adbcd37ba admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:58.590215 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebf1391-6f67-43d7-83fc-fb1adbcd37ba admin admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:58.590850 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebf1391-6f67-43d7-83fc-fb1adbcd37ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:58.592454 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebf1391-6f67-43d7-83fc-fb1adbcd37ba admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:58.602834 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1331/2671] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:08:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 12:08:58.607152 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4acb8c-11f5-4840-a960-8a1b020ee0a7 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:58.614394 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:08:58.618083 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4acb8c-11f5-4840-a960-8a1b020ee0a7 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:58.622622 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5603b000-0936-4c41-b2d9-943ab638467d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:58.623260 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5603b000-0936-4c41-b2d9-943ab638467d admin admin] REQUEST_METHOD: `PUT` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:58.623536 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5603b000-0936-4c41-b2d9-943ab638467d admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:58.623805 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5603b000-0936-4c41-b2d9-943ab638467d admin admin] PATH_INFO: `/v3/projects/31e72230ddee4ba396a4cf0dd775e621/users/7653a22a0fd54abfab8f6e2483c22acb/roles/d6e7421d1ff9451c808004b818354550` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:58.639766 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5603b000-0936-4c41-b2d9-943ab638467d admin admin] RBAC: Authorizing `identity:create_grant(project_id=31e72230ddee4ba396a4cf0dd775e621, user_id=7653a22a0fd54abfab8f6e2483c22acb, role_id=d6e7421d1ff9451c808004b818354550)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:58.642457 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5603b000-0936-4c41-b2d9-943ab638467d admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:58.748742 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1341/2672] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Oct 4 12:08:58 2022] PUT /identity/v3/projects/31e72230ddee4ba396a4cf0dd775e621/users/7653a22a0fd54abfab8f6e2483c22acb/roles/d6e7421d1ff9451c808004b818354550 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:08:58.752656 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebf1391-6f67-43d7-83fc-fb1adbcd37ba admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:58.762694 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebf1391-6f67-43d7-83fc-fb1adbcd37ba admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:58.818891 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf66b06-959d-4f6a-985b-25d9fb9bad1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:58.819547 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf66b06-959d-4f6a-985b-25d9fb9bad1e admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:58.819830 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf66b06-959d-4f6a-985b-25d9fb9bad1e admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:58.820103 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf66b06-959d-4f6a-985b-25d9fb9bad1e admin admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:58.820778 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf66b06-959d-4f6a-985b-25d9fb9bad1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:58.822426 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf66b06-959d-4f6a-985b-25d9fb9bad1e admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:58.832573 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1332/2673] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:08:58 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:08:58.836738 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5603b000-0936-4c41-b2d9-943ab638467d admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:58.847521 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5603b000-0936-4c41-b2d9-943ab638467d admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:58.852104 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b95f63-fc88-418a-8d7c-cd40e16ff5da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:58.852787 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b95f63-fc88-418a-8d7c-cd40e16ff5da admin admin] REQUEST_METHOD: `PUT` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:58.853068 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b95f63-fc88-418a-8d7c-cd40e16ff5da admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:58.853336 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b95f63-fc88-418a-8d7c-cd40e16ff5da admin admin] PATH_INFO: `/v3/projects/31e72230ddee4ba396a4cf0dd775e621/users/7653a22a0fd54abfab8f6e2483c22acb/roles/d6e7421d1ff9451c808004b818354550` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:58.855622 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b95f63-fc88-418a-8d7c-cd40e16ff5da admin admin] RBAC: Authorizing `identity:create_grant(project_id=31e72230ddee4ba396a4cf0dd775e621, user_id=7653a22a0fd54abfab8f6e2483c22acb, role_id=d6e7421d1ff9451c808004b818354550)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:58.858260 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b95f63-fc88-418a-8d7c-cd40e16ff5da admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:58.868650 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1342/2674] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Oct 4 12:08:58 2022] PUT /identity/v3/projects/31e72230ddee4ba396a4cf0dd775e621/users/7653a22a0fd54abfab8f6e2483c22acb/roles/d6e7421d1ff9451c808004b818354550 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:08:58.879021 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebef25b3-6c15-4333-a973-8caa2ddebce3 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:58.879317 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebef25b3-6c15-4333-a973-8caa2ddebce3 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:58.879604 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebef25b3-6c15-4333-a973-8caa2ddebce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:58.908159 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-ebef25b3-6c15-4333-a973-8caa2ddebce3 None None] MFA Rules not processed for user `7653a22a0fd54abfab8f6e2483c22acb`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:08:58.909943 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-ebef25b3-6c15-4333-a973-8caa2ddebce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:08:58.976258 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1333/2675] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:08:58 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:08:58.987783 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b95f63-fc88-418a-8d7c-cd40e16ff5da admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:58.989511 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-c0b95f63-fc88-418a-8d7c-cd40e16ff5da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:08:59.047310 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b95f63-fc88-418a-8d7c-cd40e16ff5da admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:59.051102 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93fee67-ac89-42a2-a4de-930215bf76bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e2a05b782424ab2928b5864f1bfd556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:59.051692 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93fee67-ac89-42a2-a4de-930215bf76bc service cinder] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:59.051972 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93fee67-ac89-42a2-a4de-930215bf76bc service cinder] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:59.052238 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93fee67-ac89-42a2-a4de-930215bf76bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:59.061083 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93fee67-ac89-42a2-a4de-930215bf76bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:59.062506 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93fee67-ac89-42a2-a4de-930215bf76bc service cinder] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:59.071875 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1343/2676] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:08:58 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:08:59.224206 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebef25b3-6c15-4333-a973-8caa2ddebce3 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:59.225650 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-ebef25b3-6c15-4333-a973-8caa2ddebce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:08:59.265911 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:08:59.290589 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebef25b3-6c15-4333-a973-8caa2ddebce3 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:59.295450 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d84772-ebd5-4e59-9563-06cadf777a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:59.296151 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d84772-ebd5-4e59-9563-06cadf777a0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:59.296439 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d84772-ebd5-4e59-9563-06cadf777a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:59.296755 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d84772-ebd5-4e59-9563-06cadf777a0a admin admin] PATH_INFO: `/v3/users/061fde88cb8a4784872438840236ace4` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:59.297891 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d84772-ebd5-4e59-9563-06cadf777a0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=061fde88cb8a4784872438840236ace4)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:59.299820 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d84772-ebd5-4e59-9563-06cadf777a0a admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:59.323932 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93fee67-ac89-42a2-a4de-930215bf76bc service cinder] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:59.333256 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93fee67-ac89-42a2-a4de-930215bf76bc service cinder] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:59.336914 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8805e4-e152-4e48-b3ca-b7974938a1e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e2a05b782424ab2928b5864f1bfd556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:59.337526 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8805e4-e152-4e48-b3ca-b7974938a1e2 service cinder] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:59.337802 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8805e4-e152-4e48-b3ca-b7974938a1e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:59.338069 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8805e4-e152-4e48-b3ca-b7974938a1e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:59.393225 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8805e4-e152-4e48-b3ca-b7974938a1e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:59.396030 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8805e4-e152-4e48-b3ca-b7974938a1e2 service cinder] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:59.406727 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1344/2677] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:08:59 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 12:08:59.497907 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-86d84772-ebd5-4e59-9563-06cadf777a0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '061fde88cb8a4784872438840236ace4'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:59.505731 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-86d84772-ebd5-4e59-9563-06cadf777a0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '061fde88cb8a4784872438840236ace4'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:59.506386 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-86d84772-ebd5-4e59-9563-06cadf777a0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '061fde88cb8a4784872438840236ace4'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:59.507010 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-86d84772-ebd5-4e59-9563-06cadf777a0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '061fde88cb8a4784872438840236ace4'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:59.600052 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-86d84772-ebd5-4e59-9563-06cadf777a0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '061fde88cb8a4784872438840236ace4'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:08:59.618734 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1334/2678] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Oct 4 12:08:59 2022] DELETE /identity/v3/users/061fde88cb8a4784872438840236ace4 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:08:59.623241 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa012d6-a741-4dee-a913-7f4db0c9d58e None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:59.623550 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa012d6-a741-4dee-a913-7f4db0c9d58e None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:59.623824 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa012d6-a741-4dee-a913-7f4db0c9d58e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:59.644231 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-7aa012d6-a741-4dee-a913-7f4db0c9d58e None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:08:59.645566 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-7aa012d6-a741-4dee-a913-7f4db0c9d58e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:08:59.706862 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1345/2679] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:08:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:08:59.716994 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d84772-ebd5-4e59-9563-06cadf777a0a admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:08:59.718486 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-86d84772-ebd5-4e59-9563-06cadf777a0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:08:59.775911 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d84772-ebd5-4e59-9563-06cadf777a0a admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:08:59.779602 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162ac7d8-de9a-429f-88f4-7b4eeb2b50d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7289515c5c44914a19daa439de98cb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:08:59.780141 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ac7d8-de9a-429f-88f4-7b4eeb2b50d1 service neutron] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:08:59.780418 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ac7d8-de9a-429f-88f4-7b4eeb2b50d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:08:59.780722 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ac7d8-de9a-429f-88f4-7b4eeb2b50d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:08:59.790080 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162ac7d8-de9a-429f-88f4-7b4eeb2b50d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:08:59.791494 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162ac7d8-de9a-429f-88f4-7b4eeb2b50d1 service neutron] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:08:59.800997 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1335/2680] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:08:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:09:00.340555 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa012d6-a741-4dee-a913-7f4db0c9d58e None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:09:00.342153 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-7aa012d6-a741-4dee-a913-7f4db0c9d58e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:09:00.355357 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa012d6-a741-4dee-a913-7f4db0c9d58e None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:09:00.360414 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb17e2eb-d1b1-4487-aaaf-253d2161205a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:09:00.361112 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb17e2eb-d1b1-4487-aaaf-253d2161205a admin admin] REQUEST_METHOD: `DELETE` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:09:00.361387 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb17e2eb-d1b1-4487-aaaf-253d2161205a admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:09:00.361654 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb17e2eb-d1b1-4487-aaaf-253d2161205a admin admin] PATH_INFO: `/v3/projects/9355f5b023644262b00f5791ea43fe87` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:09:00.364100 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb17e2eb-d1b1-4487-aaaf-253d2161205a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9355f5b023644262b00f5791ea43fe87)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:09:00.366322 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb17e2eb-d1b1-4487-aaaf-253d2161205a admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:09:00.369376 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:09:00.519397 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-fb17e2eb-d1b1-4487-aaaf-253d2161205a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9355f5b023644262b00f5791ea43fe87', 'request_id': 'req-fb17e2eb-d1b1-4487-aaaf-253d2161205a'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:09:00.646581 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-fb17e2eb-d1b1-4487-aaaf-253d2161205a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9355f5b023644262b00f5791ea43fe87', 'request_id': 'req-fb17e2eb-d1b1-4487-aaaf-253d2161205a'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:09:00.653808 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-fb17e2eb-d1b1-4487-aaaf-253d2161205a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9355f5b023644262b00f5791ea43fe87', 'request_id': 'req-fb17e2eb-d1b1-4487-aaaf-253d2161205a'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:09:00.664973 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-fb17e2eb-d1b1-4487-aaaf-253d2161205a admin admin] The token cache is being invalidate because project 9355f5b023644262b00f5791ea43fe87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:09:00.665287 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-fb17e2eb-d1b1-4487-aaaf-253d2161205a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:09:00.665925 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-fb17e2eb-d1b1-4487-aaaf-253d2161205a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:09:00.667405 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1346/2681] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Oct 4 12:09:00 2022] DELETE /identity/v3/projects/9355f5b023644262b00f5791ea43fe87 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:09:00.671489 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162ac7d8-de9a-429f-88f4-7b4eeb2b50d1 service neutron] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:09:00.681926 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162ac7d8-de9a-429f-88f4-7b4eeb2b50d1 service neutron] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:09:00.740405 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:09:00.746362 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102ee5a4-324c-4505-beac-2e230747546e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:09:00.746993 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102ee5a4-324c-4505-beac-2e230747546e admin admin] REQUEST_METHOD: `DELETE` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:09:00.747275 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102ee5a4-324c-4505-beac-2e230747546e admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:09:00.747550 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102ee5a4-324c-4505-beac-2e230747546e admin admin] PATH_INFO: `/v3/users/ad295c6d65a34a678d03bf7c3bc4ea39` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:09:00.748697 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102ee5a4-324c-4505-beac-2e230747546e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad295c6d65a34a678d03bf7c3bc4ea39)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:09:00.750684 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102ee5a4-324c-4505-beac-2e230747546e admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:09:00.993497 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-102ee5a4-324c-4505-beac-2e230747546e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad295c6d65a34a678d03bf7c3bc4ea39'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:09:01.001051 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-102ee5a4-324c-4505-beac-2e230747546e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad295c6d65a34a678d03bf7c3bc4ea39'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:09:01.001843 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-102ee5a4-324c-4505-beac-2e230747546e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad295c6d65a34a678d03bf7c3bc4ea39'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:09:01.007039 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-102ee5a4-324c-4505-beac-2e230747546e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad295c6d65a34a678d03bf7c3bc4ea39'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:09:01.166317 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-102ee5a4-324c-4505-beac-2e230747546e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad295c6d65a34a678d03bf7c3bc4ea39'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:09:01.185113 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1336/2682] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Oct 4 12:09:00 2022] DELETE /identity/v3/users/ad295c6d65a34a678d03bf7c3bc4ea39 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:09:01.728977 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb17e2eb-d1b1-4487-aaaf-253d2161205a admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:09:01.736349 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-fb17e2eb-d1b1-4487-aaaf-253d2161205a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:09:01.744179 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb17e2eb-d1b1-4487-aaaf-253d2161205a admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:09:01.804952 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7932408f-46c2-4c70-bc4f-d8fc57ba4696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:09:01.805530 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7932408f-46c2-4c70-bc4f-d8fc57ba4696 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:09:01.805806 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7932408f-46c2-4c70-bc4f-d8fc57ba4696 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:09:01.806075 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7932408f-46c2-4c70-bc4f-d8fc57ba4696 admin admin] PATH_INFO: `/v3/projects/1dc1327e2b15477393d93baa37533142` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:09:01.807207 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7932408f-46c2-4c70-bc4f-d8fc57ba4696 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1dc1327e2b15477393d93baa37533142)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:09:01.809163 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7932408f-46c2-4c70-bc4f-d8fc57ba4696 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:09:02.005454 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-7932408f-46c2-4c70-bc4f-d8fc57ba4696 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1dc1327e2b15477393d93baa37533142', 'request_id': 'req-7932408f-46c2-4c70-bc4f-d8fc57ba4696'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:09:02.103529 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-7932408f-46c2-4c70-bc4f-d8fc57ba4696 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1dc1327e2b15477393d93baa37533142', 'request_id': 'req-7932408f-46c2-4c70-bc4f-d8fc57ba4696'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:09:02.110841 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-7932408f-46c2-4c70-bc4f-d8fc57ba4696 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1dc1327e2b15477393d93baa37533142', 'request_id': 'req-7932408f-46c2-4c70-bc4f-d8fc57ba4696'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:09:02.123310 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-7932408f-46c2-4c70-bc4f-d8fc57ba4696 admin admin] The token cache is being invalidate because project 1dc1327e2b15477393d93baa37533142 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:09:02.123611 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-7932408f-46c2-4c70-bc4f-d8fc57ba4696 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:09:02.124317 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-7932408f-46c2-4c70-bc4f-d8fc57ba4696 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:09:02.129758 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1347/2683] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Oct 4 12:09:01 2022] DELETE /identity/v3/projects/1dc1327e2b15477393d93baa37533142 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:09:02.130578 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102ee5a4-324c-4505-beac-2e230747546e admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:09:02.132306 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-102ee5a4-324c-4505-beac-2e230747546e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:09:02.146091 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102ee5a4-324c-4505-beac-2e230747546e admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:09:02.207315 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc4cc22-5876-410f-a8ea-8c5fb4291878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:09:02.207951 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc4cc22-5876-410f-a8ea-8c5fb4291878 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:09:02.208229 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc4cc22-5876-410f-a8ea-8c5fb4291878 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:09:02.208506 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc4cc22-5876-410f-a8ea-8c5fb4291878 admin admin] PATH_INFO: `/v3/users/10cd1ad1a8944da7a45cc9e71365586a` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:09:02.209702 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc4cc22-5876-410f-a8ea-8c5fb4291878 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10cd1ad1a8944da7a45cc9e71365586a)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:09:02.211798 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc4cc22-5876-410f-a8ea-8c5fb4291878 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:09:02.543016 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-3dc4cc22-5876-410f-a8ea-8c5fb4291878 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10cd1ad1a8944da7a45cc9e71365586a'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:09:02.550795 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-3dc4cc22-5876-410f-a8ea-8c5fb4291878 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10cd1ad1a8944da7a45cc9e71365586a'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:09:02.551569 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-3dc4cc22-5876-410f-a8ea-8c5fb4291878 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10cd1ad1a8944da7a45cc9e71365586a'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:09:02.552160 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-3dc4cc22-5876-410f-a8ea-8c5fb4291878 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10cd1ad1a8944da7a45cc9e71365586a'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:09:02.691949 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-3dc4cc22-5876-410f-a8ea-8c5fb4291878 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10cd1ad1a8944da7a45cc9e71365586a'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:09:02.703654 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:09:02.711005 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1337/2684] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Oct 4 12:09:02 2022] DELETE /identity/v3/users/10cd1ad1a8944da7a45cc9e71365586a => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:09:03.277117 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7932408f-46c2-4c70-bc4f-d8fc57ba4696 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:09:03.278694 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-7932408f-46c2-4c70-bc4f-d8fc57ba4696 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:09:03.291836 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7932408f-46c2-4c70-bc4f-d8fc57ba4696 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:09:03.312909 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:09:03.350181 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6127a29-fb2e-4520-bc16-76b51273369b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:09:03.350813 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6127a29-fb2e-4520-bc16-76b51273369b admin admin] REQUEST_METHOD: `DELETE` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:09:03.351093 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6127a29-fb2e-4520-bc16-76b51273369b admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:09:03.351370 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6127a29-fb2e-4520-bc16-76b51273369b admin admin] PATH_INFO: `/v3/projects/a21f97c1230f4b90975d8d1b92c9c484` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:09:03.352480 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6127a29-fb2e-4520-bc16-76b51273369b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a21f97c1230f4b90975d8d1b92c9c484)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:09:03.354421 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6127a29-fb2e-4520-bc16-76b51273369b admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:09:03.491142 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-b6127a29-fb2e-4520-bc16-76b51273369b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a21f97c1230f4b90975d8d1b92c9c484', 'request_id': 'req-b6127a29-fb2e-4520-bc16-76b51273369b'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:09:03.614691 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-b6127a29-fb2e-4520-bc16-76b51273369b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a21f97c1230f4b90975d8d1b92c9c484', 'request_id': 'req-b6127a29-fb2e-4520-bc16-76b51273369b'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:09:03.621846 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-b6127a29-fb2e-4520-bc16-76b51273369b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a21f97c1230f4b90975d8d1b92c9c484', 'request_id': 'req-b6127a29-fb2e-4520-bc16-76b51273369b'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:09:03.635197 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-b6127a29-fb2e-4520-bc16-76b51273369b admin admin] The token cache is being invalidate because project a21f97c1230f4b90975d8d1b92c9c484 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:09:03.635471 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-b6127a29-fb2e-4520-bc16-76b51273369b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:09:03.636301 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-b6127a29-fb2e-4520-bc16-76b51273369b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:09:03.637996 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1348/2685] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Oct 4 12:09:03 2022] DELETE /identity/v3/projects/a21f97c1230f4b90975d8d1b92c9c484 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:09:03.643497 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d96aaa7-c1f4-4ea5-8bd0-7cdb66ff826d None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:09:03.644405 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d96aaa7-c1f4-4ea5-8bd0-7cdb66ff826d None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:09:03.644708 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d96aaa7-c1f4-4ea5-8bd0-7cdb66ff826d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:09:03.665569 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-7d96aaa7-c1f4-4ea5-8bd0-7cdb66ff826d None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:09:03.666759 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-7d96aaa7-c1f4-4ea5-8bd0-7cdb66ff826d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:09:03.727838 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1338/2686] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:09:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 12:09:03.735710 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896e116c-642d-4fbb-b003-18cbf4bffb3c None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:09:03.736000 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896e116c-642d-4fbb-b003-18cbf4bffb3c None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:09:03.736275 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896e116c-642d-4fbb-b003-18cbf4bffb3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:09:03.761611 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-896e116c-642d-4fbb-b003-18cbf4bffb3c None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:09:03.764146 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-896e116c-642d-4fbb-b003-18cbf4bffb3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:09:03.772304 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1349/2687] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:09:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:09:03.776446 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d96aaa7-c1f4-4ea5-8bd0-7cdb66ff826d None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:09:03.787173 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d96aaa7-c1f4-4ea5-8bd0-7cdb66ff826d None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:09:03.793066 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325e8b77-eec1-4530-a3d7-df1118edcd52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:09:03.793677 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325e8b77-eec1-4530-a3d7-df1118edcd52 admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:09:03.794231 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325e8b77-eec1-4530-a3d7-df1118edcd52 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:09:03.794345 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325e8b77-eec1-4530-a3d7-df1118edcd52 admin admin] PATH_INFO: `/v3/domains` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:09:03.794992 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325e8b77-eec1-4530-a3d7-df1118edcd52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:09:03.795298 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325e8b77-eec1-4530-a3d7-df1118edcd52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:09:03.796932 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325e8b77-eec1-4530-a3d7-df1118edcd52 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:09:03.808948 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1339/2688] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Oct 4 12:09:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:09:03.813366 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896e116c-642d-4fbb-b003-18cbf4bffb3c None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:09:03.822980 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896e116c-642d-4fbb-b003-18cbf4bffb3c None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:09:03.827619 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f402fd6-130f-4f30-b167-a3733ce045fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:09:03.828206 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f402fd6-130f-4f30-b167-a3733ce045fa admin admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:09:03.828477 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f402fd6-130f-4f30-b167-a3733ce045fa admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:09:03.828784 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f402fd6-130f-4f30-b167-a3733ce045fa admin admin] PATH_INFO: `/v3/projects` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:09:03.829409 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f402fd6-130f-4f30-b167-a3733ce045fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:09:03.831919 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f402fd6-130f-4f30-b167-a3733ce045fa admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:09:03.976122 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1350/2689] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Oct 4 12:09:03 2022] POST /identity/v3/projects => generated 385 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 12:09:03.980320 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325e8b77-eec1-4530-a3d7-df1118edcd52 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:09:03.991280 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325e8b77-eec1-4530-a3d7-df1118edcd52 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:09:04.048581 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a845689-e1b5-4e41-ac27-9eaa9a939967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:09:04.049190 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a845689-e1b5-4e41-ac27-9eaa9a939967 admin admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:09:04.049469 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a845689-e1b5-4e41-ac27-9eaa9a939967 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:09:04.050407 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a845689-e1b5-4e41-ac27-9eaa9a939967 admin admin] PATH_INFO: `/v3/users` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:09:04.051064 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a845689-e1b5-4e41-ac27-9eaa9a939967 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:09:04.052997 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a845689-e1b5-4e41-ac27-9eaa9a939967 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:09:04.175337 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1340/2690] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Oct 4 12:09:03 2022] POST /identity/v3/users => generated 293 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:09:04.179579 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f402fd6-130f-4f30-b167-a3733ce045fa admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:09:04.189726 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f402fd6-130f-4f30-b167-a3733ce045fa admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:09:04.194811 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25c4fa0-a25f-45c2-8f7c-e24d53fbb0bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:09:04.195397 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25c4fa0-a25f-45c2-8f7c-e24d53fbb0bd admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:09:04.195674 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25c4fa0-a25f-45c2-8f7c-e24d53fbb0bd admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:09:04.195943 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25c4fa0-a25f-45c2-8f7c-e24d53fbb0bd admin admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:09:04.196708 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25c4fa0-a25f-45c2-8f7c-e24d53fbb0bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:09:04.198268 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25c4fa0-a25f-45c2-8f7c-e24d53fbb0bd admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:09:04.208658 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1351/2691] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:09:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:09:04.212929 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a845689-e1b5-4e41-ac27-9eaa9a939967 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:09:04.224279 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a845689-e1b5-4e41-ac27-9eaa9a939967 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:09:04.230498 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3807444d-4bb6-4811-b800-0edaa2a5095b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:09:04.239654 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3807444d-4bb6-4811-b800-0edaa2a5095b admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:09:04.239947 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3807444d-4bb6-4811-b800-0edaa2a5095b admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:09:04.240231 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3807444d-4bb6-4811-b800-0edaa2a5095b admin admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:09:04.240924 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3807444d-4bb6-4811-b800-0edaa2a5095b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:09:04.242533 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3807444d-4bb6-4811-b800-0edaa2a5095b admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:09:04.254198 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1341/2692] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:09:04 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:09:04.258568 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25c4fa0-a25f-45c2-8f7c-e24d53fbb0bd admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:09:04.269397 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25c4fa0-a25f-45c2-8f7c-e24d53fbb0bd admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:09:04.274084 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02ccd62-a24f-47f7-a293-4ef818d8a0d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:09:04.274719 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02ccd62-a24f-47f7-a293-4ef818d8a0d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:09:04.275005 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02ccd62-a24f-47f7-a293-4ef818d8a0d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:09:04.275271 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02ccd62-a24f-47f7-a293-4ef818d8a0d8 admin admin] PATH_INFO: `/v3/projects/15960e3ae99040e69b306b44729fe236/users/cea72e36518a417a9879ab4a01ca6e85/roles/ab4307f3b7994c1c80036fa7db93b6b9` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:09:04.289658 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02ccd62-a24f-47f7-a293-4ef818d8a0d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15960e3ae99040e69b306b44729fe236, user_id=cea72e36518a417a9879ab4a01ca6e85, role_id=ab4307f3b7994c1c80036fa7db93b6b9)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:09:04.292287 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02ccd62-a24f-47f7-a293-4ef818d8a0d8 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:09:04.435571 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1352/2693] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Oct 4 12:09:04 2022] PUT /identity/v3/projects/15960e3ae99040e69b306b44729fe236/users/cea72e36518a417a9879ab4a01ca6e85/roles/ab4307f3b7994c1c80036fa7db93b6b9 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:09:04.446313 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcceefed-496b-4b55-bf5b-34beb4539e88 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:09:04.446601 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcceefed-496b-4b55-bf5b-34beb4539e88 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:09:04.446874 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcceefed-496b-4b55-bf5b-34beb4539e88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:09:04.476573 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-bcceefed-496b-4b55-bf5b-34beb4539e88 None None] MFA Rules not processed for user `cea72e36518a417a9879ab4a01ca6e85`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:09:04.477813 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-bcceefed-496b-4b55-bf5b-34beb4539e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:09:04.538133 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:09:04.559305 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1342/2694] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:09:04 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:09:04.570678 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02ccd62-a24f-47f7-a293-4ef818d8a0d8 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:09:04.572367 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-c02ccd62-a24f-47f7-a293-4ef818d8a0d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:09:04.627299 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:09:04.630930 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02ccd62-a24f-47f7-a293-4ef818d8a0d8 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:09:04.634659 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e130ea4-0446-42be-8ec0-37cc16afaf17 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e2a05b782424ab2928b5864f1bfd556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:09:04.635259 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e130ea4-0446-42be-8ec0-37cc16afaf17 service cinder] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:09:04.635535 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e130ea4-0446-42be-8ec0-37cc16afaf17 service cinder] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:09:04.635805 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e130ea4-0446-42be-8ec0-37cc16afaf17 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:09:04.644547 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e130ea4-0446-42be-8ec0-37cc16afaf17 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:09:04.645992 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e130ea4-0446-42be-8ec0-37cc16afaf17 service cinder] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:09:04.654595 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1353/2695] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:09:04 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:09:07.989539 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcceefed-496b-4b55-bf5b-34beb4539e88 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:09:08.052918 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcceefed-496b-4b55-bf5b-34beb4539e88 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:09:08.061428 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308b3d64-bc09-4556-bbde-9aa8db6bd5b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:09:08.062060 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308b3d64-bc09-4556-bbde-9aa8db6bd5b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:09:08.062338 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308b3d64-bc09-4556-bbde-9aa8db6bd5b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:09:08.062610 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308b3d64-bc09-4556-bbde-9aa8db6bd5b9 admin admin] PATH_INFO: `/v3/users/cea72e36518a417a9879ab4a01ca6e85` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:09:08.063720 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308b3d64-bc09-4556-bbde-9aa8db6bd5b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cea72e36518a417a9879ab4a01ca6e85)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:09:08.065674 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308b3d64-bc09-4556-bbde-9aa8db6bd5b9 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:09:08.285704 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-308b3d64-bc09-4556-bbde-9aa8db6bd5b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cea72e36518a417a9879ab4a01ca6e85'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:09:08.292897 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-308b3d64-bc09-4556-bbde-9aa8db6bd5b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cea72e36518a417a9879ab4a01ca6e85'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:09:08.293594 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-308b3d64-bc09-4556-bbde-9aa8db6bd5b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cea72e36518a417a9879ab4a01ca6e85'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:09:08.294234 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-308b3d64-bc09-4556-bbde-9aa8db6bd5b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cea72e36518a417a9879ab4a01ca6e85'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:09:08.391314 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-308b3d64-bc09-4556-bbde-9aa8db6bd5b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cea72e36518a417a9879ab4a01ca6e85'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:09:08.412569 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1343/2696] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Oct 4 12:09:07 2022] DELETE /identity/v3/users/cea72e36518a417a9879ab4a01ca6e85 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:09:08.417103 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714b73d4-f4de-4ebd-bdd8-94d96e9a597a None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:09:08.417586 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714b73d4-f4de-4ebd-bdd8-94d96e9a597a None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:09:08.417686 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714b73d4-f4de-4ebd-bdd8-94d96e9a597a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:09:08.437868 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-714b73d4-f4de-4ebd-bdd8-94d96e9a597a None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:09:08.439975 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-714b73d4-f4de-4ebd-bdd8-94d96e9a597a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:09:08.503046 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1354/2697] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:09:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:09:08.513022 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308b3d64-bc09-4556-bbde-9aa8db6bd5b9 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:09:08.514480 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-308b3d64-bc09-4556-bbde-9aa8db6bd5b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:09:08.574582 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308b3d64-bc09-4556-bbde-9aa8db6bd5b9 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:09:08.578293 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91924307-1688-449e-bb1f-b6feb4ab31ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7289515c5c44914a19daa439de98cb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:09:08.578927 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91924307-1688-449e-bb1f-b6feb4ab31ba service neutron] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:09:08.579205 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91924307-1688-449e-bb1f-b6feb4ab31ba service neutron] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:09:08.579469 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91924307-1688-449e-bb1f-b6feb4ab31ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:09:08.588457 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91924307-1688-449e-bb1f-b6feb4ab31ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:09:08.590098 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91924307-1688-449e-bb1f-b6feb4ab31ba service neutron] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:09:08.599428 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1344/2698] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:09:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:09:09.044814 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714b73d4-f4de-4ebd-bdd8-94d96e9a597a None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:09:09.046297 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-714b73d4-f4de-4ebd-bdd8-94d96e9a597a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:09:09.058329 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714b73d4-f4de-4ebd-bdd8-94d96e9a597a None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:09:09.062910 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef47b8c3-c599-4003-9285-0f3fe8326c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:09:09.063498 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef47b8c3-c599-4003-9285-0f3fe8326c0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:09:09.063775 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef47b8c3-c599-4003-9285-0f3fe8326c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:09:09.064044 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef47b8c3-c599-4003-9285-0f3fe8326c0f admin admin] PATH_INFO: `/v3/users/0211720df394480ba23d9c33762cc7cb` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:09:09.065715 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef47b8c3-c599-4003-9285-0f3fe8326c0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0211720df394480ba23d9c33762cc7cb)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:09:09.067615 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef47b8c3-c599-4003-9285-0f3fe8326c0f admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:09:09.148071 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91924307-1688-449e-bb1f-b6feb4ab31ba service neutron] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:09:09.149635 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-91924307-1688-449e-bb1f-b6feb4ab31ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:09:09.162772 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91924307-1688-449e-bb1f-b6feb4ab31ba service neutron] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:09:09.167508 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf331bc-bae3-4a1d-a2cf-747c7b306306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:09:09.168228 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf331bc-bae3-4a1d-a2cf-747c7b306306 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:09:09.168483 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf331bc-bae3-4a1d-a2cf-747c7b306306 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:09:09.168705 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf331bc-bae3-4a1d-a2cf-747c7b306306 admin admin] PATH_INFO: `/v3/projects/15960e3ae99040e69b306b44729fe236` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:09:09.169821 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf331bc-bae3-4a1d-a2cf-747c7b306306 admin admin] RBAC: Authorizing `identity:delete_project(project_id=15960e3ae99040e69b306b44729fe236)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:09:09.171735 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf331bc-bae3-4a1d-a2cf-747c7b306306 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:09:09.181326 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:09:09.281408 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-ef47b8c3-c599-4003-9285-0f3fe8326c0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0211720df394480ba23d9c33762cc7cb'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:09:09.284016 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-8cf331bc-bae3-4a1d-a2cf-747c7b306306 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15960e3ae99040e69b306b44729fe236', 'request_id': 'req-8cf331bc-bae3-4a1d-a2cf-747c7b306306'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:09:09.288677 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-ef47b8c3-c599-4003-9285-0f3fe8326c0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0211720df394480ba23d9c33762cc7cb'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:09:09.289359 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-ef47b8c3-c599-4003-9285-0f3fe8326c0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0211720df394480ba23d9c33762cc7cb'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:09:09.289972 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-ef47b8c3-c599-4003-9285-0f3fe8326c0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0211720df394480ba23d9c33762cc7cb'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:09:09.290517 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-8cf331bc-bae3-4a1d-a2cf-747c7b306306 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15960e3ae99040e69b306b44729fe236', 'request_id': 'req-8cf331bc-bae3-4a1d-a2cf-747c7b306306'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:09:09.379919 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-ef47b8c3-c599-4003-9285-0f3fe8326c0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0211720df394480ba23d9c33762cc7cb'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:09:09.398018 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1355/2699] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Oct 4 12:09:09 2022] DELETE /identity/v3/users/0211720df394480ba23d9c33762cc7cb => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:09:09.402243 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba9609f-d4d3-428b-9cb1-76c5984f44e9 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:09:09.402533 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba9609f-d4d3-428b-9cb1-76c5984f44e9 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:09:09.402827 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba9609f-d4d3-428b-9cb1-76c5984f44e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:09:09.421841 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-fba9609f-d4d3-428b-9cb1-76c5984f44e9 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:09:09.423034 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-fba9609f-d4d3-428b-9cb1-76c5984f44e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:09:09.482333 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1356/2700] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:09:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 12:09:09.482554 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-8cf331bc-bae3-4a1d-a2cf-747c7b306306 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15960e3ae99040e69b306b44729fe236', 'request_id': 'req-8cf331bc-bae3-4a1d-a2cf-747c7b306306'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:09:09.493108 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba9609f-d4d3-428b-9cb1-76c5984f44e9 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:09:09.494661 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-8cf331bc-bae3-4a1d-a2cf-747c7b306306 admin admin] The token cache is being invalidate because project 15960e3ae99040e69b306b44729fe236 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:09:09.494822 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-fba9609f-d4d3-428b-9cb1-76c5984f44e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:09:09.494978 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-8cf331bc-bae3-4a1d-a2cf-747c7b306306 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:09:09.495600 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-8cf331bc-bae3-4a1d-a2cf-747c7b306306 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:09:09.497106 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1345/2701] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Oct 4 12:09:09 2022] DELETE /identity/v3/projects/15960e3ae99040e69b306b44729fe236 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:09:09.501773 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ade19d0-fe56-49dc-b03e-d8ec34d01459 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:09:09.502074 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ade19d0-fe56-49dc-b03e-d8ec34d01459 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:09:09.502404 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ade19d0-fe56-49dc-b03e-d8ec34d01459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:09:09.505260 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:09:09.525024 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-5ade19d0-fe56-49dc-b03e-d8ec34d01459 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:09:09.526339 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-5ade19d0-fe56-49dc-b03e-d8ec34d01459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:09:09.534462 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1346/2702] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:09:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 12:09:09.543124 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0466f0c7-99af-4ec6-a5d9-fff3acebd8c3 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:09:09.548389 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0466f0c7-99af-4ec6-a5d9-fff3acebd8c3 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:09:09.548389 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0466f0c7-99af-4ec6-a5d9-fff3acebd8c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:09:09.558484 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba9609f-d4d3-428b-9cb1-76c5984f44e9 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:09:09.562148 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f587f18a-27aa-48a5-8dae-2efc0de2b990 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7289515c5c44914a19daa439de98cb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:09:09.562776 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f587f18a-27aa-48a5-8dae-2efc0de2b990 service neutron] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:09:09.563181 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f587f18a-27aa-48a5-8dae-2efc0de2b990 service neutron] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:09:09.563458 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f587f18a-27aa-48a5-8dae-2efc0de2b990 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:09:09.564011 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-0466f0c7-99af-4ec6-a5d9-fff3acebd8c3 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:09:09.565933 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-0466f0c7-99af-4ec6-a5d9-fff3acebd8c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:09:09.566399 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-f587f18a-27aa-48a5-8dae-2efc0de2b990 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:09:09.573875 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1347/2703] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:09:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 12:09:09.577887 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f587f18a-27aa-48a5-8dae-2efc0de2b990 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:09:09.578051 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0466f0c7-99af-4ec6-a5d9-fff3acebd8c3 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:09:09.579316 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f587f18a-27aa-48a5-8dae-2efc0de2b990 service neutron] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:09:09.587153 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0466f0c7-99af-4ec6-a5d9-fff3acebd8c3 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:09:09.589112 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1357/2704] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:09:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 12:09:09.591910 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c8d2d9-1336-4345-aba1-76b6c9765145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:09:09.592496 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c8d2d9-1336-4345-aba1-76b6c9765145 admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:09:09.592805 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c8d2d9-1336-4345-aba1-76b6c9765145 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:09:09.593072 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c8d2d9-1336-4345-aba1-76b6c9765145 admin admin] PATH_INFO: `/v3/domains` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:09:09.593699 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c8d2d9-1336-4345-aba1-76b6c9765145 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:09:09.593994 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c8d2d9-1336-4345-aba1-76b6c9765145 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:09:09.595593 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c8d2d9-1336-4345-aba1-76b6c9765145 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:09:09.608154 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1348/2705] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Oct 4 12:09:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 12:09:09.612589 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f587f18a-27aa-48a5-8dae-2efc0de2b990 service neutron] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:09:09.622086 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f587f18a-27aa-48a5-8dae-2efc0de2b990 service neutron] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:09:09.627404 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c03f2f-b1f0-414b-96fc-789a360b0a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:09:09.628627 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c03f2f-b1f0-414b-96fc-789a360b0a8b admin admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:09:09.629228 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c03f2f-b1f0-414b-96fc-789a360b0a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:09:09.629228 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c03f2f-b1f0-414b-96fc-789a360b0a8b admin admin] PATH_INFO: `/v3/projects` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:09:09.629787 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c03f2f-b1f0-414b-96fc-789a360b0a8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:09:09.631673 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c03f2f-b1f0-414b-96fc-789a360b0a8b admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:09:09.796248 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1358/2706] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Oct 4 12:09:09 2022] POST /identity/v3/projects => generated 373 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:09:09.811071 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c8d2d9-1336-4345-aba1-76b6c9765145 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:09:09.811502 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c8d2d9-1336-4345-aba1-76b6c9765145 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:09:09.872694 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7a937b-89df-485c-baf3-a3930208875a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:09:09.874038 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7a937b-89df-485c-baf3-a3930208875a admin admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:09:09.874038 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7a937b-89df-485c-baf3-a3930208875a admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:09:09.874038 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7a937b-89df-485c-baf3-a3930208875a admin admin] PATH_INFO: `/v3/users` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:09:09.874658 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7a937b-89df-485c-baf3-a3930208875a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:09:09.876650 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7a937b-89df-485c-baf3-a3930208875a admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:09:10.053509 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1349/2707] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Oct 4 12:09:09 2022] POST /identity/v3/users => generated 287 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 12:09:10.054377 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c03f2f-b1f0-414b-96fc-789a360b0a8b admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:09:10.055997 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-86c03f2f-b1f0-414b-96fc-789a360b0a8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:09:10.057466 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7a937b-89df-485c-baf3-a3930208875a admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:09:10.067866 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7a937b-89df-485c-baf3-a3930208875a admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:09:10.070048 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c03f2f-b1f0-414b-96fc-789a360b0a8b admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:09:10.072687 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1874f4-7607-4d5a-bb80-86eab0e979bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:09:10.073302 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1874f4-7607-4d5a-bb80-86eab0e979bb admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:09:10.073581 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1874f4-7607-4d5a-bb80-86eab0e979bb admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:09:10.073854 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1874f4-7607-4d5a-bb80-86eab0e979bb admin admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:09:10.074495 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1874f4-7607-4d5a-bb80-86eab0e979bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:09:10.076144 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1874f4-7607-4d5a-bb80-86eab0e979bb admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:09:10.081266 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1744bc1-2bbe-46b9-965e-f3f9c15cb8b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:09:10.081911 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1744bc1-2bbe-46b9-965e-f3f9c15cb8b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:09:10.082676 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1744bc1-2bbe-46b9-965e-f3f9c15cb8b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:09:10.083016 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1744bc1-2bbe-46b9-965e-f3f9c15cb8b4 admin admin] PATH_INFO: `/v3/projects/98c714a02f914659800ee2acf245ecf2` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:09:10.084342 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1744bc1-2bbe-46b9-965e-f3f9c15cb8b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98c714a02f914659800ee2acf245ecf2)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:09:10.086458 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1744bc1-2bbe-46b9-965e-f3f9c15cb8b4 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:09:10.088323 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1350/2708] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:09:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 12:09:10.097199 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1874f4-7607-4d5a-bb80-86eab0e979bb admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:09:10.102719 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1874f4-7607-4d5a-bb80-86eab0e979bb admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:09:10.107830 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22eedac-13a1-4ad7-a436-967882f43a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:09:10.108419 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22eedac-13a1-4ad7-a436-967882f43a6a admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:09:10.108727 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22eedac-13a1-4ad7-a436-967882f43a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:09:10.109017 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22eedac-13a1-4ad7-a436-967882f43a6a admin admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:09:10.109656 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22eedac-13a1-4ad7-a436-967882f43a6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:09:10.111230 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22eedac-13a1-4ad7-a436-967882f43a6a admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:09:10.122056 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1351/2709] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:09:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 12:09:10.126244 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22eedac-13a1-4ad7-a436-967882f43a6a admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:09:10.135652 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22eedac-13a1-4ad7-a436-967882f43a6a admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:09:10.140194 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ffb4eb-0b8e-4b50-85a4-2a67f18ac04a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:09:10.140842 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ffb4eb-0b8e-4b50-85a4-2a67f18ac04a admin admin] REQUEST_METHOD: `PUT` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:09:10.141117 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ffb4eb-0b8e-4b50-85a4-2a67f18ac04a admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:09:10.141408 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ffb4eb-0b8e-4b50-85a4-2a67f18ac04a admin admin] PATH_INFO: `/v3/projects/50f802fa17304a1abee47f21fd1e19d5/users/144325fbfe2945a6acb711efe7625c70/roles/ab4307f3b7994c1c80036fa7db93b6b9` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:09:10.156304 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ffb4eb-0b8e-4b50-85a4-2a67f18ac04a admin admin] RBAC: Authorizing `identity:create_grant(project_id=50f802fa17304a1abee47f21fd1e19d5, user_id=144325fbfe2945a6acb711efe7625c70, role_id=ab4307f3b7994c1c80036fa7db93b6b9)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:09:10.159530 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ffb4eb-0b8e-4b50-85a4-2a67f18ac04a admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:09:10.276319 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1352/2710] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Oct 4 12:09:10 2022] PUT /identity/v3/projects/50f802fa17304a1abee47f21fd1e19d5/users/144325fbfe2945a6acb711efe7625c70/roles/ab4307f3b7994c1c80036fa7db93b6b9 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:09:10.288433 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b34f5d-0b38-4861-bfe2-9ccc209b005e None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:09:10.288751 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b34f5d-0b38-4861-bfe2-9ccc209b005e None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:09:10.289028 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b34f5d-0b38-4861-bfe2-9ccc209b005e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:09:10.290036 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-b1744bc1-2bbe-46b9-965e-f3f9c15cb8b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98c714a02f914659800ee2acf245ecf2', 'request_id': 'req-b1744bc1-2bbe-46b9-965e-f3f9c15cb8b4'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:09:10.314700 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:09:10.318153 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-85b34f5d-0b38-4861-bfe2-9ccc209b005e None None] MFA Rules not processed for user `144325fbfe2945a6acb711efe7625c70`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:09:10.319410 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-85b34f5d-0b38-4861-bfe2-9ccc209b005e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:09:10.380254 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-b1744bc1-2bbe-46b9-965e-f3f9c15cb8b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98c714a02f914659800ee2acf245ecf2', 'request_id': 'req-b1744bc1-2bbe-46b9-965e-f3f9c15cb8b4'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:09:10.386780 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1353/2711] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:09:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:09:10.394300 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-b1744bc1-2bbe-46b9-965e-f3f9c15cb8b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98c714a02f914659800ee2acf245ecf2', 'request_id': 'req-b1744bc1-2bbe-46b9-965e-f3f9c15cb8b4'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:09:10.399213 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b34f5d-0b38-4861-bfe2-9ccc209b005e None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:09:10.401282 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-85b34f5d-0b38-4861-bfe2-9ccc209b005e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:09:10.404543 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-b1744bc1-2bbe-46b9-965e-f3f9c15cb8b4 admin admin] The token cache is being invalidate because project 98c714a02f914659800ee2acf245ecf2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:09:10.404858 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-b1744bc1-2bbe-46b9-965e-f3f9c15cb8b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:09:10.405506 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-b1744bc1-2bbe-46b9-965e-f3f9c15cb8b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:09:10.407053 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1359/2712] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Oct 4 12:09:10 2022] DELETE /identity/v3/projects/98c714a02f914659800ee2acf245ecf2 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:09:10.412041 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1744bc1-2bbe-46b9-965e-f3f9c15cb8b4 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:09:10.413519 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-b1744bc1-2bbe-46b9-965e-f3f9c15cb8b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:09:10.465168 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b34f5d-0b38-4861-bfe2-9ccc209b005e None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:09:10.469149 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc077fa-b5b9-4be0-b930-2f2217e368ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e2a05b782424ab2928b5864f1bfd556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:09:10.469757 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc077fa-b5b9-4be0-b930-2f2217e368ae service cinder] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:09:10.470037 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc077fa-b5b9-4be0-b930-2f2217e368ae service cinder] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:09:10.470306 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc077fa-b5b9-4be0-b930-2f2217e368ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:09:10.472150 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-5cc077fa-b5b9-4be0-b930-2f2217e368ae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:09:10.483591 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc077fa-b5b9-4be0-b930-2f2217e368ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:09:10.484344 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1744bc1-2bbe-46b9-965e-f3f9c15cb8b4 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:09:10.485155 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc077fa-b5b9-4be0-b930-2f2217e368ae service cinder] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:09:10.489438 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b03ad4f-9694-4b00-a4de-c3f19ea72a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:09:10.496782 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b03ad4f-9694-4b00-a4de-c3f19ea72a6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:09:10.496782 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b03ad4f-9694-4b00-a4de-c3f19ea72a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:09:10.496782 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b03ad4f-9694-4b00-a4de-c3f19ea72a6b admin admin] PATH_INFO: `/v3/users/7653a22a0fd54abfab8f6e2483c22acb` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:09:10.496782 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b03ad4f-9694-4b00-a4de-c3f19ea72a6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7653a22a0fd54abfab8f6e2483c22acb)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:09:10.496782 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b03ad4f-9694-4b00-a4de-c3f19ea72a6b admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:09:10.497259 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1354/2713] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:09:10 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 12:09:10.506279 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:09:10.725494 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-8b03ad4f-9694-4b00-a4de-c3f19ea72a6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7653a22a0fd54abfab8f6e2483c22acb'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:09:10.732370 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-8b03ad4f-9694-4b00-a4de-c3f19ea72a6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7653a22a0fd54abfab8f6e2483c22acb'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:09:10.733064 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-8b03ad4f-9694-4b00-a4de-c3f19ea72a6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7653a22a0fd54abfab8f6e2483c22acb'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:09:10.733663 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-8b03ad4f-9694-4b00-a4de-c3f19ea72a6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7653a22a0fd54abfab8f6e2483c22acb'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:09:10.808912 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-8b03ad4f-9694-4b00-a4de-c3f19ea72a6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7653a22a0fd54abfab8f6e2483c22acb'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:09:10.827556 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1360/2714] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Oct 4 12:09:10 2022] DELETE /identity/v3/users/7653a22a0fd54abfab8f6e2483c22acb => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:09:11.320810 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc077fa-b5b9-4be0-b930-2f2217e368ae service cinder] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:09:11.333598 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc077fa-b5b9-4be0-b930-2f2217e368ae service cinder] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:09:11.395537 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44032dcf-a069-48b4-b6a7-5a1e6e2485a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:09:11.396234 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44032dcf-a069-48b4-b6a7-5a1e6e2485a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:09:11.396513 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44032dcf-a069-48b4-b6a7-5a1e6e2485a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:09:11.396822 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44032dcf-a069-48b4-b6a7-5a1e6e2485a5 admin admin] PATH_INFO: `/v3/projects/31e72230ddee4ba396a4cf0dd775e621` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:09:11.397952 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44032dcf-a069-48b4-b6a7-5a1e6e2485a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31e72230ddee4ba396a4cf0dd775e621)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:09:11.399871 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44032dcf-a069-48b4-b6a7-5a1e6e2485a5 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:09:11.550982 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:09:11.552504 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-44032dcf-a069-48b4-b6a7-5a1e6e2485a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31e72230ddee4ba396a4cf0dd775e621', 'request_id': 'req-44032dcf-a069-48b4-b6a7-5a1e6e2485a5'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:09:11.559325 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-44032dcf-a069-48b4-b6a7-5a1e6e2485a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31e72230ddee4ba396a4cf0dd775e621', 'request_id': 'req-44032dcf-a069-48b4-b6a7-5a1e6e2485a5'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:09:11.648325 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-44032dcf-a069-48b4-b6a7-5a1e6e2485a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31e72230ddee4ba396a4cf0dd775e621', 'request_id': 'req-44032dcf-a069-48b4-b6a7-5a1e6e2485a5'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:09:11.659966 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-44032dcf-a069-48b4-b6a7-5a1e6e2485a5 admin admin] The token cache is being invalidate because project 31e72230ddee4ba396a4cf0dd775e621 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:09:11.664678 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-44032dcf-a069-48b4-b6a7-5a1e6e2485a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:09:11.664678 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-44032dcf-a069-48b4-b6a7-5a1e6e2485a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:09:11.664678 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1355/2715] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Oct 4 12:09:11 2022] DELETE /identity/v3/projects/31e72230ddee4ba396a4cf0dd775e621 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:09:11.668107 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c41d466-8734-44de-9b5f-8d4f71207a20 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:09:11.668619 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c41d466-8734-44de-9b5f-8d4f71207a20 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:09:11.668734 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c41d466-8734-44de-9b5f-8d4f71207a20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:09:11.689646 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-9c41d466-8734-44de-9b5f-8d4f71207a20 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:09:11.691017 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-9c41d466-8734-44de-9b5f-8d4f71207a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:09:11.752185 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1361/2716] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:09:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:09:11.760650 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481f6c75-2512-418d-93bc-147ab41e0634 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:09:11.760941 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481f6c75-2512-418d-93bc-147ab41e0634 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:09:11.761217 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481f6c75-2512-418d-93bc-147ab41e0634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:09:11.782730 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-481f6c75-2512-418d-93bc-147ab41e0634 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:09:11.784645 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-481f6c75-2512-418d-93bc-147ab41e0634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:09:11.792940 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1356/2717] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:09:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:09:11.797701 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c41d466-8734-44de-9b5f-8d4f71207a20 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:09:11.807599 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c41d466-8734-44de-9b5f-8d4f71207a20 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:09:11.812482 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aa207e-08ad-4391-9025-bf208cdfcd4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:09:11.813693 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aa207e-08ad-4391-9025-bf208cdfcd4b admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:09:11.813693 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aa207e-08ad-4391-9025-bf208cdfcd4b admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:09:11.813693 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aa207e-08ad-4391-9025-bf208cdfcd4b admin admin] PATH_INFO: `/v3/domains` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:09:11.814446 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13aa207e-08ad-4391-9025-bf208cdfcd4b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:09:11.814752 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13aa207e-08ad-4391-9025-bf208cdfcd4b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:09:11.816850 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13aa207e-08ad-4391-9025-bf208cdfcd4b admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:09:11.828779 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1362/2718] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Oct 4 12:09:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:09:11.833744 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481f6c75-2512-418d-93bc-147ab41e0634 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:09:11.842900 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481f6c75-2512-418d-93bc-147ab41e0634 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:09:11.848182 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32edfee2-a286-4214-8f34-6578ffd140e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:09:11.848788 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32edfee2-a286-4214-8f34-6578ffd140e0 admin admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:09:11.849064 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32edfee2-a286-4214-8f34-6578ffd140e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:09:11.849331 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32edfee2-a286-4214-8f34-6578ffd140e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:09:11.849961 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32edfee2-a286-4214-8f34-6578ffd140e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:09:11.851847 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32edfee2-a286-4214-8f34-6578ffd140e0 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:09:11.945081 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1357/2719] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Oct 4 12:09:11 2022] POST /identity/v3/projects => generated 381 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 12:09:11.949340 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aa207e-08ad-4391-9025-bf208cdfcd4b admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:09:11.960096 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aa207e-08ad-4391-9025-bf208cdfcd4b admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:09:12.016136 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14505126-0d49-4e1b-b5d4-f26d4d2e7157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:09:12.016772 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14505126-0d49-4e1b-b5d4-f26d4d2e7157 admin admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:09:12.017045 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14505126-0d49-4e1b-b5d4-f26d4d2e7157 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:09:12.017318 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14505126-0d49-4e1b-b5d4-f26d4d2e7157 admin admin] PATH_INFO: `/v3/users` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:09:12.017966 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14505126-0d49-4e1b-b5d4-f26d4d2e7157 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:09:12.020488 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14505126-0d49-4e1b-b5d4-f26d4d2e7157 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:09:12.203980 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1363/2720] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Oct 4 12:09:11 2022] POST /identity/v3/users => generated 291 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:09:12.209332 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32edfee2-a286-4214-8f34-6578ffd140e0 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:09:12.219486 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32edfee2-a286-4214-8f34-6578ffd140e0 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:09:12.224363 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0ccc88-37de-4df8-847d-cca452671aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:09:12.224993 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0ccc88-37de-4df8-847d-cca452671aeb admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:09:12.225269 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0ccc88-37de-4df8-847d-cca452671aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:09:12.225536 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0ccc88-37de-4df8-847d-cca452671aeb admin admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:09:12.226162 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0ccc88-37de-4df8-847d-cca452671aeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:09:12.227732 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0ccc88-37de-4df8-847d-cca452671aeb admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:09:12.238468 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1358/2721] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:09:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:09:12.242761 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14505126-0d49-4e1b-b5d4-f26d4d2e7157 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:09:12.249125 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:09:12.254188 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14505126-0d49-4e1b-b5d4-f26d4d2e7157 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:09:12.258799 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bfe053-c8ec-4d62-89e6-f9cee4942011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:09:12.259393 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bfe053-c8ec-4d62-89e6-f9cee4942011 admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:09:12.259704 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bfe053-c8ec-4d62-89e6-f9cee4942011 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:09:12.259977 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bfe053-c8ec-4d62-89e6-f9cee4942011 admin admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:09:12.260637 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bfe053-c8ec-4d62-89e6-f9cee4942011 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:09:12.262229 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bfe053-c8ec-4d62-89e6-f9cee4942011 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:09:12.273921 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1364/2722] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:09:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:09:12.278008 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0ccc88-37de-4df8-847d-cca452671aeb admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:09:12.288165 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0ccc88-37de-4df8-847d-cca452671aeb admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:09:12.292698 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d621ea2-8251-4402-ae17-059739b90ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:09:12.293467 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d621ea2-8251-4402-ae17-059739b90ec6 admin admin] REQUEST_METHOD: `PUT` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:09:12.293733 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d621ea2-8251-4402-ae17-059739b90ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:09:12.294003 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d621ea2-8251-4402-ae17-059739b90ec6 admin admin] PATH_INFO: `/v3/projects/c0ecd25d5396493ea95b9e1b97649419/users/e1429acb77ea4b5eafd2ad48293ef188/roles/ab4307f3b7994c1c80036fa7db93b6b9` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:09:12.314173 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d621ea2-8251-4402-ae17-059739b90ec6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0ecd25d5396493ea95b9e1b97649419, user_id=e1429acb77ea4b5eafd2ad48293ef188, role_id=ab4307f3b7994c1c80036fa7db93b6b9)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:09:12.320104 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d621ea2-8251-4402-ae17-059739b90ec6 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:09:12.427093 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1359/2723] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Oct 4 12:09:12 2022] PUT /identity/v3/projects/c0ecd25d5396493ea95b9e1b97649419/users/e1429acb77ea4b5eafd2ad48293ef188/roles/ab4307f3b7994c1c80036fa7db93b6b9 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:09:12.438494 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83c8a8f-4330-4c88-b5c3-941e5406ac87 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:09:12.438877 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83c8a8f-4330-4c88-b5c3-941e5406ac87 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:09:12.439264 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83c8a8f-4330-4c88-b5c3-941e5406ac87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:09:12.473687 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-f83c8a8f-4330-4c88-b5c3-941e5406ac87 None None] MFA Rules not processed for user `e1429acb77ea4b5eafd2ad48293ef188`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:09:12.474897 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-f83c8a8f-4330-4c88-b5c3-941e5406ac87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:09:12.561140 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1365/2724] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:09:12 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:09:12.566368 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d621ea2-8251-4402-ae17-059739b90ec6 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:09:12.629899 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d621ea2-8251-4402-ae17-059739b90ec6 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:09:12.634657 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42b56f9-ac0a-4f95-918e-208939705109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:09:12.635270 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42b56f9-ac0a-4f95-918e-208939705109 admin admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:09:12.635545 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42b56f9-ac0a-4f95-918e-208939705109 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:09:12.635820 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42b56f9-ac0a-4f95-918e-208939705109 admin admin] PATH_INFO: `/v3/projects` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:09:12.636457 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42b56f9-ac0a-4f95-918e-208939705109 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:09:12.638400 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42b56f9-ac0a-4f95-918e-208939705109 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:09:12.736046 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1360/2725] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Oct 4 12:09:12 2022] POST /identity/v3/projects => generated 379 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 12:09:12.741525 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83c8a8f-4330-4c88-b5c3-941e5406ac87 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:09:12.756007 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83c8a8f-4330-4c88-b5c3-941e5406ac87 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:09:12.822765 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801b8430-5299-4123-8681-3da04b596164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:09:12.823382 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801b8430-5299-4123-8681-3da04b596164 admin admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:09:12.823675 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801b8430-5299-4123-8681-3da04b596164 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:09:12.823936 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801b8430-5299-4123-8681-3da04b596164 admin admin] PATH_INFO: `/v3/users` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:09:12.824591 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801b8430-5299-4123-8681-3da04b596164 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:09:12.826543 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801b8430-5299-4123-8681-3da04b596164 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:09:13.003694 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1366/2726] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Oct 4 12:09:12 2022] POST /identity/v3/users => generated 296 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:09:13.006827 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42b56f9-ac0a-4f95-918e-208939705109 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:09:13.020475 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42b56f9-ac0a-4f95-918e-208939705109 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:09:13.025213 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e0be94-5961-4ff2-abe4-8dde8ab9db2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:09:13.025812 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e0be94-5961-4ff2-abe4-8dde8ab9db2b admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:09:13.026080 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e0be94-5961-4ff2-abe4-8dde8ab9db2b admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:09:13.026453 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e0be94-5961-4ff2-abe4-8dde8ab9db2b admin admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:09:13.027119 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e0be94-5961-4ff2-abe4-8dde8ab9db2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:09:13.028725 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e0be94-5961-4ff2-abe4-8dde8ab9db2b admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:09:13.040408 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1361/2727] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:09:13 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:09:13.044665 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801b8430-5299-4123-8681-3da04b596164 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:09:13.055456 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801b8430-5299-4123-8681-3da04b596164 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:09:13.060463 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a504bcc-1d61-42bc-99fa-03bd57c359ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:09:13.061279 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a504bcc-1d61-42bc-99fa-03bd57c359ea admin admin] REQUEST_METHOD: `PUT` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:09:13.061457 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a504bcc-1d61-42bc-99fa-03bd57c359ea admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:09:13.061734 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a504bcc-1d61-42bc-99fa-03bd57c359ea admin admin] PATH_INFO: `/v3/projects/2c7df8456d4a4debb839a7891a6ab641/users/9915a8d3a0a24c3292f451e16b9c5934/roles/d6e7421d1ff9451c808004b818354550` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:09:13.077225 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a504bcc-1d61-42bc-99fa-03bd57c359ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c7df8456d4a4debb839a7891a6ab641, user_id=9915a8d3a0a24c3292f451e16b9c5934, role_id=d6e7421d1ff9451c808004b818354550)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:09:13.079946 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a504bcc-1d61-42bc-99fa-03bd57c359ea admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:09:13.205032 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1367/2728] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Oct 4 12:09:13 2022] PUT /identity/v3/projects/2c7df8456d4a4debb839a7891a6ab641/users/9915a8d3a0a24c3292f451e16b9c5934/roles/d6e7421d1ff9451c808004b818354550 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:09:13.209768 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e0be94-5961-4ff2-abe4-8dde8ab9db2b admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:09:13.220145 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e0be94-5961-4ff2-abe4-8dde8ab9db2b admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:09:13.267457 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:09:13.286487 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcf0097-279a-46e9-b347-96396e0e4338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:09:13.287186 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcf0097-279a-46e9-b347-96396e0e4338 admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:09:13.287401 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcf0097-279a-46e9-b347-96396e0e4338 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:09:13.287673 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcf0097-279a-46e9-b347-96396e0e4338 admin admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:09:13.288359 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcf0097-279a-46e9-b347-96396e0e4338 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:09:13.290027 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcf0097-279a-46e9-b347-96396e0e4338 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:09:13.310707 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1362/2729] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:09:13 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:09:13.311202 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a504bcc-1d61-42bc-99fa-03bd57c359ea admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:09:13.323906 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a504bcc-1d61-42bc-99fa-03bd57c359ea admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:09:13.328819 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fea3ea6-6c21-4c4a-9633-4dd9f8247060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:09:13.329967 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fea3ea6-6c21-4c4a-9633-4dd9f8247060 admin admin] REQUEST_METHOD: `PUT` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:09:13.330361 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fea3ea6-6c21-4c4a-9633-4dd9f8247060 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:09:13.331148 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fea3ea6-6c21-4c4a-9633-4dd9f8247060 admin admin] PATH_INFO: `/v3/projects/2c7df8456d4a4debb839a7891a6ab641/users/9915a8d3a0a24c3292f451e16b9c5934/roles/d6e7421d1ff9451c808004b818354550` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:09:13.334227 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fea3ea6-6c21-4c4a-9633-4dd9f8247060 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c7df8456d4a4debb839a7891a6ab641, user_id=9915a8d3a0a24c3292f451e16b9c5934, role_id=d6e7421d1ff9451c808004b818354550)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:09:13.338076 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fea3ea6-6c21-4c4a-9633-4dd9f8247060 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:09:13.352478 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1368/2730] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Oct 4 12:09:13 2022] PUT /identity/v3/projects/2c7df8456d4a4debb839a7891a6ab641/users/9915a8d3a0a24c3292f451e16b9c5934/roles/d6e7421d1ff9451c808004b818354550 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:09:13.364250 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bb8b65-ad8d-44fa-a8ef-ccb11ca33139 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:09:13.364540 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bb8b65-ad8d-44fa-a8ef-ccb11ca33139 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:09:13.373100 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bb8b65-ad8d-44fa-a8ef-ccb11ca33139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:09:13.397975 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-34bb8b65-ad8d-44fa-a8ef-ccb11ca33139 None None] MFA Rules not processed for user `9915a8d3a0a24c3292f451e16b9c5934`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:09:13.399198 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-34bb8b65-ad8d-44fa-a8ef-ccb11ca33139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:09:13.473203 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1363/2731] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:09:13 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 12:09:13.484910 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fea3ea6-6c21-4c4a-9633-4dd9f8247060 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:09:13.486601 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-4fea3ea6-6c21-4c4a-9633-4dd9f8247060 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:09:13.529153 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:09:13.546056 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fea3ea6-6c21-4c4a-9633-4dd9f8247060 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:09:13.550128 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60c5a8a-03c2-47bf-b9f4-f60cc6f8fe4f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e2a05b782424ab2928b5864f1bfd556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:09:13.550732 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60c5a8a-03c2-47bf-b9f4-f60cc6f8fe4f service cinder] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:09:13.551014 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60c5a8a-03c2-47bf-b9f4-f60cc6f8fe4f service cinder] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:09:13.551294 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60c5a8a-03c2-47bf-b9f4-f60cc6f8fe4f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:09:13.560179 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60c5a8a-03c2-47bf-b9f4-f60cc6f8fe4f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:09:13.561662 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60c5a8a-03c2-47bf-b9f4-f60cc6f8fe4f service cinder] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:09:13.571853 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1369/2732] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:09:13 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:09:14.355253 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bb8b65-ad8d-44fa-a8ef-ccb11ca33139 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:09:14.417831 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bb8b65-ad8d-44fa-a8ef-ccb11ca33139 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:09:14.422282 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e96e1b5-f89e-4083-b991-0455026cdbb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:09:14.422913 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e96e1b5-f89e-4083-b991-0455026cdbb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:09:14.423193 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e96e1b5-f89e-4083-b991-0455026cdbb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:09:14.423465 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e96e1b5-f89e-4083-b991-0455026cdbb3 admin admin] PATH_INFO: `/v3/users/e1429acb77ea4b5eafd2ad48293ef188` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:09:14.425713 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e96e1b5-f89e-4083-b991-0455026cdbb3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1429acb77ea4b5eafd2ad48293ef188)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:09:14.427698 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e96e1b5-f89e-4083-b991-0455026cdbb3 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:09:14.677327 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-1e96e1b5-f89e-4083-b991-0455026cdbb3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1429acb77ea4b5eafd2ad48293ef188'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:09:14.684344 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-1e96e1b5-f89e-4083-b991-0455026cdbb3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1429acb77ea4b5eafd2ad48293ef188'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:09:14.685053 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-1e96e1b5-f89e-4083-b991-0455026cdbb3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1429acb77ea4b5eafd2ad48293ef188'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:09:14.685652 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-1e96e1b5-f89e-4083-b991-0455026cdbb3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1429acb77ea4b5eafd2ad48293ef188'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:09:14.782929 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-1e96e1b5-f89e-4083-b991-0455026cdbb3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1429acb77ea4b5eafd2ad48293ef188'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:09:14.789137 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:09:14.802035 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1364/2733] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Oct 4 12:09:14 2022] DELETE /identity/v3/users/e1429acb77ea4b5eafd2ad48293ef188 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:09:14.806570 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe7f39d-9ccd-4c21-98b8-d22e807bbc2c None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:09:14.807070 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe7f39d-9ccd-4c21-98b8-d22e807bbc2c None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:09:14.807181 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe7f39d-9ccd-4c21-98b8-d22e807bbc2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:09:14.827894 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-1fe7f39d-9ccd-4c21-98b8-d22e807bbc2c None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:09:14.829132 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-1fe7f39d-9ccd-4c21-98b8-d22e807bbc2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:09:14.888630 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1370/2734] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:09:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:09:14.901193 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e96e1b5-f89e-4083-b991-0455026cdbb3 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:09:14.902906 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-1e96e1b5-f89e-4083-b991-0455026cdbb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:09:14.968912 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e96e1b5-f89e-4083-b991-0455026cdbb3 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:09:14.973308 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57921665-2852-4d8c-87a6-df95fa284db6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7289515c5c44914a19daa439de98cb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:09:14.973916 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57921665-2852-4d8c-87a6-df95fa284db6 service neutron] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:09:14.974196 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57921665-2852-4d8c-87a6-df95fa284db6 service neutron] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:09:14.974473 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57921665-2852-4d8c-87a6-df95fa284db6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:09:14.983387 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57921665-2852-4d8c-87a6-df95fa284db6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:09:14.984894 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57921665-2852-4d8c-87a6-df95fa284db6 service neutron] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:09:14.995654 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1365/2735] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:09:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:09:15.449172 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe7f39d-9ccd-4c21-98b8-d22e807bbc2c None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:09:15.451050 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-1fe7f39d-9ccd-4c21-98b8-d22e807bbc2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:09:15.463969 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe7f39d-9ccd-4c21-98b8-d22e807bbc2c None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:09:15.468988 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f094fb34-9cd1-4385-89b0-8d71878de656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:09:15.469627 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f094fb34-9cd1-4385-89b0-8d71878de656 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:09:15.469906 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f094fb34-9cd1-4385-89b0-8d71878de656 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:09:15.470179 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f094fb34-9cd1-4385-89b0-8d71878de656 admin admin] PATH_INFO: `/v3/projects/c0ecd25d5396493ea95b9e1b97649419` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:09:15.472049 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f094fb34-9cd1-4385-89b0-8d71878de656 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0ecd25d5396493ea95b9e1b97649419)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:09:15.474074 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f094fb34-9cd1-4385-89b0-8d71878de656 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:09:15.588732 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-f094fb34-9cd1-4385-89b0-8d71878de656 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0ecd25d5396493ea95b9e1b97649419', 'request_id': 'req-f094fb34-9cd1-4385-89b0-8d71878de656'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:09:15.714272 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-f094fb34-9cd1-4385-89b0-8d71878de656 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0ecd25d5396493ea95b9e1b97649419', 'request_id': 'req-f094fb34-9cd1-4385-89b0-8d71878de656'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:09:15.721780 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-f094fb34-9cd1-4385-89b0-8d71878de656 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0ecd25d5396493ea95b9e1b97649419', 'request_id': 'req-f094fb34-9cd1-4385-89b0-8d71878de656'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:09:15.732375 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-f094fb34-9cd1-4385-89b0-8d71878de656 admin admin] The token cache is being invalidate because project c0ecd25d5396493ea95b9e1b97649419 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:09:15.732637 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-f094fb34-9cd1-4385-89b0-8d71878de656 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:09:15.733299 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-f094fb34-9cd1-4385-89b0-8d71878de656 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:09:15.734791 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1371/2736] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Oct 4 12:09:15 2022] DELETE /identity/v3/projects/c0ecd25d5396493ea95b9e1b97649419 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:09:15.740182 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57921665-2852-4d8c-87a6-df95fa284db6 service neutron] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:09:15.750059 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57921665-2852-4d8c-87a6-df95fa284db6 service neutron] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:09:15.808705 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d0b8d9-cdf8-4cca-ba80-483e96bd29e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:09:15.809346 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d0b8d9-cdf8-4cca-ba80-483e96bd29e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:09:15.809626 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d0b8d9-cdf8-4cca-ba80-483e96bd29e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:09:15.809899 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d0b8d9-cdf8-4cca-ba80-483e96bd29e3 admin admin] PATH_INFO: `/v3/users/9915a8d3a0a24c3292f451e16b9c5934` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:09:15.811013 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d0b8d9-cdf8-4cca-ba80-483e96bd29e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9915a8d3a0a24c3292f451e16b9c5934)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:09:15.813031 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d0b8d9-cdf8-4cca-ba80-483e96bd29e3 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:09:16.067300 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-12d0b8d9-cdf8-4cca-ba80-483e96bd29e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9915a8d3a0a24c3292f451e16b9c5934'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:09:16.074760 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-12d0b8d9-cdf8-4cca-ba80-483e96bd29e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9915a8d3a0a24c3292f451e16b9c5934'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:09:16.075437 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-12d0b8d9-cdf8-4cca-ba80-483e96bd29e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9915a8d3a0a24c3292f451e16b9c5934'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:09:16.076034 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-12d0b8d9-cdf8-4cca-ba80-483e96bd29e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9915a8d3a0a24c3292f451e16b9c5934'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:09:16.156781 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-12d0b8d9-cdf8-4cca-ba80-483e96bd29e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9915a8d3a0a24c3292f451e16b9c5934'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:09:16.175644 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1366/2737] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Oct 4 12:09:15 2022] DELETE /identity/v3/users/9915a8d3a0a24c3292f451e16b9c5934 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:09:16.684007 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f094fb34-9cd1-4385-89b0-8d71878de656 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:09:16.685500 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-f094fb34-9cd1-4385-89b0-8d71878de656 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:09:16.700417 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f094fb34-9cd1-4385-89b0-8d71878de656 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:09:16.759899 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dfa8e6-46df-4667-a3df-ca2a4abc8da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:09:16.760554 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dfa8e6-46df-4667-a3df-ca2a4abc8da9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:09:16.760887 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dfa8e6-46df-4667-a3df-ca2a4abc8da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:09:16.761160 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dfa8e6-46df-4667-a3df-ca2a4abc8da9 admin admin] PATH_INFO: `/v3/projects/2c7df8456d4a4debb839a7891a6ab641` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:09:16.762324 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dfa8e6-46df-4667-a3df-ca2a4abc8da9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c7df8456d4a4debb839a7891a6ab641)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:09:16.764234 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dfa8e6-46df-4667-a3df-ca2a4abc8da9 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:09:16.766531 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:09:16.920489 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-81dfa8e6-46df-4667-a3df-ca2a4abc8da9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c7df8456d4a4debb839a7891a6ab641', 'request_id': 'req-81dfa8e6-46df-4667-a3df-ca2a4abc8da9'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:09:17.024894 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-81dfa8e6-46df-4667-a3df-ca2a4abc8da9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c7df8456d4a4debb839a7891a6ab641', 'request_id': 'req-81dfa8e6-46df-4667-a3df-ca2a4abc8da9'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:09:17.027740 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-81dfa8e6-46df-4667-a3df-ca2a4abc8da9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c7df8456d4a4debb839a7891a6ab641', 'request_id': 'req-81dfa8e6-46df-4667-a3df-ca2a4abc8da9'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:09:17.045339 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-81dfa8e6-46df-4667-a3df-ca2a4abc8da9 admin admin] The token cache is being invalidate because project 2c7df8456d4a4debb839a7891a6ab641 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:09:17.045648 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-81dfa8e6-46df-4667-a3df-ca2a4abc8da9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:09:17.046270 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-81dfa8e6-46df-4667-a3df-ca2a4abc8da9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:09:17.047792 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1372/2738] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Oct 4 12:09:16 2022] DELETE /identity/v3/projects/2c7df8456d4a4debb839a7891a6ab641 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:09:17.053235 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09b6318-6cd7-4a62-b541-09b46bafd3e7 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:09:17.053645 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09b6318-6cd7-4a62-b541-09b46bafd3e7 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:09:17.053900 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09b6318-6cd7-4a62-b541-09b46bafd3e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:09:17.074884 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-b09b6318-6cd7-4a62-b541-09b46bafd3e7 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:09:17.076071 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-b09b6318-6cd7-4a62-b541-09b46bafd3e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:09:17.080234 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:09:17.138976 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1367/2739] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:09:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:09:17.148926 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6e9f74-0088-4c58-b74c-f2f21d17bf78 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:09:17.149218 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6e9f74-0088-4c58-b74c-f2f21d17bf78 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:09:17.149495 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6e9f74-0088-4c58-b74c-f2f21d17bf78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:09:17.170315 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-2a6e9f74-0088-4c58-b74c-f2f21d17bf78 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:09:17.172162 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-2a6e9f74-0088-4c58-b74c-f2f21d17bf78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:09:17.181753 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1373/2740] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:09:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:09:17.185490 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09b6318-6cd7-4a62-b541-09b46bafd3e7 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:09:17.196832 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09b6318-6cd7-4a62-b541-09b46bafd3e7 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:09:17.208822 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec05d9f-c83c-48f9-96b9-f67f91acfaf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:09:17.214326 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec05d9f-c83c-48f9-96b9-f67f91acfaf3 admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:09:17.214326 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec05d9f-c83c-48f9-96b9-f67f91acfaf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:09:17.214326 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec05d9f-c83c-48f9-96b9-f67f91acfaf3 admin admin] PATH_INFO: `/v3/domains` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:09:17.214326 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec05d9f-c83c-48f9-96b9-f67f91acfaf3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:09:17.214326 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec05d9f-c83c-48f9-96b9-f67f91acfaf3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:09:17.215428 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec05d9f-c83c-48f9-96b9-f67f91acfaf3 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:09:17.231236 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1368/2741] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Oct 4 12:09:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:09:17.233734 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6e9f74-0088-4c58-b74c-f2f21d17bf78 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:09:17.243706 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6e9f74-0088-4c58-b74c-f2f21d17bf78 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:09:17.251620 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c62443f-9379-48fb-8b96-18ed842e7acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:09:17.252967 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c62443f-9379-48fb-8b96-18ed842e7acc admin admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:09:17.253435 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c62443f-9379-48fb-8b96-18ed842e7acc admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:09:17.253435 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c62443f-9379-48fb-8b96-18ed842e7acc admin admin] PATH_INFO: `/v3/projects` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:09:17.254177 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c62443f-9379-48fb-8b96-18ed842e7acc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:09:17.256528 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c62443f-9379-48fb-8b96-18ed842e7acc admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:09:17.359558 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1374/2742] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Oct 4 12:09:17 2022] POST /identity/v3/projects => generated 383 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:09:17.363539 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec05d9f-c83c-48f9-96b9-f67f91acfaf3 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:09:17.371265 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec05d9f-c83c-48f9-96b9-f67f91acfaf3 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:09:17.429801 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ae14d6-6071-4bb3-956c-4dbf00398acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:09:17.430420 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae14d6-6071-4bb3-956c-4dbf00398acc admin admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:09:17.430705 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae14d6-6071-4bb3-956c-4dbf00398acc admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:09:17.430983 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae14d6-6071-4bb3-956c-4dbf00398acc admin admin] PATH_INFO: `/v3/users` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:09:17.431613 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ae14d6-6071-4bb3-956c-4dbf00398acc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:09:17.433572 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ae14d6-6071-4bb3-956c-4dbf00398acc admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:09:17.617104 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1369/2743] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Oct 4 12:09:17 2022] POST /identity/v3/users => generated 292 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:09:17.639114 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c62443f-9379-48fb-8b96-18ed842e7acc admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:09:17.649603 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c62443f-9379-48fb-8b96-18ed842e7acc admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:09:17.654441 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3ce155-df6d-4569-b444-48684ac43265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:09:17.655136 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3ce155-df6d-4569-b444-48684ac43265 admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:09:17.655490 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3ce155-df6d-4569-b444-48684ac43265 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:09:17.655838 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3ce155-df6d-4569-b444-48684ac43265 admin admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:09:17.656633 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3ce155-df6d-4569-b444-48684ac43265 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:09:17.658354 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3ce155-df6d-4569-b444-48684ac43265 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:09:17.668482 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1375/2744] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:09:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:09:17.679447 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ae14d6-6071-4bb3-956c-4dbf00398acc admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:09:17.689323 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ae14d6-6071-4bb3-956c-4dbf00398acc admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:09:17.695001 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2358b2ef-6e89-4876-9b38-95037baa5cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:09:17.695976 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2358b2ef-6e89-4876-9b38-95037baa5cba admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:09:17.696321 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2358b2ef-6e89-4876-9b38-95037baa5cba admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:09:17.696806 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2358b2ef-6e89-4876-9b38-95037baa5cba admin admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:09:17.697780 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2358b2ef-6e89-4876-9b38-95037baa5cba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:09:17.699703 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2358b2ef-6e89-4876-9b38-95037baa5cba admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:09:17.711273 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1370/2745] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:09:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:09:17.715992 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3ce155-df6d-4569-b444-48684ac43265 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:09:17.726859 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3ce155-df6d-4569-b444-48684ac43265 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:09:17.731582 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f70783e-9081-45ce-a758-f952c9e8a7e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:09:17.732275 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f70783e-9081-45ce-a758-f952c9e8a7e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:09:17.732552 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f70783e-9081-45ce-a758-f952c9e8a7e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:09:17.732875 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f70783e-9081-45ce-a758-f952c9e8a7e4 admin admin] PATH_INFO: `/v3/projects/1c69ada794a84fafadf41fdd7aeceecb/users/aeb05dcd670145abadf85dca275b9f2d/roles/ab4307f3b7994c1c80036fa7db93b6b9` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:09:17.748416 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f70783e-9081-45ce-a758-f952c9e8a7e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c69ada794a84fafadf41fdd7aeceecb, user_id=aeb05dcd670145abadf85dca275b9f2d, role_id=ab4307f3b7994c1c80036fa7db93b6b9)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:09:17.751152 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f70783e-9081-45ce-a758-f952c9e8a7e4 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:09:17.857243 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1376/2746] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Oct 4 12:09:17 2022] PUT /identity/v3/projects/1c69ada794a84fafadf41fdd7aeceecb/users/aeb05dcd670145abadf85dca275b9f2d/roles/ab4307f3b7994c1c80036fa7db93b6b9 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:09:17.869416 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2abe365-1a3c-4f7d-9c52-688610522de0 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:09:17.869585 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2abe365-1a3c-4f7d-9c52-688610522de0 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:09:17.869867 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2abe365-1a3c-4f7d-9c52-688610522de0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:09:17.905704 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-a2abe365-1a3c-4f7d-9c52-688610522de0 None None] MFA Rules not processed for user `aeb05dcd670145abadf85dca275b9f2d`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:09:17.905704 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-a2abe365-1a3c-4f7d-9c52-688610522de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:09:17.970812 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1371/2747] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:09:17 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:09:17.975911 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f70783e-9081-45ce-a758-f952c9e8a7e4 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:09:18.040862 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f70783e-9081-45ce-a758-f952c9e8a7e4 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:09:18.045406 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6978543-2cd2-4f27-ae96-9f5b7e5a72a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:09:18.046010 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6978543-2cd2-4f27-ae96-9f5b7e5a72a2 admin admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:09:18.046287 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6978543-2cd2-4f27-ae96-9f5b7e5a72a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:09:18.046560 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6978543-2cd2-4f27-ae96-9f5b7e5a72a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:09:18.047338 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6978543-2cd2-4f27-ae96-9f5b7e5a72a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:09:18.049195 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6978543-2cd2-4f27-ae96-9f5b7e5a72a2 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:09:18.197289 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1377/2748] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Oct 4 12:09:17 2022] POST /identity/v3/projects => generated 383 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:09:18.207184 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2abe365-1a3c-4f7d-9c52-688610522de0 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:09:18.213731 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:09:18.218021 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2abe365-1a3c-4f7d-9c52-688610522de0 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:09:18.280040 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472f8f87-fcc5-4eaa-8be5-b5c30689de3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:09:18.280685 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472f8f87-fcc5-4eaa-8be5-b5c30689de3f admin admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:09:18.281107 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472f8f87-fcc5-4eaa-8be5-b5c30689de3f admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:09:18.281381 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472f8f87-fcc5-4eaa-8be5-b5c30689de3f admin admin] PATH_INFO: `/v3/users` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:09:18.282164 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472f8f87-fcc5-4eaa-8be5-b5c30689de3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:09:18.284695 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472f8f87-fcc5-4eaa-8be5-b5c30689de3f admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:09:18.406467 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1372/2749] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Oct 4 12:09:18 2022] POST /identity/v3/users => generated 298 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 12:09:18.410986 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6978543-2cd2-4f27-ae96-9f5b7e5a72a2 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:09:18.420972 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6978543-2cd2-4f27-ae96-9f5b7e5a72a2 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:09:18.426865 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d7ebc7-5cfb-4ea1-9ee0-149b4b0ddfbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:09:18.427170 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d7ebc7-5cfb-4ea1-9ee0-149b4b0ddfbf admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:09:18.427457 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d7ebc7-5cfb-4ea1-9ee0-149b4b0ddfbf admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:09:18.427731 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d7ebc7-5cfb-4ea1-9ee0-149b4b0ddfbf admin admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:09:18.428377 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d7ebc7-5cfb-4ea1-9ee0-149b4b0ddfbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:09:18.430013 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d7ebc7-5cfb-4ea1-9ee0-149b4b0ddfbf admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:09:18.441741 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1378/2750] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:09:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 12:09:18.445762 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472f8f87-fcc5-4eaa-8be5-b5c30689de3f admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:09:18.456347 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472f8f87-fcc5-4eaa-8be5-b5c30689de3f admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:09:18.461212 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92282e48-d699-493f-8226-2196640b349d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:09:18.461860 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92282e48-d699-493f-8226-2196640b349d admin admin] REQUEST_METHOD: `PUT` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:09:18.462169 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92282e48-d699-493f-8226-2196640b349d admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:09:18.462395 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92282e48-d699-493f-8226-2196640b349d admin admin] PATH_INFO: `/v3/projects/de05172556cb47a9a2ad2a50abd6f11e/users/2979aac9dd8e4e5e9c2b992d2b84c708/roles/d6e7421d1ff9451c808004b818354550` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:09:18.478001 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92282e48-d699-493f-8226-2196640b349d admin admin] RBAC: Authorizing `identity:create_grant(project_id=de05172556cb47a9a2ad2a50abd6f11e, user_id=2979aac9dd8e4e5e9c2b992d2b84c708, role_id=d6e7421d1ff9451c808004b818354550)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:09:18.480722 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92282e48-d699-493f-8226-2196640b349d admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:09:18.577750 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1373/2751] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Oct 4 12:09:18 2022] PUT /identity/v3/projects/de05172556cb47a9a2ad2a50abd6f11e/users/2979aac9dd8e4e5e9c2b992d2b84c708/roles/d6e7421d1ff9451c808004b818354550 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:09:18.581887 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d7ebc7-5cfb-4ea1-9ee0-149b4b0ddfbf admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:09:18.587106 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:09:18.592292 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d7ebc7-5cfb-4ea1-9ee0-149b4b0ddfbf admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:09:18.651343 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17885343-8afc-4c98-878b-5c7bcf6459ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:09:18.651943 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17885343-8afc-4c98-878b-5c7bcf6459ee admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:09:18.652256 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17885343-8afc-4c98-878b-5c7bcf6459ee admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:09:18.652480 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17885343-8afc-4c98-878b-5c7bcf6459ee admin admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:09:18.653168 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17885343-8afc-4c98-878b-5c7bcf6459ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:09:18.654707 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17885343-8afc-4c98-878b-5c7bcf6459ee admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:09:18.666222 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1379/2752] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:09:18 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 12:09:18.670383 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92282e48-d699-493f-8226-2196640b349d admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:09:18.681981 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92282e48-d699-493f-8226-2196640b349d admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:09:18.686594 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f673c098-5c1e-4a58-be06-af18e4cebb54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:09:18.687238 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f673c098-5c1e-4a58-be06-af18e4cebb54 admin admin] REQUEST_METHOD: `PUT` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:09:18.707669 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f673c098-5c1e-4a58-be06-af18e4cebb54 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:09:18.707669 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f673c098-5c1e-4a58-be06-af18e4cebb54 admin admin] PATH_INFO: `/v3/projects/de05172556cb47a9a2ad2a50abd6f11e/users/2979aac9dd8e4e5e9c2b992d2b84c708/roles/d6e7421d1ff9451c808004b818354550` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:09:18.707669 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f673c098-5c1e-4a58-be06-af18e4cebb54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de05172556cb47a9a2ad2a50abd6f11e, user_id=2979aac9dd8e4e5e9c2b992d2b84c708, role_id=d6e7421d1ff9451c808004b818354550)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:09:18.707669 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f673c098-5c1e-4a58-be06-af18e4cebb54 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:09:18.707669 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1374/2753] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Oct 4 12:09:18 2022] PUT /identity/v3/projects/de05172556cb47a9a2ad2a50abd6f11e/users/2979aac9dd8e4e5e9c2b992d2b84c708/roles/d6e7421d1ff9451c808004b818354550 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:09:18.717418 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9171c47-fcb6-4fb1-94e3-7c68867c5094 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:09:18.717958 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9171c47-fcb6-4fb1-94e3-7c68867c5094 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:09:18.717958 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9171c47-fcb6-4fb1-94e3-7c68867c5094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:09:18.748221 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-c9171c47-fcb6-4fb1-94e3-7c68867c5094 None None] MFA Rules not processed for user `2979aac9dd8e4e5e9c2b992d2b84c708`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:09:18.749469 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-c9171c47-fcb6-4fb1-94e3-7c68867c5094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:09:18.820575 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1380/2754] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:09:18 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:09:18.832539 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f673c098-5c1e-4a58-be06-af18e4cebb54 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:09:18.834194 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-f673c098-5c1e-4a58-be06-af18e4cebb54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:09:18.908523 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f673c098-5c1e-4a58-be06-af18e4cebb54 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:09:18.912916 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86ec4b8-073e-451f-9c28-026ba70e54bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e2a05b782424ab2928b5864f1bfd556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:09:18.913529 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86ec4b8-073e-451f-9c28-026ba70e54bb service cinder] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:09:18.919882 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86ec4b8-073e-451f-9c28-026ba70e54bb service cinder] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:09:18.919882 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86ec4b8-073e-451f-9c28-026ba70e54bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:09:18.923876 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86ec4b8-073e-451f-9c28-026ba70e54bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:09:18.926058 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86ec4b8-073e-451f-9c28-026ba70e54bb service cinder] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:09:18.937023 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1375/2755] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:09:18 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:09:19.127082 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9171c47-fcb6-4fb1-94e3-7c68867c5094 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:09:19.137342 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9171c47-fcb6-4fb1-94e3-7c68867c5094 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:09:19.141317 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e733e53-0e97-49b1-84aa-c345c837892d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e2a05b782424ab2928b5864f1bfd556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:09:19.141798 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e733e53-0e97-49b1-84aa-c345c837892d service cinder] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:09:19.142281 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e733e53-0e97-49b1-84aa-c345c837892d service cinder] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:09:19.142552 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e733e53-0e97-49b1-84aa-c345c837892d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:09:19.214447 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e733e53-0e97-49b1-84aa-c345c837892d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:09:19.215977 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e733e53-0e97-49b1-84aa-c345c837892d service cinder] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:09:19.237932 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1381/2756] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:09:19 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:09:19.788728 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86ec4b8-073e-451f-9c28-026ba70e54bb service cinder] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:09:19.851939 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:09:19.896505 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86ec4b8-073e-451f-9c28-026ba70e54bb service cinder] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:09:19.901110 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcc4e52-8d26-45c9-8343-15750d4d2398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:09:19.901732 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcc4e52-8d26-45c9-8343-15750d4d2398 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:09:19.902005 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcc4e52-8d26-45c9-8343-15750d4d2398 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:09:19.902270 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcc4e52-8d26-45c9-8343-15750d4d2398 admin admin] PATH_INFO: `/v3/users/aeb05dcd670145abadf85dca275b9f2d` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:09:19.903375 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcc4e52-8d26-45c9-8343-15750d4d2398 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aeb05dcd670145abadf85dca275b9f2d)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:09:19.905304 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcc4e52-8d26-45c9-8343-15750d4d2398 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:09:20.297267 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-7bcc4e52-8d26-45c9-8343-15750d4d2398 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aeb05dcd670145abadf85dca275b9f2d'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:09:20.308115 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-7bcc4e52-8d26-45c9-8343-15750d4d2398 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aeb05dcd670145abadf85dca275b9f2d'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:09:20.308865 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-7bcc4e52-8d26-45c9-8343-15750d4d2398 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aeb05dcd670145abadf85dca275b9f2d'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:09:20.309716 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-7bcc4e52-8d26-45c9-8343-15750d4d2398 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aeb05dcd670145abadf85dca275b9f2d'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:09:20.448466 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-7bcc4e52-8d26-45c9-8343-15750d4d2398 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aeb05dcd670145abadf85dca275b9f2d'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:09:20.467285 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1376/2757] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Oct 4 12:09:19 2022] DELETE /identity/v3/users/aeb05dcd670145abadf85dca275b9f2d => generated 0 bytes in 679 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:09:20.473014 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d828e94d-4de0-4a63-b529-05e692946155 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:09:20.473517 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d828e94d-4de0-4a63-b529-05e692946155 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:09:20.473617 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d828e94d-4de0-4a63-b529-05e692946155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:09:20.505199 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=100 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:09:20.527427 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-d828e94d-4de0-4a63-b529-05e692946155 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:09:20.528660 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-d828e94d-4de0-4a63-b529-05e692946155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:09:20.587866 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1382/2758] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:09:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:09:20.598918 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcc4e52-8d26-45c9-8343-15750d4d2398 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:09:20.600360 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-7bcc4e52-8d26-45c9-8343-15750d4d2398 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:09:20.674400 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcc4e52-8d26-45c9-8343-15750d4d2398 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:09:20.678261 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351793e3-afed-4b62-9ae8-aa5b6f4063eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7289515c5c44914a19daa439de98cb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:09:20.678862 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351793e3-afed-4b62-9ae8-aa5b6f4063eb service neutron] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:09:20.679139 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351793e3-afed-4b62-9ae8-aa5b6f4063eb service neutron] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:09:20.679407 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351793e3-afed-4b62-9ae8-aa5b6f4063eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:09:20.688585 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351793e3-afed-4b62-9ae8-aa5b6f4063eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:09:20.690070 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351793e3-afed-4b62-9ae8-aa5b6f4063eb service neutron] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:09:20.699516 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1377/2759] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:09:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:09:21.170137 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d828e94d-4de0-4a63-b529-05e692946155 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:09:21.171900 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-d828e94d-4de0-4a63-b529-05e692946155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:09:21.187400 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d828e94d-4de0-4a63-b529-05e692946155 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:09:21.193902 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda545c2-e510-4462-b46e-e9da5af1e551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:09:21.194669 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda545c2-e510-4462-b46e-e9da5af1e551 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:09:21.195007 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda545c2-e510-4462-b46e-e9da5af1e551 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:09:21.196120 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda545c2-e510-4462-b46e-e9da5af1e551 admin admin] PATH_INFO: `/v3/projects/1c69ada794a84fafadf41fdd7aeceecb` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:09:21.197751 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda545c2-e510-4462-b46e-e9da5af1e551 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c69ada794a84fafadf41fdd7aeceecb)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:09:21.199704 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda545c2-e510-4462-b46e-e9da5af1e551 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:09:21.331330 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-eda545c2-e510-4462-b46e-e9da5af1e551 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c69ada794a84fafadf41fdd7aeceecb', 'request_id': 'req-eda545c2-e510-4462-b46e-e9da5af1e551'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:09:21.502985 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-eda545c2-e510-4462-b46e-e9da5af1e551 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c69ada794a84fafadf41fdd7aeceecb', 'request_id': 'req-eda545c2-e510-4462-b46e-e9da5af1e551'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:09:21.510344 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-eda545c2-e510-4462-b46e-e9da5af1e551 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c69ada794a84fafadf41fdd7aeceecb', 'request_id': 'req-eda545c2-e510-4462-b46e-e9da5af1e551'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:09:21.521917 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-eda545c2-e510-4462-b46e-e9da5af1e551 admin admin] The token cache is being invalidate because project 1c69ada794a84fafadf41fdd7aeceecb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:09:21.522229 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-eda545c2-e510-4462-b46e-e9da5af1e551 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:09:21.522883 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-eda545c2-e510-4462-b46e-e9da5af1e551 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:09:21.524421 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1383/2760] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Oct 4 12:09:21 2022] DELETE /identity/v3/projects/1c69ada794a84fafadf41fdd7aeceecb => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:09:21.528410 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351793e3-afed-4b62-9ae8-aa5b6f4063eb service neutron] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:09:21.538733 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351793e3-afed-4b62-9ae8-aa5b6f4063eb service neutron] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:09:21.559177 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:09:21.594268 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e62ec55-d253-4e08-ae22-bb452cb1df2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:09:21.594963 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e62ec55-d253-4e08-ae22-bb452cb1df2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:09:21.595324 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e62ec55-d253-4e08-ae22-bb452cb1df2a admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:09:21.595592 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e62ec55-d253-4e08-ae22-bb452cb1df2a admin admin] PATH_INFO: `/v3/users/2979aac9dd8e4e5e9c2b992d2b84c708` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:09:21.597700 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e62ec55-d253-4e08-ae22-bb452cb1df2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2979aac9dd8e4e5e9c2b992d2b84c708)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:09:21.599653 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e62ec55-d253-4e08-ae22-bb452cb1df2a admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:09:21.865109 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-5e62ec55-d253-4e08-ae22-bb452cb1df2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2979aac9dd8e4e5e9c2b992d2b84c708'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:09:21.871805 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-5e62ec55-d253-4e08-ae22-bb452cb1df2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2979aac9dd8e4e5e9c2b992d2b84c708'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:09:21.872515 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-5e62ec55-d253-4e08-ae22-bb452cb1df2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2979aac9dd8e4e5e9c2b992d2b84c708'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:09:21.873152 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-5e62ec55-d253-4e08-ae22-bb452cb1df2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2979aac9dd8e4e5e9c2b992d2b84c708'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:09:21.996796 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-5e62ec55-d253-4e08-ae22-bb452cb1df2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2979aac9dd8e4e5e9c2b992d2b84c708'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:09:22.015240 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1378/2761] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Oct 4 12:09:21 2022] DELETE /identity/v3/users/2979aac9dd8e4e5e9c2b992d2b84c708 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:09:22.628268 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda545c2-e510-4462-b46e-e9da5af1e551 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:09:22.635700 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-eda545c2-e510-4462-b46e-e9da5af1e551 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:09:22.642945 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda545c2-e510-4462-b46e-e9da5af1e551 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:09:22.704672 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd456cc0-17e4-4eac-a677-5d764cbc0856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:09:22.705459 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd456cc0-17e4-4eac-a677-5d764cbc0856 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:09:22.705741 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd456cc0-17e4-4eac-a677-5d764cbc0856 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:09:22.706375 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd456cc0-17e4-4eac-a677-5d764cbc0856 admin admin] PATH_INFO: `/v3/projects/de05172556cb47a9a2ad2a50abd6f11e` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:09:22.707526 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd456cc0-17e4-4eac-a677-5d764cbc0856 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de05172556cb47a9a2ad2a50abd6f11e)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:09:22.709458 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd456cc0-17e4-4eac-a677-5d764cbc0856 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:09:22.732459 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:09:22.859108 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-dd456cc0-17e4-4eac-a677-5d764cbc0856 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de05172556cb47a9a2ad2a50abd6f11e', 'request_id': 'req-dd456cc0-17e4-4eac-a677-5d764cbc0856'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:09:22.945931 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-dd456cc0-17e4-4eac-a677-5d764cbc0856 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de05172556cb47a9a2ad2a50abd6f11e', 'request_id': 'req-dd456cc0-17e4-4eac-a677-5d764cbc0856'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:09:22.953168 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-dd456cc0-17e4-4eac-a677-5d764cbc0856 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de05172556cb47a9a2ad2a50abd6f11e', 'request_id': 'req-dd456cc0-17e4-4eac-a677-5d764cbc0856'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:09:22.965051 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-dd456cc0-17e4-4eac-a677-5d764cbc0856 admin admin] The token cache is being invalidate because project de05172556cb47a9a2ad2a50abd6f11e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:09:22.965348 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-dd456cc0-17e4-4eac-a677-5d764cbc0856 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:09:22.965994 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-dd456cc0-17e4-4eac-a677-5d764cbc0856 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:09:22.967882 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1384/2762] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Oct 4 12:09:22 2022] DELETE /identity/v3/projects/de05172556cb47a9a2ad2a50abd6f11e => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:09:22.973164 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565f2d36-b401-4443-aa62-5652c46264b5 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:09:22.973746 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565f2d36-b401-4443-aa62-5652c46264b5 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:09:22.973746 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565f2d36-b401-4443-aa62-5652c46264b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:09:23.026337 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-565f2d36-b401-4443-aa62-5652c46264b5 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:09:23.027628 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-565f2d36-b401-4443-aa62-5652c46264b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:09:23.089299 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1379/2763] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:09:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:09:23.156100 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8dfb79-c163-4fca-92c4-9797598da4bb None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:09:23.156380 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8dfb79-c163-4fca-92c4-9797598da4bb None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:09:23.156706 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8dfb79-c163-4fca-92c4-9797598da4bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:09:23.177792 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-6a8dfb79-c163-4fca-92c4-9797598da4bb None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:09:23.179236 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-6a8dfb79-c163-4fca-92c4-9797598da4bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:09:23.188537 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1385/2764] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:09:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:09:23.193515 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565f2d36-b401-4443-aa62-5652c46264b5 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:09:23.203219 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565f2d36-b401-4443-aa62-5652c46264b5 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:09:23.209596 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f57f26a-22c4-4aee-b0f8-3055256fe9c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:09:23.210286 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f57f26a-22c4-4aee-b0f8-3055256fe9c2 admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:09:23.210564 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f57f26a-22c4-4aee-b0f8-3055256fe9c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:09:23.210862 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f57f26a-22c4-4aee-b0f8-3055256fe9c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:09:23.211745 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f57f26a-22c4-4aee-b0f8-3055256fe9c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:09:23.212049 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f57f26a-22c4-4aee-b0f8-3055256fe9c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:09:23.213708 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f57f26a-22c4-4aee-b0f8-3055256fe9c2 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:09:23.225702 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1380/2765] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Oct 4 12:09:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:09:23.230097 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8dfb79-c163-4fca-92c4-9797598da4bb None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:09:23.240154 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8dfb79-c163-4fca-92c4-9797598da4bb None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:09:23.244858 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31140b98-afe1-4ecb-8611-7d776678d45f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:09:23.245445 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31140b98-afe1-4ecb-8611-7d776678d45f admin admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:09:23.245719 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31140b98-afe1-4ecb-8611-7d776678d45f admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:09:23.245987 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31140b98-afe1-4ecb-8611-7d776678d45f admin admin] PATH_INFO: `/v3/projects` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:09:23.246721 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31140b98-afe1-4ecb-8611-7d776678d45f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:09:23.248704 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31140b98-afe1-4ecb-8611-7d776678d45f admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:09:23.388166 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1386/2766] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Oct 4 12:09:23 2022] POST /identity/v3/projects => generated 373 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:09:23.389506 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f57f26a-22c4-4aee-b0f8-3055256fe9c2 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:09:23.401174 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f57f26a-22c4-4aee-b0f8-3055256fe9c2 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:09:23.404998 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:09:23.457475 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49439217-8bff-45c3-90d5-798a961d9fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:09:23.458080 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49439217-8bff-45c3-90d5-798a961d9fbe admin admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:09:23.458365 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49439217-8bff-45c3-90d5-798a961d9fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:09:23.458661 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49439217-8bff-45c3-90d5-798a961d9fbe admin admin] PATH_INFO: `/v3/users` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:09:23.459306 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49439217-8bff-45c3-90d5-798a961d9fbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:09:23.461345 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49439217-8bff-45c3-90d5-798a961d9fbe admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:09:23.518695 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31140b98-afe1-4ecb-8611-7d776678d45f admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:09:23.525918 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-31140b98-afe1-4ecb-8611-7d776678d45f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:09:23.539781 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31140b98-afe1-4ecb-8611-7d776678d45f admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:09:23.544423 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ef232b-4aca-480f-a871-c1f15c3873fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:09:23.545079 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ef232b-4aca-480f-a871-c1f15c3873fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:09:23.545362 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ef232b-4aca-480f-a871-c1f15c3873fc admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:09:23.545630 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ef232b-4aca-480f-a871-c1f15c3873fc admin admin] PATH_INFO: `/v3/users/144325fbfe2945a6acb711efe7625c70` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:09:23.546755 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ef232b-4aca-480f-a871-c1f15c3873fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=144325fbfe2945a6acb711efe7625c70)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:09:23.548697 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ef232b-4aca-480f-a871-c1f15c3873fc admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:09:23.646179 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1381/2767] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Oct 4 12:09:23 2022] POST /identity/v3/users => generated 287 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:09:23.650333 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49439217-8bff-45c3-90d5-798a961d9fbe admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:09:23.660624 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49439217-8bff-45c3-90d5-798a961d9fbe admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:09:23.665420 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1a0736-3024-4d77-ad48-bb78e7d285dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:09:23.666036 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1a0736-3024-4d77-ad48-bb78e7d285dd admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:09:23.666326 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1a0736-3024-4d77-ad48-bb78e7d285dd admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:09:23.666594 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1a0736-3024-4d77-ad48-bb78e7d285dd admin admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:09:23.667307 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1a0736-3024-4d77-ad48-bb78e7d285dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:09:23.668936 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1a0736-3024-4d77-ad48-bb78e7d285dd admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:09:23.680879 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1382/2768] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:09:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 12:09:23.684832 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1a0736-3024-4d77-ad48-bb78e7d285dd admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:09:23.698343 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1a0736-3024-4d77-ad48-bb78e7d285dd admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:09:23.706988 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caa642a-df65-43c3-b256-3b4bf1911825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:09:23.706988 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caa642a-df65-43c3-b256-3b4bf1911825 admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:09:23.706988 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caa642a-df65-43c3-b256-3b4bf1911825 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:09:23.706988 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caa642a-df65-43c3-b256-3b4bf1911825 admin admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:09:23.707385 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caa642a-df65-43c3-b256-3b4bf1911825 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:09:23.707385 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caa642a-df65-43c3-b256-3b4bf1911825 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:09:23.716349 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1383/2769] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:09:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 12:09:23.720433 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caa642a-df65-43c3-b256-3b4bf1911825 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:09:23.729820 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caa642a-df65-43c3-b256-3b4bf1911825 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:09:23.734363 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71c78ed-6cd8-4c16-b00a-cc2e098a0925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:09:23.735011 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71c78ed-6cd8-4c16-b00a-cc2e098a0925 admin admin] REQUEST_METHOD: `PUT` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:09:23.735290 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71c78ed-6cd8-4c16-b00a-cc2e098a0925 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:09:23.735563 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71c78ed-6cd8-4c16-b00a-cc2e098a0925 admin admin] PATH_INFO: `/v3/projects/168dab8672934a5dbff15ca8b7a216d0/users/d85023cabe1d44fda685c7a3d35b58dc/roles/ab4307f3b7994c1c80036fa7db93b6b9` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:09:23.750351 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71c78ed-6cd8-4c16-b00a-cc2e098a0925 admin admin] RBAC: Authorizing `identity:create_grant(project_id=168dab8672934a5dbff15ca8b7a216d0, user_id=d85023cabe1d44fda685c7a3d35b58dc, role_id=ab4307f3b7994c1c80036fa7db93b6b9)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:09:23.758543 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71c78ed-6cd8-4c16-b00a-cc2e098a0925 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:09:23.880908 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1384/2770] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Oct 4 12:09:23 2022] PUT /identity/v3/projects/168dab8672934a5dbff15ca8b7a216d0/users/d85023cabe1d44fda685c7a3d35b58dc/roles/ab4307f3b7994c1c80036fa7db93b6b9 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:09:23.886064 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684bdfc7-0e20-4028-9e2e-343a31a2db10 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:09:23.886363 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684bdfc7-0e20-4028-9e2e-343a31a2db10 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:09:23.886688 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684bdfc7-0e20-4028-9e2e-343a31a2db10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:09:23.889739 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-78ef232b-4aca-480f-a871-c1f15c3873fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '144325fbfe2945a6acb711efe7625c70'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:09:23.897080 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-78ef232b-4aca-480f-a871-c1f15c3873fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '144325fbfe2945a6acb711efe7625c70'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:09:23.897867 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-78ef232b-4aca-480f-a871-c1f15c3873fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '144325fbfe2945a6acb711efe7625c70'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:09:23.898586 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-78ef232b-4aca-480f-a871-c1f15c3873fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '144325fbfe2945a6acb711efe7625c70'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:09:23.906395 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-684bdfc7-0e20-4028-9e2e-343a31a2db10 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:09:23.907743 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-684bdfc7-0e20-4028-9e2e-343a31a2db10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:09:23.983737 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1385/2771] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:09:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 12:09:23.993926 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684bdfc7-0e20-4028-9e2e-343a31a2db10 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:09:23.995269 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-684bdfc7-0e20-4028-9e2e-343a31a2db10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:09:24.002676 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-78ef232b-4aca-480f-a871-c1f15c3873fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '144325fbfe2945a6acb711efe7625c70'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:09:24.020968 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1387/2772] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Oct 4 12:09:23 2022] DELETE /identity/v3/users/144325fbfe2945a6acb711efe7625c70 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:09:24.025348 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff8a090-d69f-4f15-9639-a273af9cc8ba None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:09:24.025707 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff8a090-d69f-4f15-9639-a273af9cc8ba None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:09:24.026026 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff8a090-d69f-4f15-9639-a273af9cc8ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:09:24.046371 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-aff8a090-d69f-4f15-9639-a273af9cc8ba None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:09:24.047581 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-aff8a090-d69f-4f15-9639-a273af9cc8ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:09:24.056459 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684bdfc7-0e20-4028-9e2e-343a31a2db10 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:09:24.097016 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:DELETE=17,keystone:SELECT=80,keystone:INSERT=3 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:09:24.104067 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d87a78b-61cd-4aae-91fc-30fc2be4357f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7289515c5c44914a19daa439de98cb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:09:24.104706 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d87a78b-61cd-4aae-91fc-30fc2be4357f service neutron] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:09:24.105012 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d87a78b-61cd-4aae-91fc-30fc2be4357f service neutron] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:09:24.105256 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d87a78b-61cd-4aae-91fc-30fc2be4357f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:09:24.109369 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1388/2773] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:09:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 12:09:24.115965 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:09:24.120267 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d87a78b-61cd-4aae-91fc-30fc2be4357f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:09:24.120267 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d87a78b-61cd-4aae-91fc-30fc2be4357f service neutron] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:09:24.120489 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff8a090-d69f-4f15-9639-a273af9cc8ba None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:09:24.128504 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1386/2774] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:09:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 12:09:24.130679 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff8a090-d69f-4f15-9639-a273af9cc8ba None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:09:24.134503 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83778e3-ed48-4f40-b71d-fe41ec1bf94c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7289515c5c44914a19daa439de98cb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:09:24.135111 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83778e3-ed48-4f40-b71d-fe41ec1bf94c service neutron] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:09:24.135413 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83778e3-ed48-4f40-b71d-fe41ec1bf94c service neutron] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:09:24.135686 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83778e3-ed48-4f40-b71d-fe41ec1bf94c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:09:24.145619 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83778e3-ed48-4f40-b71d-fe41ec1bf94c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:09:24.147085 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83778e3-ed48-4f40-b71d-fe41ec1bf94c service neutron] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:09:24.160491 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1389/2775] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:09:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 12:09:24.730278 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d87a78b-61cd-4aae-91fc-30fc2be4357f service neutron] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:09:24.732131 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-3d87a78b-61cd-4aae-91fc-30fc2be4357f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:09:24.753362 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d87a78b-61cd-4aae-91fc-30fc2be4357f service neutron] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:09:24.768232 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edf74c3-49fa-4821-902a-66cbb3224489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:09:24.769522 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edf74c3-49fa-4821-902a-66cbb3224489 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:09:24.769806 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edf74c3-49fa-4821-902a-66cbb3224489 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:09:24.770084 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edf74c3-49fa-4821-902a-66cbb3224489 admin admin] PATH_INFO: `/v3/projects/50f802fa17304a1abee47f21fd1e19d5` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:09:24.771242 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edf74c3-49fa-4821-902a-66cbb3224489 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50f802fa17304a1abee47f21fd1e19d5)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:09:24.773540 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edf74c3-49fa-4821-902a-66cbb3224489 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:09:24.941502 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-8edf74c3-49fa-4821-902a-66cbb3224489 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50f802fa17304a1abee47f21fd1e19d5', 'request_id': 'req-8edf74c3-49fa-4821-902a-66cbb3224489'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:09:24.948188 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-8edf74c3-49fa-4821-902a-66cbb3224489 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50f802fa17304a1abee47f21fd1e19d5', 'request_id': 'req-8edf74c3-49fa-4821-902a-66cbb3224489'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:09:25.051973 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-8edf74c3-49fa-4821-902a-66cbb3224489 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50f802fa17304a1abee47f21fd1e19d5', 'request_id': 'req-8edf74c3-49fa-4821-902a-66cbb3224489'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:09:25.070252 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-8edf74c3-49fa-4821-902a-66cbb3224489 admin admin] The token cache is being invalidate because project 50f802fa17304a1abee47f21fd1e19d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:09:25.070252 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-8edf74c3-49fa-4821-902a-66cbb3224489 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:09:25.070252 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-8edf74c3-49fa-4821-902a-66cbb3224489 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:09:25.070252 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1387/2776] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Oct 4 12:09:24 2022] DELETE /identity/v3/projects/50f802fa17304a1abee47f21fd1e19d5 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:09:25.899337 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8575551-781d-4381-873d-0d962c77c303 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:09:25.899838 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8575551-781d-4381-873d-0d962c77c303 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:09:25.899948 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8575551-781d-4381-873d-0d962c77c303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:09:25.933467 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-a8575551-781d-4381-873d-0d962c77c303 None None] MFA Rules not processed for user `d85023cabe1d44fda685c7a3d35b58dc`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:09:25.934845 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-a8575551-781d-4381-873d-0d962c77c303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:09:26.009618 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1390/2777] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:09:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:09:26.014202 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edf74c3-49fa-4821-902a-66cbb3224489 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:09:26.015702 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-8edf74c3-49fa-4821-902a-66cbb3224489 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:09:26.084753 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edf74c3-49fa-4821-902a-66cbb3224489 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:09:26.089309 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9401e67-1460-411e-bc83-3c7093e5d6b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:09:26.089949 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9401e67-1460-411e-bc83-3c7093e5d6b2 admin admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:09:26.090230 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9401e67-1460-411e-bc83-3c7093e5d6b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:09:26.090505 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9401e67-1460-411e-bc83-3c7093e5d6b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:09:26.091176 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9401e67-1460-411e-bc83-3c7093e5d6b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:09:26.093192 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9401e67-1460-411e-bc83-3c7093e5d6b2 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:09:26.431364 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8575551-781d-4381-873d-0d962c77c303 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:09:26.444111 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1388/2778] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Oct 4 12:09:26 2022] POST /identity/v3/projects => generated 373 bytes in 429 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 12:09:26.453968 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8575551-781d-4381-873d-0d962c77c303 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:09:26.553537 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5cd240-744c-480c-87ba-cc562d234342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:09:26.554153 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5cd240-744c-480c-87ba-cc562d234342 admin admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:09:26.554432 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5cd240-744c-480c-87ba-cc562d234342 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:09:26.554862 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5cd240-744c-480c-87ba-cc562d234342 admin admin] PATH_INFO: `/v3/users` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:09:26.555536 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5cd240-744c-480c-87ba-cc562d234342 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:09:26.557854 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5cd240-744c-480c-87ba-cc562d234342 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:09:26.752218 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1391/2779] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Oct 4 12:09:26 2022] POST /identity/v3/users => generated 293 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:09:26.756558 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9401e67-1460-411e-bc83-3c7093e5d6b2 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:09:26.769786 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9401e67-1460-411e-bc83-3c7093e5d6b2 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:09:26.775534 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa48b72-cd9b-417a-9d91-ff28275d089f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:09:26.776156 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa48b72-cd9b-417a-9d91-ff28275d089f admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:09:26.776486 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa48b72-cd9b-417a-9d91-ff28275d089f admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:09:26.776790 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa48b72-cd9b-417a-9d91-ff28275d089f admin admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:09:26.777433 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa48b72-cd9b-417a-9d91-ff28275d089f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:09:26.779020 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa48b72-cd9b-417a-9d91-ff28275d089f admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:09:26.790781 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1389/2780] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:09:26 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:09:26.795569 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5cd240-744c-480c-87ba-cc562d234342 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:09:26.806110 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5cd240-744c-480c-87ba-cc562d234342 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:09:26.810733 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6497f1d-f009-49f6-a8cb-1c302f6cf530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:09:26.811420 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6497f1d-f009-49f6-a8cb-1c302f6cf530 admin admin] REQUEST_METHOD: `PUT` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:09:26.812815 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6497f1d-f009-49f6-a8cb-1c302f6cf530 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:09:26.813193 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6497f1d-f009-49f6-a8cb-1c302f6cf530 admin admin] PATH_INFO: `/v3/projects/6838a98afb234b408010455edfa1049d/users/652d45cce6304d1fae59c5fcba6e2bff/roles/d6e7421d1ff9451c808004b818354550` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:09:26.829194 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6497f1d-f009-49f6-a8cb-1c302f6cf530 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6838a98afb234b408010455edfa1049d, user_id=652d45cce6304d1fae59c5fcba6e2bff, role_id=d6e7421d1ff9451c808004b818354550)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:09:26.833185 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6497f1d-f009-49f6-a8cb-1c302f6cf530 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:09:26.974598 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1392/2781] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Oct 4 12:09:26 2022] PUT /identity/v3/projects/6838a98afb234b408010455edfa1049d/users/652d45cce6304d1fae59c5fcba6e2bff/roles/d6e7421d1ff9451c808004b818354550 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:09:26.978669 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa48b72-cd9b-417a-9d91-ff28275d089f admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:09:26.989191 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa48b72-cd9b-417a-9d91-ff28275d089f admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:09:26.992991 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:09:27.050525 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a57250d-292d-4064-9cc6-7d7a28ee2f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:09:27.051277 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a57250d-292d-4064-9cc6-7d7a28ee2f81 admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:09:27.051568 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a57250d-292d-4064-9cc6-7d7a28ee2f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:09:27.051871 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a57250d-292d-4064-9cc6-7d7a28ee2f81 admin admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:09:27.052526 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a57250d-292d-4064-9cc6-7d7a28ee2f81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:09:27.054155 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a57250d-292d-4064-9cc6-7d7a28ee2f81 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:09:27.066113 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1390/2782] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:09:26 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:09:27.070247 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6497f1d-f009-49f6-a8cb-1c302f6cf530 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:09:27.081958 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6497f1d-f009-49f6-a8cb-1c302f6cf530 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:09:27.098915 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0216a0a1-436e-425f-aede-f895d8e21cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:09:27.102161 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0216a0a1-436e-425f-aede-f895d8e21cc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:09:27.102496 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0216a0a1-436e-425f-aede-f895d8e21cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:09:27.102794 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0216a0a1-436e-425f-aede-f895d8e21cc5 admin admin] PATH_INFO: `/v3/projects/6838a98afb234b408010455edfa1049d/users/652d45cce6304d1fae59c5fcba6e2bff/roles/d6e7421d1ff9451c808004b818354550` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:09:27.109432 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0216a0a1-436e-425f-aede-f895d8e21cc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6838a98afb234b408010455edfa1049d, user_id=652d45cce6304d1fae59c5fcba6e2bff, role_id=d6e7421d1ff9451c808004b818354550)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:09:27.112964 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0216a0a1-436e-425f-aede-f895d8e21cc5 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:09:27.124498 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1393/2783] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Oct 4 12:09:27 2022] PUT /identity/v3/projects/6838a98afb234b408010455edfa1049d/users/652d45cce6304d1fae59c5fcba6e2bff/roles/d6e7421d1ff9451c808004b818354550 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:09:28.793670 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1f5603-ba0b-4cf8-965b-9e8b8a92e858 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:09:28.794169 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1f5603-ba0b-4cf8-965b-9e8b8a92e858 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:09:28.794279 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1f5603-ba0b-4cf8-965b-9e8b8a92e858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:09:28.824744 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-fc1f5603-ba0b-4cf8-965b-9e8b8a92e858 None None] MFA Rules not processed for user `652d45cce6304d1fae59c5fcba6e2bff`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:09:28.825977 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-fc1f5603-ba0b-4cf8-965b-9e8b8a92e858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:09:28.917792 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1391/2784] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:09:28 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:09:28.929056 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48bd41f-a8fe-4127-a908-c47d57d15cc6 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:09:28.929625 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48bd41f-a8fe-4127-a908-c47d57d15cc6 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:09:28.929625 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48bd41f-a8fe-4127-a908-c47d57d15cc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:09:28.951401 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-e48bd41f-a8fe-4127-a908-c47d57d15cc6 None None] MFA Rules not processed for user `d85023cabe1d44fda685c7a3d35b58dc`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:09:28.952643 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-e48bd41f-a8fe-4127-a908-c47d57d15cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:09:28.970794 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:09:29.011267 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1394/2785] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:09:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:09:29.022116 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1f5603-ba0b-4cf8-965b-9e8b8a92e858 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:09:29.023509 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-fc1f5603-ba0b-4cf8-965b-9e8b8a92e858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:09:29.117286 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=100 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:09:29.126437 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1f5603-ba0b-4cf8-965b-9e8b8a92e858 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:09:29.133142 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70380ca-05f5-434b-b965-6b348a14f026 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8e23d1d2fe24bdf9552e7c2f0ae3424', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:09:29.133761 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70380ca-05f5-434b-b965-6b348a14f026 service nova] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:09:29.134043 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70380ca-05f5-434b-b965-6b348a14f026 service nova] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:09:29.134348 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70380ca-05f5-434b-b965-6b348a14f026 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:09:29.143159 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70380ca-05f5-434b-b965-6b348a14f026 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:09:29.144943 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70380ca-05f5-434b-b965-6b348a14f026 service nova] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:09:29.154709 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1392/2786] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:09:29 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:09:31.875247 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48bd41f-a8fe-4127-a908-c47d57d15cc6 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:09:31.876723 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-e48bd41f-a8fe-4127-a908-c47d57d15cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:09:31.978350 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48bd41f-a8fe-4127-a908-c47d57d15cc6 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:09:31.982689 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d47994-eda2-4165-b2a7-f25da5ebd911 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be119968b02440adbbbc85c553077b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:09:31.983520 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d47994-eda2-4165-b2a7-f25da5ebd911 service placement] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:09:31.983907 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d47994-eda2-4165-b2a7-f25da5ebd911 service placement] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:09:31.984193 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d47994-eda2-4165-b2a7-f25da5ebd911 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:09:31.986109 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-08d47994-eda2-4165-b2a7-f25da5ebd911 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:09:32.003745 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d47994-eda2-4165-b2a7-f25da5ebd911 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:09:32.005472 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d47994-eda2-4165-b2a7-f25da5ebd911 service placement] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:09:32.028919 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1395/2787] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:09:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:09:32.565543 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15e0fc7-6afc-4494-b1e5-5bd7e7c129b6 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:09:32.566027 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15e0fc7-6afc-4494-b1e5-5bd7e7c129b6 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:09:32.566127 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15e0fc7-6afc-4494-b1e5-5bd7e7c129b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:09:32.585343 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-f15e0fc7-6afc-4494-b1e5-5bd7e7c129b6 None None] MFA Rules not processed for user `1b7f5ed542594c0eabffe87b89344716`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:09:32.586553 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-f15e0fc7-6afc-4494-b1e5-5bd7e7c129b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:09:32.645218 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1393/2788] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:09:32 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:09:42.013765 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=56 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:09:42.637959 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=31 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:09:47.072662 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d47994-eda2-4165-b2a7-f25da5ebd911 service placement] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:09:47.074090 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-08d47994-eda2-4165-b2a7-f25da5ebd911 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:09:47.156674 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d47994-eda2-4165-b2a7-f25da5ebd911 service placement] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:09:47.161479 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2491a571-cba2-4930-a986-350fcf0f9122 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e2a05b782424ab2928b5864f1bfd556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:09:47.162081 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2491a571-cba2-4930-a986-350fcf0f9122 service cinder] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:09:47.162356 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2491a571-cba2-4930-a986-350fcf0f9122 service cinder] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:09:47.163470 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2491a571-cba2-4930-a986-350fcf0f9122 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:09:47.176562 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2491a571-cba2-4930-a986-350fcf0f9122 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:09:47.178027 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2491a571-cba2-4930-a986-350fcf0f9122 service cinder] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:09:47.188052 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1396/2789] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:09:47 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:09:57.183717 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=35 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:10:12.598880 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15e0fc7-6afc-4494-b1e5-5bd7e7c129b6 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:10:12.629120 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15e0fc7-6afc-4494-b1e5-5bd7e7c129b6 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:10:12.639532 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe99f7f-6f75-4fe1-9a4c-3a816fa4cef3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be119968b02440adbbbc85c553077b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:10:12.640154 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe99f7f-6f75-4fe1-9a4c-3a816fa4cef3 service placement] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:10:12.640433 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe99f7f-6f75-4fe1-9a4c-3a816fa4cef3 service placement] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:10:12.640743 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe99f7f-6f75-4fe1-9a4c-3a816fa4cef3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:10:12.642633 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-fbe99f7f-6f75-4fe1-9a4c-3a816fa4cef3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:10:12.655459 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe99f7f-6f75-4fe1-9a4c-3a816fa4cef3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:10:12.657735 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe99f7f-6f75-4fe1-9a4c-3a816fa4cef3 service placement] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:10:12.668533 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1394/2790] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:10:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:10:13.532923 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2491a571-cba2-4930-a986-350fcf0f9122 service cinder] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:10:13.607304 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2491a571-cba2-4930-a986-350fcf0f9122 service cinder] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:10:13.613940 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510e3d5b-4a8f-4e06-80e8-f24b76ff491e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:10:13.614585 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510e3d5b-4a8f-4e06-80e8-f24b76ff491e admin admin] REQUEST_METHOD: `DELETE` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:10:13.614911 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510e3d5b-4a8f-4e06-80e8-f24b76ff491e admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:10:13.615228 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510e3d5b-4a8f-4e06-80e8-f24b76ff491e admin admin] PATH_INFO: `/v3/users/d85023cabe1d44fda685c7a3d35b58dc` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:10:13.616619 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510e3d5b-4a8f-4e06-80e8-f24b76ff491e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d85023cabe1d44fda685c7a3d35b58dc)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:10:13.618744 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510e3d5b-4a8f-4e06-80e8-f24b76ff491e admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:10:13.851814 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-510e3d5b-4a8f-4e06-80e8-f24b76ff491e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd85023cabe1d44fda685c7a3d35b58dc'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:10:13.859779 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-510e3d5b-4a8f-4e06-80e8-f24b76ff491e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd85023cabe1d44fda685c7a3d35b58dc'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:10:13.860445 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-510e3d5b-4a8f-4e06-80e8-f24b76ff491e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd85023cabe1d44fda685c7a3d35b58dc'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:10:13.861080 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-510e3d5b-4a8f-4e06-80e8-f24b76ff491e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd85023cabe1d44fda685c7a3d35b58dc'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:10:13.939156 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-510e3d5b-4a8f-4e06-80e8-f24b76ff491e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd85023cabe1d44fda685c7a3d35b58dc'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:10:13.957620 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1397/2791] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Oct 4 12:10:13 2022] DELETE /identity/v3/users/d85023cabe1d44fda685c7a3d35b58dc => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:10:14.243965 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe99f7f-6f75-4fe1-9a4c-3a816fa4cef3 service placement] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:10:14.255644 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe99f7f-6f75-4fe1-9a4c-3a816fa4cef3 service placement] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:10:14.313807 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b24521-1ecd-444f-960c-c99ca9cae6e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:10:14.314550 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b24521-1ecd-444f-960c-c99ca9cae6e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:10:14.314833 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b24521-1ecd-444f-960c-c99ca9cae6e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:10:14.315111 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b24521-1ecd-444f-960c-c99ca9cae6e1 admin admin] PATH_INFO: `/v3/projects/168dab8672934a5dbff15ca8b7a216d0` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:10:14.316361 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b24521-1ecd-444f-960c-c99ca9cae6e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=168dab8672934a5dbff15ca8b7a216d0)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:10:14.318338 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b24521-1ecd-444f-960c-c99ca9cae6e1 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:10:14.435280 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-c3b24521-1ecd-444f-960c-c99ca9cae6e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '168dab8672934a5dbff15ca8b7a216d0', 'request_id': 'req-c3b24521-1ecd-444f-960c-c99ca9cae6e1'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:10:14.441603 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-c3b24521-1ecd-444f-960c-c99ca9cae6e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '168dab8672934a5dbff15ca8b7a216d0', 'request_id': 'req-c3b24521-1ecd-444f-960c-c99ca9cae6e1'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:10:14.495397 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-c3b24521-1ecd-444f-960c-c99ca9cae6e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '168dab8672934a5dbff15ca8b7a216d0', 'request_id': 'req-c3b24521-1ecd-444f-960c-c99ca9cae6e1'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:10:14.506101 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-c3b24521-1ecd-444f-960c-c99ca9cae6e1 admin admin] The token cache is being invalidate because project 168dab8672934a5dbff15ca8b7a216d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:10:14.506392 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-c3b24521-1ecd-444f-960c-c99ca9cae6e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:10:14.507049 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-c3b24521-1ecd-444f-960c-c99ca9cae6e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:10:14.508540 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1395/2792] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Oct 4 12:10:14 2022] DELETE /identity/v3/projects/168dab8672934a5dbff15ca8b7a216d0 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:10:14.512652 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510e3d5b-4a8f-4e06-80e8-f24b76ff491e admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:10:14.514061 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-510e3d5b-4a8f-4e06-80e8-f24b76ff491e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:10:14.528332 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510e3d5b-4a8f-4e06-80e8-f24b76ff491e admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:10:14.587121 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbebc309-dc8b-4ba9-9e77-c10f8e263797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:10:14.587780 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbebc309-dc8b-4ba9-9e77-c10f8e263797 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:10:14.588000 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbebc309-dc8b-4ba9-9e77-c10f8e263797 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:10:14.588266 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbebc309-dc8b-4ba9-9e77-c10f8e263797 admin admin] PATH_INFO: `/v3/users/652d45cce6304d1fae59c5fcba6e2bff` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:10:14.589441 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbebc309-dc8b-4ba9-9e77-c10f8e263797 admin admin] RBAC: Authorizing `identity:delete_user(user_id=652d45cce6304d1fae59c5fcba6e2bff)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:10:14.591349 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbebc309-dc8b-4ba9-9e77-c10f8e263797 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:10:14.613901 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:10:14.829495 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-bbebc309-dc8b-4ba9-9e77-c10f8e263797 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '652d45cce6304d1fae59c5fcba6e2bff'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:10:14.836911 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-bbebc309-dc8b-4ba9-9e77-c10f8e263797 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '652d45cce6304d1fae59c5fcba6e2bff'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:10:14.837578 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-bbebc309-dc8b-4ba9-9e77-c10f8e263797 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '652d45cce6304d1fae59c5fcba6e2bff'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:10:14.838178 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-bbebc309-dc8b-4ba9-9e77-c10f8e263797 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '652d45cce6304d1fae59c5fcba6e2bff'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:10:14.932855 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-bbebc309-dc8b-4ba9-9e77-c10f8e263797 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '652d45cce6304d1fae59c5fcba6e2bff'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:10:14.952127 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1398/2793] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Oct 4 12:10:14 2022] DELETE /identity/v3/users/652d45cce6304d1fae59c5fcba6e2bff => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:10:15.260083 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b24521-1ecd-444f-960c-c99ca9cae6e1 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:10:15.261569 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-c3b24521-1ecd-444f-960c-c99ca9cae6e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:10:15.275227 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b24521-1ecd-444f-960c-c99ca9cae6e1 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:10:15.333233 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a291e775-d7d0-48cd-962c-8806cc6c224e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:10:15.333873 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a291e775-d7d0-48cd-962c-8806cc6c224e admin admin] REQUEST_METHOD: `DELETE` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:10:15.334198 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a291e775-d7d0-48cd-962c-8806cc6c224e admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:10:15.334477 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a291e775-d7d0-48cd-962c-8806cc6c224e admin admin] PATH_INFO: `/v3/projects/6838a98afb234b408010455edfa1049d` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:10:15.335597 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a291e775-d7d0-48cd-962c-8806cc6c224e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6838a98afb234b408010455edfa1049d)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:10:15.337535 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a291e775-d7d0-48cd-962c-8806cc6c224e admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:10:15.358052 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:10:15.628589 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-a291e775-d7d0-48cd-962c-8806cc6c224e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6838a98afb234b408010455edfa1049d', 'request_id': 'req-a291e775-d7d0-48cd-962c-8806cc6c224e'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:10:15.634958 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-a291e775-d7d0-48cd-962c-8806cc6c224e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6838a98afb234b408010455edfa1049d', 'request_id': 'req-a291e775-d7d0-48cd-962c-8806cc6c224e'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:10:15.721229 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-a291e775-d7d0-48cd-962c-8806cc6c224e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6838a98afb234b408010455edfa1049d', 'request_id': 'req-a291e775-d7d0-48cd-962c-8806cc6c224e'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:10:15.732165 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-a291e775-d7d0-48cd-962c-8806cc6c224e admin admin] The token cache is being invalidate because project 6838a98afb234b408010455edfa1049d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:10:15.732453 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-a291e775-d7d0-48cd-962c-8806cc6c224e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:10:15.733107 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-a291e775-d7d0-48cd-962c-8806cc6c224e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:10:15.735268 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1396/2794] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Oct 4 12:10:15 2022] DELETE /identity/v3/projects/6838a98afb234b408010455edfa1049d => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:10:15.740565 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c091d108-8ddb-459c-9e7c-f6a1fb06539b None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:10:15.741096 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c091d108-8ddb-459c-9e7c-f6a1fb06539b None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:10:15.741197 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c091d108-8ddb-459c-9e7c-f6a1fb06539b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:10:15.761431 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-c091d108-8ddb-459c-9e7c-f6a1fb06539b None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:10:15.762657 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-c091d108-8ddb-459c-9e7c-f6a1fb06539b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:10:15.823112 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1399/2795] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:10:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:10:15.832165 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b22449a-cd42-4f85-85b7-0bf3324f2503 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:10:15.832449 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b22449a-cd42-4f85-85b7-0bf3324f2503 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:10:15.832773 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b22449a-cd42-4f85-85b7-0bf3324f2503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:10:15.853047 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-2b22449a-cd42-4f85-85b7-0bf3324f2503 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:10:15.854243 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-2b22449a-cd42-4f85-85b7-0bf3324f2503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:10:15.863021 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1397/2796] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:10:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:10:15.867338 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c091d108-8ddb-459c-9e7c-f6a1fb06539b None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:10:15.877021 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c091d108-8ddb-459c-9e7c-f6a1fb06539b None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:10:15.881804 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68a2e2e-fbbc-4406-bbcd-6162c95ef094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:10:15.882407 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68a2e2e-fbbc-4406-bbcd-6162c95ef094 admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:10:15.882689 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68a2e2e-fbbc-4406-bbcd-6162c95ef094 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:10:15.882966 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68a2e2e-fbbc-4406-bbcd-6162c95ef094 admin admin] PATH_INFO: `/v3/domains` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:10:15.883612 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68a2e2e-fbbc-4406-bbcd-6162c95ef094 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:10:15.883915 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68a2e2e-fbbc-4406-bbcd-6162c95ef094 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:10:15.885597 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68a2e2e-fbbc-4406-bbcd-6162c95ef094 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:10:15.897384 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1400/2797] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Oct 4 12:10:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 12:10:15.901655 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b22449a-cd42-4f85-85b7-0bf3324f2503 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:10:15.911420 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b22449a-cd42-4f85-85b7-0bf3324f2503 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:10:15.916137 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea42731-48fd-4d81-b6d9-3287d5eb75e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:10:15.916774 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea42731-48fd-4d81-b6d9-3287d5eb75e6 admin admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:10:15.917057 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea42731-48fd-4d81-b6d9-3287d5eb75e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:10:15.917333 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea42731-48fd-4d81-b6d9-3287d5eb75e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:10:15.917960 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea42731-48fd-4d81-b6d9-3287d5eb75e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:10:15.919883 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea42731-48fd-4d81-b6d9-3287d5eb75e6 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:10:16.045860 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1398/2798] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Oct 4 12:10:15 2022] POST /identity/v3/projects => generated 369 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:10:16.050973 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68a2e2e-fbbc-4406-bbcd-6162c95ef094 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:10:16.060967 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68a2e2e-fbbc-4406-bbcd-6162c95ef094 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:10:16.120295 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be7f201-65f9-4b12-bc93-fff1a56b1787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:10:16.120839 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be7f201-65f9-4b12-bc93-fff1a56b1787 admin admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:10:16.121118 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be7f201-65f9-4b12-bc93-fff1a56b1787 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:10:16.121386 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be7f201-65f9-4b12-bc93-fff1a56b1787 admin admin] PATH_INFO: `/v3/users` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:10:16.122013 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be7f201-65f9-4b12-bc93-fff1a56b1787 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:10:16.124114 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be7f201-65f9-4b12-bc93-fff1a56b1787 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:10:16.219290 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1401/2799] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Oct 4 12:10:16 2022] POST /identity/v3/users => generated 285 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 12:10:16.223401 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea42731-48fd-4d81-b6d9-3287d5eb75e6 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:10:16.235027 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea42731-48fd-4d81-b6d9-3287d5eb75e6 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:10:16.239839 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b6761c-c71b-4c79-8570-0fd0ea71e1b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:10:16.240428 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b6761c-c71b-4c79-8570-0fd0ea71e1b5 admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:10:16.240735 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b6761c-c71b-4c79-8570-0fd0ea71e1b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:10:16.241006 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b6761c-c71b-4c79-8570-0fd0ea71e1b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:10:16.241639 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b6761c-c71b-4c79-8570-0fd0ea71e1b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:10:16.243220 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b6761c-c71b-4c79-8570-0fd0ea71e1b5 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:10:16.253558 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1399/2800] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:10:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:10:16.257778 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be7f201-65f9-4b12-bc93-fff1a56b1787 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:10:16.268380 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be7f201-65f9-4b12-bc93-fff1a56b1787 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:10:16.273181 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4245ee4-bb56-4b32-bf38-f8fd6974aa31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:10:16.273805 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4245ee4-bb56-4b32-bf38-f8fd6974aa31 admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:10:16.274110 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4245ee4-bb56-4b32-bf38-f8fd6974aa31 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:10:16.274389 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4245ee4-bb56-4b32-bf38-f8fd6974aa31 admin admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:10:16.275022 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4245ee4-bb56-4b32-bf38-f8fd6974aa31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:10:16.276622 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4245ee4-bb56-4b32-bf38-f8fd6974aa31 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:10:16.287719 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1402/2801] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:10:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:10:16.291706 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b6761c-c71b-4c79-8570-0fd0ea71e1b5 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:10:16.302918 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b6761c-c71b-4c79-8570-0fd0ea71e1b5 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:10:16.307456 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042ab33c-9fc3-44ab-94a8-0b349355f1b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:10:16.308800 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042ab33c-9fc3-44ab-94a8-0b349355f1b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:10:16.309085 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042ab33c-9fc3-44ab-94a8-0b349355f1b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:10:16.309385 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042ab33c-9fc3-44ab-94a8-0b349355f1b9 admin admin] PATH_INFO: `/v3/projects/41dfaca59086421e876ea83adf0d379a/users/794372ac3b754ffea068d0850bdf91ef/roles/ab4307f3b7994c1c80036fa7db93b6b9` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:10:16.324067 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042ab33c-9fc3-44ab-94a8-0b349355f1b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41dfaca59086421e876ea83adf0d379a, user_id=794372ac3b754ffea068d0850bdf91ef, role_id=ab4307f3b7994c1c80036fa7db93b6b9)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:10:16.327091 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042ab33c-9fc3-44ab-94a8-0b349355f1b9 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:10:16.421193 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1400/2802] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Oct 4 12:10:16 2022] PUT /identity/v3/projects/41dfaca59086421e876ea83adf0d379a/users/794372ac3b754ffea068d0850bdf91ef/roles/ab4307f3b7994c1c80036fa7db93b6b9 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:10:16.431606 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf15b88-eda9-41c1-b1a7-e096845418af None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:10:16.431892 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf15b88-eda9-41c1-b1a7-e096845418af None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:10:16.432164 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf15b88-eda9-41c1-b1a7-e096845418af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:10:16.440858 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:10:16.460743 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-ddf15b88-eda9-41c1-b1a7-e096845418af None None] MFA Rules not processed for user `794372ac3b754ffea068d0850bdf91ef`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:10:16.461947 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-ddf15b88-eda9-41c1-b1a7-e096845418af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:10:16.525448 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1403/2803] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:10:16 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:10:16.537535 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042ab33c-9fc3-44ab-94a8-0b349355f1b9 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:10:16.539291 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-042ab33c-9fc3-44ab-94a8-0b349355f1b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:10:16.596731 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042ab33c-9fc3-44ab-94a8-0b349355f1b9 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:10:16.600511 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c167f0b9-eb33-4e67-8b31-f87f8dee48b2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd516d0755be84b7293156625df1b13b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:10:16.601153 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c167f0b9-eb33-4e67-8b31-f87f8dee48b2 service glance] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:10:16.601518 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c167f0b9-eb33-4e67-8b31-f87f8dee48b2 service glance] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:10:16.601875 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c167f0b9-eb33-4e67-8b31-f87f8dee48b2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:10:16.611099 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c167f0b9-eb33-4e67-8b31-f87f8dee48b2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:10:16.612819 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c167f0b9-eb33-4e67-8b31-f87f8dee48b2 service glance] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:10:16.622003 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1401/2804] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:10:16 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:10:26.622562 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=69,keystone:DELETE=7,keystone:INSERT=3 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:10:26.650299 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=30 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:10:40.947428 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf15b88-eda9-41c1-b1a7-e096845418af None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:10:41.016417 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf15b88-eda9-41c1-b1a7-e096845418af None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:10:41.021335 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8984e4b6-46af-487d-90cc-95d62057ea23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:10:41.021786 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8984e4b6-46af-487d-90cc-95d62057ea23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:10:41.022088 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8984e4b6-46af-487d-90cc-95d62057ea23 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:10:41.022324 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8984e4b6-46af-487d-90cc-95d62057ea23 admin admin] PATH_INFO: `/v3/users/794372ac3b754ffea068d0850bdf91ef` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:10:41.023451 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8984e4b6-46af-487d-90cc-95d62057ea23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=794372ac3b754ffea068d0850bdf91ef)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:10:41.025629 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8984e4b6-46af-487d-90cc-95d62057ea23 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:10:41.281464 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-8984e4b6-46af-487d-90cc-95d62057ea23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '794372ac3b754ffea068d0850bdf91ef'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:10:41.289005 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-8984e4b6-46af-487d-90cc-95d62057ea23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '794372ac3b754ffea068d0850bdf91ef'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:10:41.289754 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-8984e4b6-46af-487d-90cc-95d62057ea23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '794372ac3b754ffea068d0850bdf91ef'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:10:41.290374 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-8984e4b6-46af-487d-90cc-95d62057ea23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '794372ac3b754ffea068d0850bdf91ef'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:10:41.401560 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-8984e4b6-46af-487d-90cc-95d62057ea23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '794372ac3b754ffea068d0850bdf91ef'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:10:41.430780 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1404/2805] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Oct 4 12:10:40 2022] DELETE /identity/v3/users/794372ac3b754ffea068d0850bdf91ef => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:10:41.438494 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c862e972-e53b-4adb-9a20-7e49beed8717 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:10:41.438494 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c862e972-e53b-4adb-9a20-7e49beed8717 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:10:41.438494 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c862e972-e53b-4adb-9a20-7e49beed8717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:10:41.457101 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-c862e972-e53b-4adb-9a20-7e49beed8717 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:10:41.458354 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-c862e972-e53b-4adb-9a20-7e49beed8717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:10:41.532666 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1402/2806] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:10:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:10:41.542790 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8984e4b6-46af-487d-90cc-95d62057ea23 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:10:41.544528 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-8984e4b6-46af-487d-90cc-95d62057ea23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:10:41.666962 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8984e4b6-46af-487d-90cc-95d62057ea23 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:10:41.668445 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b00bb8-fa17-4268-8b9e-f301287ca51f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7289515c5c44914a19daa439de98cb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:10:41.668985 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b00bb8-fa17-4268-8b9e-f301287ca51f service neutron] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:10:41.669323 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b00bb8-fa17-4268-8b9e-f301287ca51f service neutron] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:10:41.669654 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b00bb8-fa17-4268-8b9e-f301287ca51f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:10:41.681682 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b00bb8-fa17-4268-8b9e-f301287ca51f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:10:41.683126 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b00bb8-fa17-4268-8b9e-f301287ca51f service neutron] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:10:41.695993 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1405/2807] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:10:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:10:42.245634 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c862e972-e53b-4adb-9a20-7e49beed8717 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:10:42.247076 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-c862e972-e53b-4adb-9a20-7e49beed8717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:10:42.261212 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c862e972-e53b-4adb-9a20-7e49beed8717 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:10:42.266084 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c9b0c7-ee62-47d8-95a0-084bdbe6a7e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:10:42.266754 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c9b0c7-ee62-47d8-95a0-084bdbe6a7e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:10:42.267050 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c9b0c7-ee62-47d8-95a0-084bdbe6a7e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:10:42.267325 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c9b0c7-ee62-47d8-95a0-084bdbe6a7e5 admin admin] PATH_INFO: `/v3/projects/41dfaca59086421e876ea83adf0d379a` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:10:42.268464 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c9b0c7-ee62-47d8-95a0-084bdbe6a7e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41dfaca59086421e876ea83adf0d379a)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:10:42.270482 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c9b0c7-ee62-47d8-95a0-084bdbe6a7e5 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:10:42.441250 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-55c9b0c7-ee62-47d8-95a0-084bdbe6a7e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41dfaca59086421e876ea83adf0d379a', 'request_id': 'req-55c9b0c7-ee62-47d8-95a0-084bdbe6a7e5'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:10:42.447468 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-55c9b0c7-ee62-47d8-95a0-084bdbe6a7e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41dfaca59086421e876ea83adf0d379a', 'request_id': 'req-55c9b0c7-ee62-47d8-95a0-084bdbe6a7e5'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:10:42.512104 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-55c9b0c7-ee62-47d8-95a0-084bdbe6a7e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41dfaca59086421e876ea83adf0d379a', 'request_id': 'req-55c9b0c7-ee62-47d8-95a0-084bdbe6a7e5'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:10:42.524862 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-55c9b0c7-ee62-47d8-95a0-084bdbe6a7e5 admin admin] The token cache is being invalidate because project 41dfaca59086421e876ea83adf0d379a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:10:42.525161 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-55c9b0c7-ee62-47d8-95a0-084bdbe6a7e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:10:42.525786 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-55c9b0c7-ee62-47d8-95a0-084bdbe6a7e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:10:42.527262 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1403/2808] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Oct 4 12:10:42 2022] DELETE /identity/v3/projects/41dfaca59086421e876ea83adf0d379a => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:10:51.690000 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:10:52.431387 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b00bb8-fa17-4268-8b9e-f301287ca51f service neutron] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:10:52.432918 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-a0b00bb8-fa17-4268-8b9e-f301287ca51f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:10:52.451142 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b00bb8-fa17-4268-8b9e-f301287ca51f service neutron] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:10:52.510102 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704671b5-fb4b-48f2-bdd9-5ad0649f77db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:10:52.510951 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704671b5-fb4b-48f2-bdd9-5ad0649f77db admin admin] REQUEST_METHOD: `DELETE` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:10:52.511493 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704671b5-fb4b-48f2-bdd9-5ad0649f77db admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:10:52.511881 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704671b5-fb4b-48f2-bdd9-5ad0649f77db admin admin] PATH_INFO: `/v3/users/1b7f5ed542594c0eabffe87b89344716` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:10:52.513216 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704671b5-fb4b-48f2-bdd9-5ad0649f77db admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b7f5ed542594c0eabffe87b89344716)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:10:52.515523 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704671b5-fb4b-48f2-bdd9-5ad0649f77db admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:10:52.521468 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:10:52.731965 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-704671b5-fb4b-48f2-bdd9-5ad0649f77db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b7f5ed542594c0eabffe87b89344716'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:10:52.739429 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-704671b5-fb4b-48f2-bdd9-5ad0649f77db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b7f5ed542594c0eabffe87b89344716'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:10:52.741866 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-704671b5-fb4b-48f2-bdd9-5ad0649f77db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b7f5ed542594c0eabffe87b89344716'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:10:52.741866 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-704671b5-fb4b-48f2-bdd9-5ad0649f77db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b7f5ed542594c0eabffe87b89344716'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:10:52.854612 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-704671b5-fb4b-48f2-bdd9-5ad0649f77db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b7f5ed542594c0eabffe87b89344716'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:10:52.873754 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1406/2809] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Oct 4 12:10:52 2022] DELETE /identity/v3/users/1b7f5ed542594c0eabffe87b89344716 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:10:53.471339 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c9b0c7-ee62-47d8-95a0-084bdbe6a7e5 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:10:53.472890 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-55c9b0c7-ee62-47d8-95a0-084bdbe6a7e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:10:53.488695 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c9b0c7-ee62-47d8-95a0-084bdbe6a7e5 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:10:53.546600 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a532b51-5bfe-4448-954b-826b8244a114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:10:53.547273 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a532b51-5bfe-4448-954b-826b8244a114 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:10:53.547549 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a532b51-5bfe-4448-954b-826b8244a114 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:10:53.547817 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a532b51-5bfe-4448-954b-826b8244a114 admin admin] PATH_INFO: `/v3/projects/43ddaa7c45fd49f1a58449c859aa7d43` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:10:53.548980 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a532b51-5bfe-4448-954b-826b8244a114 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43ddaa7c45fd49f1a58449c859aa7d43)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:10:53.550865 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a532b51-5bfe-4448-954b-826b8244a114 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:10:53.710520 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-3a532b51-5bfe-4448-954b-826b8244a114 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43ddaa7c45fd49f1a58449c859aa7d43', 'request_id': 'req-3a532b51-5bfe-4448-954b-826b8244a114'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:10:53.717424 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-3a532b51-5bfe-4448-954b-826b8244a114 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43ddaa7c45fd49f1a58449c859aa7d43', 'request_id': 'req-3a532b51-5bfe-4448-954b-826b8244a114'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:10:53.874954 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-3a532b51-5bfe-4448-954b-826b8244a114 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43ddaa7c45fd49f1a58449c859aa7d43', 'request_id': 'req-3a532b51-5bfe-4448-954b-826b8244a114'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:10:53.885719 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-3a532b51-5bfe-4448-954b-826b8244a114 admin admin] The token cache is being invalidate because project 43ddaa7c45fd49f1a58449c859aa7d43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:10:53.886015 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-3a532b51-5bfe-4448-954b-826b8244a114 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:10:53.886637 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-3a532b51-5bfe-4448-954b-826b8244a114 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:10:53.888136 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1404/2810] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Oct 4 12:10:53 2022] DELETE /identity/v3/projects/43ddaa7c45fd49f1a58449c859aa7d43 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:10:53.893732 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36455d8-b603-4a9f-8f2c-f2f36e5f7d56 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:10:53.894248 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36455d8-b603-4a9f-8f2c-f2f36e5f7d56 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:10:53.894367 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36455d8-b603-4a9f-8f2c-f2f36e5f7d56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:10:53.913702 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-d36455d8-b603-4a9f-8f2c-f2f36e5f7d56 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:10:53.914898 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-d36455d8-b603-4a9f-8f2c-f2f36e5f7d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:10:53.973800 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1407/2811] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:10:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:10:53.983421 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf40361-6498-4e70-8ef1-169de1ecba92 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:10:53.983556 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf40361-6498-4e70-8ef1-169de1ecba92 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:10:53.983830 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf40361-6498-4e70-8ef1-169de1ecba92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:10:54.003828 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-4cf40361-6498-4e70-8ef1-169de1ecba92 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:10:54.005073 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-4cf40361-6498-4e70-8ef1-169de1ecba92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:10:54.012836 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1405/2812] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:10:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:10:54.017112 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36455d8-b603-4a9f-8f2c-f2f36e5f7d56 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:10:54.026518 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36455d8-b603-4a9f-8f2c-f2f36e5f7d56 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:10:54.031127 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f256ee6e-e239-474b-93bd-eb218c042308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:10:54.031762 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f256ee6e-e239-474b-93bd-eb218c042308 admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:10:54.032037 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f256ee6e-e239-474b-93bd-eb218c042308 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:10:54.032305 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f256ee6e-e239-474b-93bd-eb218c042308 admin admin] PATH_INFO: `/v3/domains` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:10:54.033035 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f256ee6e-e239-474b-93bd-eb218c042308 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:10:54.033336 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f256ee6e-e239-474b-93bd-eb218c042308 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:10:54.034948 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f256ee6e-e239-474b-93bd-eb218c042308 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:10:54.046956 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1408/2813] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Oct 4 12:10:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:10:54.051223 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf40361-6498-4e70-8ef1-169de1ecba92 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:10:54.060848 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf40361-6498-4e70-8ef1-169de1ecba92 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:10:54.065548 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa1f564-dfa5-4674-830d-3f178f677495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:10:54.066144 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa1f564-dfa5-4674-830d-3f178f677495 admin admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:10:54.066420 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa1f564-dfa5-4674-830d-3f178f677495 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:10:54.066688 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa1f564-dfa5-4674-830d-3f178f677495 admin admin] PATH_INFO: `/v3/projects` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:10:54.067321 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa1f564-dfa5-4674-830d-3f178f677495 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:10:54.069242 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa1f564-dfa5-4674-830d-3f178f677495 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:10:54.393124 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1406/2814] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Oct 4 12:10:54 2022] POST /identity/v3/projects => generated 375 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 12:10:54.397232 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f256ee6e-e239-474b-93bd-eb218c042308 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:10:54.407926 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f256ee6e-e239-474b-93bd-eb218c042308 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:10:54.411502 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:10:54.465337 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1660838-6e98-4251-95ff-41725273d5a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:10:54.465925 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1660838-6e98-4251-95ff-41725273d5a9 admin admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:10:54.466205 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1660838-6e98-4251-95ff-41725273d5a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:10:54.467514 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1660838-6e98-4251-95ff-41725273d5a9 admin admin] PATH_INFO: `/v3/users` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:10:54.468210 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1660838-6e98-4251-95ff-41725273d5a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:10:54.470156 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1660838-6e98-4251-95ff-41725273d5a9 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:10:54.613162 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1409/2815] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Oct 4 12:10:54 2022] POST /identity/v3/users => generated 288 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:10:54.617362 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa1f564-dfa5-4674-830d-3f178f677495 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:10:54.627846 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa1f564-dfa5-4674-830d-3f178f677495 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:10:54.632389 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac95f38-13d6-45fa-9c33-cad764558fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:10:54.633022 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac95f38-13d6-45fa-9c33-cad764558fbd admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:10:54.633305 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac95f38-13d6-45fa-9c33-cad764558fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:10:54.633579 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac95f38-13d6-45fa-9c33-cad764558fbd admin admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:10:54.634214 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac95f38-13d6-45fa-9c33-cad764558fbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:10:54.635861 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac95f38-13d6-45fa-9c33-cad764558fbd admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:10:54.645980 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1407/2816] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:10:54 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:10:54.649611 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1660838-6e98-4251-95ff-41725273d5a9 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:10:54.659784 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1660838-6e98-4251-95ff-41725273d5a9 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:10:54.664227 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b541aed2-c929-409a-800f-501624189146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:10:54.664839 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b541aed2-c929-409a-800f-501624189146 admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:10:54.665115 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b541aed2-c929-409a-800f-501624189146 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:10:54.665385 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b541aed2-c929-409a-800f-501624189146 admin admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:10:54.666015 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b541aed2-c929-409a-800f-501624189146 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:10:54.667597 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b541aed2-c929-409a-800f-501624189146 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:10:54.679018 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1410/2817] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:10:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:10:54.683161 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac95f38-13d6-45fa-9c33-cad764558fbd admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:10:54.692990 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac95f38-13d6-45fa-9c33-cad764558fbd admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:10:54.697632 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce8e503-a2c3-4104-a559-000a3b63dfb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:10:54.698277 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce8e503-a2c3-4104-a559-000a3b63dfb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:10:54.698555 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce8e503-a2c3-4104-a559-000a3b63dfb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:10:54.698829 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce8e503-a2c3-4104-a559-000a3b63dfb1 admin admin] PATH_INFO: `/v3/projects/43f4e264254942b8b0b96e18562882d6/users/34e318d3f9e1477f818049e5dc83cec0/roles/ab4307f3b7994c1c80036fa7db93b6b9` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:10:54.723070 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce8e503-a2c3-4104-a559-000a3b63dfb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43f4e264254942b8b0b96e18562882d6, user_id=34e318d3f9e1477f818049e5dc83cec0, role_id=ab4307f3b7994c1c80036fa7db93b6b9)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:10:54.725840 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce8e503-a2c3-4104-a559-000a3b63dfb1 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:10:54.827191 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1408/2818] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Oct 4 12:10:54 2022] PUT /identity/v3/projects/43f4e264254942b8b0b96e18562882d6/users/34e318d3f9e1477f818049e5dc83cec0/roles/ab4307f3b7994c1c80036fa7db93b6b9 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:10:54.837633 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546a21e1-84af-4194-9acb-d495ff42d037 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:10:54.837920 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546a21e1-84af-4194-9acb-d495ff42d037 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:10:54.838196 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546a21e1-84af-4194-9acb-d495ff42d037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:10:54.866844 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-546a21e1-84af-4194-9acb-d495ff42d037 None None] MFA Rules not processed for user `34e318d3f9e1477f818049e5dc83cec0`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:10:54.868048 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-546a21e1-84af-4194-9acb-d495ff42d037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:10:54.931384 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1411/2819] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:10:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:10:54.942799 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce8e503-a2c3-4104-a559-000a3b63dfb1 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:10:54.944457 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-4ce8e503-a2c3-4104-a559-000a3b63dfb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:10:54.976609 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:10:55.022328 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce8e503-a2c3-4104-a559-000a3b63dfb1 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:10:55.028527 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2efb4b-cd03-4405-a507-cdf14335f42d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8e23d1d2fe24bdf9552e7c2f0ae3424', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:10:55.029860 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2efb4b-cd03-4405-a507-cdf14335f42d service nova] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:10:55.030140 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2efb4b-cd03-4405-a507-cdf14335f42d service nova] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:10:55.030413 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2efb4b-cd03-4405-a507-cdf14335f42d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:10:55.038727 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2efb4b-cd03-4405-a507-cdf14335f42d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:10:55.040390 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2efb4b-cd03-4405-a507-cdf14335f42d service nova] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:10:55.049219 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1409/2820] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:10:54 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:10:55.279413 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546a21e1-84af-4194-9acb-d495ff42d037 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:10:55.340500 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546a21e1-84af-4194-9acb-d495ff42d037 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:10:55.345731 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7f681b-f224-45d0-875c-e6dc42ee55b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:10:55.346379 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7f681b-f224-45d0-875c-e6dc42ee55b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:10:55.346765 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7f681b-f224-45d0-875c-e6dc42ee55b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:10:55.347065 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7f681b-f224-45d0-875c-e6dc42ee55b8 admin admin] PATH_INFO: `/v3/users/34e318d3f9e1477f818049e5dc83cec0` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:10:55.353178 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7f681b-f224-45d0-875c-e6dc42ee55b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=34e318d3f9e1477f818049e5dc83cec0)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:10:55.353178 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7f681b-f224-45d0-875c-e6dc42ee55b8 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:10:55.368270 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:10:55.726546 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-dc7f681b-f224-45d0-875c-e6dc42ee55b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34e318d3f9e1477f818049e5dc83cec0'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:10:55.733670 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-dc7f681b-f224-45d0-875c-e6dc42ee55b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34e318d3f9e1477f818049e5dc83cec0'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:10:55.734323 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-dc7f681b-f224-45d0-875c-e6dc42ee55b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34e318d3f9e1477f818049e5dc83cec0'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:10:55.734916 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-dc7f681b-f224-45d0-875c-e6dc42ee55b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34e318d3f9e1477f818049e5dc83cec0'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:10:55.825753 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-dc7f681b-f224-45d0-875c-e6dc42ee55b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34e318d3f9e1477f818049e5dc83cec0'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:10:55.843749 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1412/2821] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Oct 4 12:10:55 2022] DELETE /identity/v3/users/34e318d3f9e1477f818049e5dc83cec0 => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:10:55.848257 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ced1a63-15f3-4703-8357-aebefa35aa86 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:10:55.848759 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ced1a63-15f3-4703-8357-aebefa35aa86 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:10:55.848860 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ced1a63-15f3-4703-8357-aebefa35aa86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:10:55.868332 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-1ced1a63-15f3-4703-8357-aebefa35aa86 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:10:55.869561 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-1ced1a63-15f3-4703-8357-aebefa35aa86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:10:55.928526 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1410/2822] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:10:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:10:55.938245 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7f681b-f224-45d0-875c-e6dc42ee55b8 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:10:55.939785 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-dc7f681b-f224-45d0-875c-e6dc42ee55b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:10:55.997381 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7f681b-f224-45d0-875c-e6dc42ee55b8 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:10:56.001172 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcca2ca5-b26b-400b-baa0-dc97417c2391 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7289515c5c44914a19daa439de98cb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:10:56.001774 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcca2ca5-b26b-400b-baa0-dc97417c2391 service neutron] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:10:56.002054 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcca2ca5-b26b-400b-baa0-dc97417c2391 service neutron] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:10:56.002331 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcca2ca5-b26b-400b-baa0-dc97417c2391 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:10:56.011062 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcca2ca5-b26b-400b-baa0-dc97417c2391 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:10:56.012543 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcca2ca5-b26b-400b-baa0-dc97417c2391 service neutron] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:10:56.021870 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1413/2823] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:10:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:10:56.471658 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ced1a63-15f3-4703-8357-aebefa35aa86 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:10:56.473282 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-1ced1a63-15f3-4703-8357-aebefa35aa86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:10:56.488979 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ced1a63-15f3-4703-8357-aebefa35aa86 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:10:56.493320 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8007a818-dadb-4052-b622-cdaeacd598bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:10:56.493968 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8007a818-dadb-4052-b622-cdaeacd598bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:10:56.494247 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8007a818-dadb-4052-b622-cdaeacd598bb admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:10:56.494515 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8007a818-dadb-4052-b622-cdaeacd598bb admin admin] PATH_INFO: `/v3/projects/43f4e264254942b8b0b96e18562882d6` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:10:56.495696 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8007a818-dadb-4052-b622-cdaeacd598bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=43f4e264254942b8b0b96e18562882d6)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:10:56.497648 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8007a818-dadb-4052-b622-cdaeacd598bb admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:10:56.672994 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-8007a818-dadb-4052-b622-cdaeacd598bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43f4e264254942b8b0b96e18562882d6', 'request_id': 'req-8007a818-dadb-4052-b622-cdaeacd598bb'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:10:56.679272 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-8007a818-dadb-4052-b622-cdaeacd598bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43f4e264254942b8b0b96e18562882d6', 'request_id': 'req-8007a818-dadb-4052-b622-cdaeacd598bb'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:10:56.796314 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-8007a818-dadb-4052-b622-cdaeacd598bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43f4e264254942b8b0b96e18562882d6', 'request_id': 'req-8007a818-dadb-4052-b622-cdaeacd598bb'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:10:56.807704 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-8007a818-dadb-4052-b622-cdaeacd598bb admin admin] The token cache is being invalidate because project 43f4e264254942b8b0b96e18562882d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:10:56.807997 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-8007a818-dadb-4052-b622-cdaeacd598bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:10:56.808843 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-8007a818-dadb-4052-b622-cdaeacd598bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:10:56.810513 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1411/2824] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Oct 4 12:10:56 2022] DELETE /identity/v3/projects/43f4e264254942b8b0b96e18562882d6 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:10:56.816359 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93665fad-cf8f-439a-9111-488f9a960c52 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:10:56.816747 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93665fad-cf8f-439a-9111-488f9a960c52 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:10:56.817028 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93665fad-cf8f-439a-9111-488f9a960c52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:10:56.837841 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-93665fad-cf8f-439a-9111-488f9a960c52 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:10:56.839037 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-93665fad-cf8f-439a-9111-488f9a960c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:10:56.900259 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1414/2825] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:10:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:10:56.908991 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5e7587-7050-44f5-88a1-55fc397af9f8 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:10:56.909506 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5e7587-7050-44f5-88a1-55fc397af9f8 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:10:56.909610 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5e7587-7050-44f5-88a1-55fc397af9f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:10:56.933690 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-1a5e7587-7050-44f5-88a1-55fc397af9f8 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:10:56.935023 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-1a5e7587-7050-44f5-88a1-55fc397af9f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:10:56.943358 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1412/2826] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:10:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:10:56.947545 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93665fad-cf8f-439a-9111-488f9a960c52 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:10:56.957624 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93665fad-cf8f-439a-9111-488f9a960c52 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:10:56.962121 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338fcff2-0b86-4ece-b764-396b3ea6a1c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:10:56.962705 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338fcff2-0b86-4ece-b764-396b3ea6a1c8 admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:10:56.962979 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338fcff2-0b86-4ece-b764-396b3ea6a1c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:10:56.963247 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338fcff2-0b86-4ece-b764-396b3ea6a1c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:10:56.963875 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338fcff2-0b86-4ece-b764-396b3ea6a1c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:10:56.964172 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338fcff2-0b86-4ece-b764-396b3ea6a1c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:10:56.965785 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338fcff2-0b86-4ece-b764-396b3ea6a1c8 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:10:56.977663 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1415/2827] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Oct 4 12:10:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 12:10:56.981997 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5e7587-7050-44f5-88a1-55fc397af9f8 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:10:56.991538 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5e7587-7050-44f5-88a1-55fc397af9f8 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:10:56.996241 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20f00c3-78dd-4da6-a7b8-f6be1d31a955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:10:56.996879 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20f00c3-78dd-4da6-a7b8-f6be1d31a955 admin admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:10:56.997249 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20f00c3-78dd-4da6-a7b8-f6be1d31a955 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:10:56.997431 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20f00c3-78dd-4da6-a7b8-f6be1d31a955 admin admin] PATH_INFO: `/v3/projects` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:10:56.998094 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20f00c3-78dd-4da6-a7b8-f6be1d31a955 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:10:57.000271 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20f00c3-78dd-4da6-a7b8-f6be1d31a955 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:10:57.157589 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1413/2828] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Oct 4 12:10:56 2022] POST /identity/v3/projects => generated 383 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 12:10:57.161934 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338fcff2-0b86-4ece-b764-396b3ea6a1c8 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:10:57.172671 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338fcff2-0b86-4ece-b764-396b3ea6a1c8 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:10:57.193479 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:10:57.232982 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776908ff-74bb-445a-8ece-23ae6a041e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:10:57.233587 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776908ff-74bb-445a-8ece-23ae6a041e60 admin admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:10:57.233865 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776908ff-74bb-445a-8ece-23ae6a041e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:10:57.234139 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776908ff-74bb-445a-8ece-23ae6a041e60 admin admin] PATH_INFO: `/v3/users` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:10:57.234773 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776908ff-74bb-445a-8ece-23ae6a041e60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:10:57.236779 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776908ff-74bb-445a-8ece-23ae6a041e60 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:10:57.369323 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1416/2829] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Oct 4 12:10:57 2022] POST /identity/v3/users => generated 292 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:10:57.373969 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20f00c3-78dd-4da6-a7b8-f6be1d31a955 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:10:57.384343 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20f00c3-78dd-4da6-a7b8-f6be1d31a955 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:10:57.389508 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737b0b87-4236-4604-980f-d01cf90469c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:10:57.390099 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737b0b87-4236-4604-980f-d01cf90469c9 admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:10:57.390380 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737b0b87-4236-4604-980f-d01cf90469c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:10:57.390653 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737b0b87-4236-4604-980f-d01cf90469c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:10:57.391288 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737b0b87-4236-4604-980f-d01cf90469c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:10:57.392913 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737b0b87-4236-4604-980f-d01cf90469c9 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:10:57.394142 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:10:57.403068 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1414/2830] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:10:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 12:10:57.409044 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776908ff-74bb-445a-8ece-23ae6a041e60 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:10:57.419018 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776908ff-74bb-445a-8ece-23ae6a041e60 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:10:57.428243 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098e5612-37fb-46fb-a57e-0814ab6319b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:10:57.428880 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098e5612-37fb-46fb-a57e-0814ab6319b1 admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:10:57.429161 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098e5612-37fb-46fb-a57e-0814ab6319b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:10:57.429433 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098e5612-37fb-46fb-a57e-0814ab6319b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:10:57.430069 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098e5612-37fb-46fb-a57e-0814ab6319b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:10:57.431777 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098e5612-37fb-46fb-a57e-0814ab6319b1 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:10:57.442906 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1417/2831] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:10:57 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:10:57.447013 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737b0b87-4236-4604-980f-d01cf90469c9 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:10:57.457472 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737b0b87-4236-4604-980f-d01cf90469c9 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:10:57.461958 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6f05e1-3442-444f-ae5e-5a90f1b10099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:10:57.462597 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f05e1-3442-444f-ae5e-5a90f1b10099 admin admin] REQUEST_METHOD: `PUT` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:10:57.462873 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f05e1-3442-444f-ae5e-5a90f1b10099 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:10:57.463144 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f05e1-3442-444f-ae5e-5a90f1b10099 admin admin] PATH_INFO: `/v3/projects/e186aace978144a1ae5323d0a7118d5f/users/0589b29ae9e54263a04ba2f5b7ee9538/roles/ab4307f3b7994c1c80036fa7db93b6b9` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:10:57.477245 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6f05e1-3442-444f-ae5e-5a90f1b10099 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e186aace978144a1ae5323d0a7118d5f, user_id=0589b29ae9e54263a04ba2f5b7ee9538, role_id=ab4307f3b7994c1c80036fa7db93b6b9)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:10:57.479902 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6f05e1-3442-444f-ae5e-5a90f1b10099 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:10:57.584406 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1415/2832] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Oct 4 12:10:57 2022] PUT /identity/v3/projects/e186aace978144a1ae5323d0a7118d5f/users/0589b29ae9e54263a04ba2f5b7ee9538/roles/ab4307f3b7994c1c80036fa7db93b6b9 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:10:57.596402 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507fe749-d70d-46df-a274-94532c31c4bd None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:10:57.596797 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507fe749-d70d-46df-a274-94532c31c4bd None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:10:57.597075 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507fe749-d70d-46df-a274-94532c31c4bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:10:57.626102 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-507fe749-d70d-46df-a274-94532c31c4bd None None] MFA Rules not processed for user `0589b29ae9e54263a04ba2f5b7ee9538`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:10:57.627313 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-507fe749-d70d-46df-a274-94532c31c4bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:10:57.690975 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1418/2833] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:10:57 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:10:57.695374 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6f05e1-3442-444f-ae5e-5a90f1b10099 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:10:57.756857 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6f05e1-3442-444f-ae5e-5a90f1b10099 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:10:57.761397 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26248601-6bbd-4cc0-9702-a4016f471b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:10:57.761993 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26248601-6bbd-4cc0-9702-a4016f471b82 admin admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:10:57.762267 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26248601-6bbd-4cc0-9702-a4016f471b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:10:57.762535 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26248601-6bbd-4cc0-9702-a4016f471b82 admin admin] PATH_INFO: `/v3/projects` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:10:57.763673 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26248601-6bbd-4cc0-9702-a4016f471b82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:10:57.765665 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26248601-6bbd-4cc0-9702-a4016f471b82 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:10:57.881603 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1416/2834] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Oct 4 12:10:57 2022] POST /identity/v3/projects => generated 381 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:10:57.885643 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507fe749-d70d-46df-a274-94532c31c4bd None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:10:57.896769 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507fe749-d70d-46df-a274-94532c31c4bd None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:10:57.953564 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad90dfd1-373c-471b-b241-08d69cf9acf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:10:57.954208 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad90dfd1-373c-471b-b241-08d69cf9acf3 admin admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:10:57.954359 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad90dfd1-373c-471b-b241-08d69cf9acf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:10:57.954596 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad90dfd1-373c-471b-b241-08d69cf9acf3 admin admin] PATH_INFO: `/v3/users` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:10:57.955212 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad90dfd1-373c-471b-b241-08d69cf9acf3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:10:57.957140 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad90dfd1-373c-471b-b241-08d69cf9acf3 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:10:58.094910 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1419/2835] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Oct 4 12:10:57 2022] POST /identity/v3/users => generated 297 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:10:58.099041 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26248601-6bbd-4cc0-9702-a4016f471b82 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:10:58.109355 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26248601-6bbd-4cc0-9702-a4016f471b82 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:10:58.114171 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5badf8cb-bd92-444b-8e0c-5f61c02e44c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:10:58.114756 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5badf8cb-bd92-444b-8e0c-5f61c02e44c9 admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:10:58.115035 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5badf8cb-bd92-444b-8e0c-5f61c02e44c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:10:58.115305 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5badf8cb-bd92-444b-8e0c-5f61c02e44c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:10:58.115938 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5badf8cb-bd92-444b-8e0c-5f61c02e44c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:10:58.117564 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5badf8cb-bd92-444b-8e0c-5f61c02e44c9 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:10:58.128535 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1417/2836] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:10:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 12:10:58.132636 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad90dfd1-373c-471b-b241-08d69cf9acf3 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:10:58.143458 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad90dfd1-373c-471b-b241-08d69cf9acf3 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:10:58.147936 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30732a5-bdb3-4b9d-93a5-bd59ba993da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:10:58.148573 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30732a5-bdb3-4b9d-93a5-bd59ba993da2 admin admin] REQUEST_METHOD: `PUT` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:10:58.148876 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30732a5-bdb3-4b9d-93a5-bd59ba993da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:10:58.149143 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30732a5-bdb3-4b9d-93a5-bd59ba993da2 admin admin] PATH_INFO: `/v3/projects/459805b517454a7390d1e7144fa0f4ac/users/fbeae257fe034283833d2fe1bea6d9db/roles/d6e7421d1ff9451c808004b818354550` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:10:58.164548 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30732a5-bdb3-4b9d-93a5-bd59ba993da2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=459805b517454a7390d1e7144fa0f4ac, user_id=fbeae257fe034283833d2fe1bea6d9db, role_id=d6e7421d1ff9451c808004b818354550)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:10:58.167291 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30732a5-bdb3-4b9d-93a5-bd59ba993da2 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:10:58.269879 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:10:58.275479 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1420/2837] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Oct 4 12:10:58 2022] PUT /identity/v3/projects/459805b517454a7390d1e7144fa0f4ac/users/fbeae257fe034283833d2fe1bea6d9db/roles/d6e7421d1ff9451c808004b818354550 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:10:58.279667 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5badf8cb-bd92-444b-8e0c-5f61c02e44c9 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:10:58.289511 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5badf8cb-bd92-444b-8e0c-5f61c02e44c9 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:10:58.345256 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76bcf8d-4542-4046-88fe-f190754c69ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:10:58.345853 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76bcf8d-4542-4046-88fe-f190754c69ac admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:10:58.346128 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76bcf8d-4542-4046-88fe-f190754c69ac admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:10:58.346398 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76bcf8d-4542-4046-88fe-f190754c69ac admin admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:10:58.347026 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76bcf8d-4542-4046-88fe-f190754c69ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:10:58.348627 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76bcf8d-4542-4046-88fe-f190754c69ac admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:10:58.358279 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1418/2838] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:10:58 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:10:58.363027 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30732a5-bdb3-4b9d-93a5-bd59ba993da2 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:10:58.373554 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30732a5-bdb3-4b9d-93a5-bd59ba993da2 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:10:58.378111 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf26026-b70c-4893-96b1-fd519f45ee31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:10:58.378756 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf26026-b70c-4893-96b1-fd519f45ee31 admin admin] REQUEST_METHOD: `PUT` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:10:58.379034 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf26026-b70c-4893-96b1-fd519f45ee31 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:10:58.379306 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf26026-b70c-4893-96b1-fd519f45ee31 admin admin] PATH_INFO: `/v3/projects/459805b517454a7390d1e7144fa0f4ac/users/fbeae257fe034283833d2fe1bea6d9db/roles/d6e7421d1ff9451c808004b818354550` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:10:58.381301 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf26026-b70c-4893-96b1-fd519f45ee31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=459805b517454a7390d1e7144fa0f4ac, user_id=fbeae257fe034283833d2fe1bea6d9db, role_id=d6e7421d1ff9451c808004b818354550)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:10:58.383952 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf26026-b70c-4893-96b1-fd519f45ee31 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:10:58.395221 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1421/2839] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Oct 4 12:10:58 2022] PUT /identity/v3/projects/459805b517454a7390d1e7144fa0f4ac/users/fbeae257fe034283833d2fe1bea6d9db/roles/d6e7421d1ff9451c808004b818354550 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:10:58.405921 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2407b585-b222-4f03-b0ef-b863502f2e28 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:10:58.406205 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2407b585-b222-4f03-b0ef-b863502f2e28 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:10:58.406475 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2407b585-b222-4f03-b0ef-b863502f2e28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:10:58.434042 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-2407b585-b222-4f03-b0ef-b863502f2e28 None None] MFA Rules not processed for user `fbeae257fe034283833d2fe1bea6d9db`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:10:58.435855 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-2407b585-b222-4f03-b0ef-b863502f2e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:10:58.464421 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:10:58.504536 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1419/2840] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:10:58 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 12:10:58.515727 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf26026-b70c-4893-96b1-fd519f45ee31 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:10:58.517444 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-ddf26026-b70c-4893-96b1-fd519f45ee31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:10:58.575350 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf26026-b70c-4893-96b1-fd519f45ee31 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:10:58.579275 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eef4b1-615c-4016-9d63-aeaf0d0a1884 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e2a05b782424ab2928b5864f1bfd556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:10:58.579900 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eef4b1-615c-4016-9d63-aeaf0d0a1884 service cinder] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:10:58.580182 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eef4b1-615c-4016-9d63-aeaf0d0a1884 service cinder] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:10:58.580459 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eef4b1-615c-4016-9d63-aeaf0d0a1884 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:10:58.589585 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55eef4b1-615c-4016-9d63-aeaf0d0a1884 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:10:58.591017 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55eef4b1-615c-4016-9d63-aeaf0d0a1884 service cinder] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:10:58.601223 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1422/2841] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:10:58 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:10:58.706218 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2407b585-b222-4f03-b0ef-b863502f2e28 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:10:58.715667 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2407b585-b222-4f03-b0ef-b863502f2e28 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:10:58.719209 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948e5085-648a-4067-8f41-39901892357e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e2a05b782424ab2928b5864f1bfd556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:10:58.719801 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948e5085-648a-4067-8f41-39901892357e service cinder] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:10:58.720076 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948e5085-648a-4067-8f41-39901892357e service cinder] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:10:58.720345 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948e5085-648a-4067-8f41-39901892357e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:10:58.775279 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948e5085-648a-4067-8f41-39901892357e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:10:58.776791 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948e5085-648a-4067-8f41-39901892357e service cinder] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:10:58.785861 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1420/2842] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:10:58 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 12:11:02.491232 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eef4b1-615c-4016-9d63-aeaf0d0a1884 service cinder] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:11:02.554423 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eef4b1-615c-4016-9d63-aeaf0d0a1884 service cinder] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:11:02.558981 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d946b5-1c33-4ad9-b608-866b42f81f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:11:02.559612 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d946b5-1c33-4ad9-b608-866b42f81f5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:11:02.560517 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d946b5-1c33-4ad9-b608-866b42f81f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:11:02.560831 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d946b5-1c33-4ad9-b608-866b42f81f5a admin admin] PATH_INFO: `/v3/users/0589b29ae9e54263a04ba2f5b7ee9538` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:11:02.562513 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d946b5-1c33-4ad9-b608-866b42f81f5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0589b29ae9e54263a04ba2f5b7ee9538)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:11:02.564462 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d946b5-1c33-4ad9-b608-866b42f81f5a admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:11:02.795589 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-00d946b5-1c33-4ad9-b608-866b42f81f5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0589b29ae9e54263a04ba2f5b7ee9538'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:11:02.803138 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-00d946b5-1c33-4ad9-b608-866b42f81f5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0589b29ae9e54263a04ba2f5b7ee9538'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:11:02.804041 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-00d946b5-1c33-4ad9-b608-866b42f81f5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0589b29ae9e54263a04ba2f5b7ee9538'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:11:02.804794 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-00d946b5-1c33-4ad9-b608-866b42f81f5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0589b29ae9e54263a04ba2f5b7ee9538'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:11:02.888726 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-00d946b5-1c33-4ad9-b608-866b42f81f5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0589b29ae9e54263a04ba2f5b7ee9538'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:11:02.907201 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1423/2843] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Oct 4 12:11:02 2022] DELETE /identity/v3/users/0589b29ae9e54263a04ba2f5b7ee9538 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:11:02.911795 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624da559-c7ae-401c-b8cc-a9f653f64633 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:11:02.912277 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624da559-c7ae-401c-b8cc-a9f653f64633 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:11:02.912396 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624da559-c7ae-401c-b8cc-a9f653f64633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:11:02.933717 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-624da559-c7ae-401c-b8cc-a9f653f64633 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:11:02.935627 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-624da559-c7ae-401c-b8cc-a9f653f64633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:11:02.995587 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1421/2844] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:11:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:11:03.005372 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d946b5-1c33-4ad9-b608-866b42f81f5a admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:11:03.006801 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-00d946b5-1c33-4ad9-b608-866b42f81f5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:11:03.017321 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:11:03.069467 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d946b5-1c33-4ad9-b608-866b42f81f5a admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:11:03.073019 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa1b317-f2b5-40bf-959b-b0a0e2336a42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7289515c5c44914a19daa439de98cb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:11:03.073632 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa1b317-f2b5-40bf-959b-b0a0e2336a42 service neutron] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:11:03.073913 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa1b317-f2b5-40bf-959b-b0a0e2336a42 service neutron] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:11:03.074184 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa1b317-f2b5-40bf-959b-b0a0e2336a42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:11:03.083685 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa1b317-f2b5-40bf-959b-b0a0e2336a42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:11:03.085152 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa1b317-f2b5-40bf-959b-b0a0e2336a42 service neutron] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:11:03.095169 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1424/2845] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:11:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:11:03.542619 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624da559-c7ae-401c-b8cc-a9f653f64633 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:11:03.544056 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-624da559-c7ae-401c-b8cc-a9f653f64633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:11:03.559127 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624da559-c7ae-401c-b8cc-a9f653f64633 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:11:03.564412 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcfe4bd-063f-49c4-af89-6b7f31d5fb36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:11:03.565102 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcfe4bd-063f-49c4-af89-6b7f31d5fb36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:11:03.565422 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcfe4bd-063f-49c4-af89-6b7f31d5fb36 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:11:03.565635 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcfe4bd-063f-49c4-af89-6b7f31d5fb36 admin admin] PATH_INFO: `/v3/projects/e186aace978144a1ae5323d0a7118d5f` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:11:03.566812 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcfe4bd-063f-49c4-af89-6b7f31d5fb36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e186aace978144a1ae5323d0a7118d5f)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:11:03.568740 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcfe4bd-063f-49c4-af89-6b7f31d5fb36 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:11:03.709562 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-4fcfe4bd-063f-49c4-af89-6b7f31d5fb36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e186aace978144a1ae5323d0a7118d5f', 'request_id': 'req-4fcfe4bd-063f-49c4-af89-6b7f31d5fb36'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:11:03.716127 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-4fcfe4bd-063f-49c4-af89-6b7f31d5fb36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e186aace978144a1ae5323d0a7118d5f', 'request_id': 'req-4fcfe4bd-063f-49c4-af89-6b7f31d5fb36'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:11:03.812225 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-4fcfe4bd-063f-49c4-af89-6b7f31d5fb36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e186aace978144a1ae5323d0a7118d5f', 'request_id': 'req-4fcfe4bd-063f-49c4-af89-6b7f31d5fb36'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:11:03.813774 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:11:03.824218 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-4fcfe4bd-063f-49c4-af89-6b7f31d5fb36 admin admin] The token cache is being invalidate because project e186aace978144a1ae5323d0a7118d5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:11:03.824509 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-4fcfe4bd-063f-49c4-af89-6b7f31d5fb36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:11:03.825236 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-4fcfe4bd-063f-49c4-af89-6b7f31d5fb36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:11:03.828513 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1422/2846] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Oct 4 12:11:03 2022] DELETE /identity/v3/projects/e186aace978144a1ae5323d0a7118d5f => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:11:03.830977 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa1b317-f2b5-40bf-959b-b0a0e2336a42 service neutron] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:11:03.840716 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa1b317-f2b5-40bf-959b-b0a0e2336a42 service neutron] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:11:03.897076 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465ed985-673c-4811-92dc-21af60205acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:11:03.897737 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465ed985-673c-4811-92dc-21af60205acb admin admin] REQUEST_METHOD: `DELETE` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:11:03.898013 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465ed985-673c-4811-92dc-21af60205acb admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:11:03.898285 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465ed985-673c-4811-92dc-21af60205acb admin admin] PATH_INFO: `/v3/users/fbeae257fe034283833d2fe1bea6d9db` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:11:03.899463 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465ed985-673c-4811-92dc-21af60205acb admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbeae257fe034283833d2fe1bea6d9db)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:11:03.901410 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465ed985-673c-4811-92dc-21af60205acb admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:11:04.126021 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-465ed985-673c-4811-92dc-21af60205acb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbeae257fe034283833d2fe1bea6d9db'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:11:04.132963 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-465ed985-673c-4811-92dc-21af60205acb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbeae257fe034283833d2fe1bea6d9db'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:11:04.133631 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-465ed985-673c-4811-92dc-21af60205acb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbeae257fe034283833d2fe1bea6d9db'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:11:04.134252 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-465ed985-673c-4811-92dc-21af60205acb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbeae257fe034283833d2fe1bea6d9db'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:11:04.242915 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-465ed985-673c-4811-92dc-21af60205acb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbeae257fe034283833d2fe1bea6d9db'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:11:04.262341 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1425/2847] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Oct 4 12:11:03 2022] DELETE /identity/v3/users/fbeae257fe034283833d2fe1bea6d9db => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:11:04.739731 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcfe4bd-063f-49c4-af89-6b7f31d5fb36 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:11:04.747669 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-4fcfe4bd-063f-49c4-af89-6b7f31d5fb36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:11:04.755186 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcfe4bd-063f-49c4-af89-6b7f31d5fb36 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:11:04.815141 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d810f7db-2fca-4e25-8752-f72e5ef99ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:11:04.815786 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d810f7db-2fca-4e25-8752-f72e5ef99ce2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:11:04.816067 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d810f7db-2fca-4e25-8752-f72e5ef99ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:11:04.816359 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d810f7db-2fca-4e25-8752-f72e5ef99ce2 admin admin] PATH_INFO: `/v3/projects/459805b517454a7390d1e7144fa0f4ac` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:11:04.817485 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d810f7db-2fca-4e25-8752-f72e5ef99ce2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=459805b517454a7390d1e7144fa0f4ac)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:11:04.819392 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d810f7db-2fca-4e25-8752-f72e5ef99ce2 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:11:04.946576 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-d810f7db-2fca-4e25-8752-f72e5ef99ce2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '459805b517454a7390d1e7144fa0f4ac', 'request_id': 'req-d810f7db-2fca-4e25-8752-f72e5ef99ce2'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:11:04.953497 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-d810f7db-2fca-4e25-8752-f72e5ef99ce2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '459805b517454a7390d1e7144fa0f4ac', 'request_id': 'req-d810f7db-2fca-4e25-8752-f72e5ef99ce2'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:11:05.023138 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-d810f7db-2fca-4e25-8752-f72e5ef99ce2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '459805b517454a7390d1e7144fa0f4ac', 'request_id': 'req-d810f7db-2fca-4e25-8752-f72e5ef99ce2'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:11:05.034433 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-d810f7db-2fca-4e25-8752-f72e5ef99ce2 admin admin] The token cache is being invalidate because project 459805b517454a7390d1e7144fa0f4ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:11:05.034722 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-d810f7db-2fca-4e25-8752-f72e5ef99ce2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:11:05.035345 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-d810f7db-2fca-4e25-8752-f72e5ef99ce2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:11:05.036875 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1423/2848] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Oct 4 12:11:04 2022] DELETE /identity/v3/projects/459805b517454a7390d1e7144fa0f4ac => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:11:05.041783 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f56ee07-e65d-49d3-873d-ffd9680d2811 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:11:05.042266 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f56ee07-e65d-49d3-873d-ffd9680d2811 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:11:05.042371 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f56ee07-e65d-49d3-873d-ffd9680d2811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:11:05.063657 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-2f56ee07-e65d-49d3-873d-ffd9680d2811 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:11:05.067199 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-2f56ee07-e65d-49d3-873d-ffd9680d2811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:11:05.093901 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:11:05.128946 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1426/2849] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:11:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:11:05.139511 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2bf207-c569-4aba-a86e-cfecb482c13e None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:11:05.141714 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2bf207-c569-4aba-a86e-cfecb482c13e None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:11:05.141714 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2bf207-c569-4aba-a86e-cfecb482c13e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:11:05.161022 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-fa2bf207-c569-4aba-a86e-cfecb482c13e None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:11:05.162235 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-fa2bf207-c569-4aba-a86e-cfecb482c13e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:11:05.175566 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1424/2850] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:11:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:11:05.179875 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f56ee07-e65d-49d3-873d-ffd9680d2811 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:11:05.191436 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f56ee07-e65d-49d3-873d-ffd9680d2811 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:11:05.196456 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4d18c2-d8a8-48f1-8e2e-1d336fec2faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:11:05.197093 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4d18c2-d8a8-48f1-8e2e-1d336fec2faf admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:11:05.197369 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4d18c2-d8a8-48f1-8e2e-1d336fec2faf admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:11:05.197636 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4d18c2-d8a8-48f1-8e2e-1d336fec2faf admin admin] PATH_INFO: `/v3/domains` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:11:05.198279 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4d18c2-d8a8-48f1-8e2e-1d336fec2faf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:11:05.198579 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4d18c2-d8a8-48f1-8e2e-1d336fec2faf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:11:05.200177 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4d18c2-d8a8-48f1-8e2e-1d336fec2faf admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:11:05.211942 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1427/2851] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Oct 4 12:11:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:11:05.216775 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2bf207-c569-4aba-a86e-cfecb482c13e None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:11:05.226311 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2bf207-c569-4aba-a86e-cfecb482c13e None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:11:05.231015 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585e0c3e-1f9e-44b3-bf09-51df71121758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:11:05.232210 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585e0c3e-1f9e-44b3-bf09-51df71121758 admin admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:11:05.232494 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585e0c3e-1f9e-44b3-bf09-51df71121758 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:11:05.232906 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585e0c3e-1f9e-44b3-bf09-51df71121758 admin admin] PATH_INFO: `/v3/projects` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:11:05.233544 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585e0c3e-1f9e-44b3-bf09-51df71121758 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:11:05.235472 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585e0c3e-1f9e-44b3-bf09-51df71121758 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:11:05.341384 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1425/2852] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Oct 4 12:11:05 2022] POST /identity/v3/projects => generated 377 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:11:05.345553 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4d18c2-d8a8-48f1-8e2e-1d336fec2faf admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:11:05.355749 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4d18c2-d8a8-48f1-8e2e-1d336fec2faf admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:11:05.411451 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd6733a-a5d5-46a7-ab50-b0cb58ae1c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:11:05.412042 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd6733a-a5d5-46a7-ab50-b0cb58ae1c0f admin admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:11:05.412319 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd6733a-a5d5-46a7-ab50-b0cb58ae1c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:11:05.412586 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd6733a-a5d5-46a7-ab50-b0cb58ae1c0f admin admin] PATH_INFO: `/v3/users` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:11:05.413241 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd6733a-a5d5-46a7-ab50-b0cb58ae1c0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:11:05.415137 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd6733a-a5d5-46a7-ab50-b0cb58ae1c0f admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:11:05.543746 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1428/2853] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Oct 4 12:11:05 2022] POST /identity/v3/users => generated 289 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 12:11:05.549092 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585e0c3e-1f9e-44b3-bf09-51df71121758 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:11:05.559569 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585e0c3e-1f9e-44b3-bf09-51df71121758 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:11:05.564800 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ac7caa-be10-4798-b1a4-d9889fe8ff0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:11:05.565392 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ac7caa-be10-4798-b1a4-d9889fe8ff0b admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:11:05.565671 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ac7caa-be10-4798-b1a4-d9889fe8ff0b admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:11:05.565938 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ac7caa-be10-4798-b1a4-d9889fe8ff0b admin admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:11:05.566564 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ac7caa-be10-4798-b1a4-d9889fe8ff0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:11:05.568145 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ac7caa-be10-4798-b1a4-d9889fe8ff0b admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:11:05.578035 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1426/2854] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:11:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:11:05.582058 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd6733a-a5d5-46a7-ab50-b0cb58ae1c0f admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:11:05.593487 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd6733a-a5d5-46a7-ab50-b0cb58ae1c0f admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:11:05.598083 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07561b5-57e0-4fc0-a8f2-c2d29f88e9be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:11:05.598694 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07561b5-57e0-4fc0-a8f2-c2d29f88e9be admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:11:05.598973 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07561b5-57e0-4fc0-a8f2-c2d29f88e9be admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:11:05.599247 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07561b5-57e0-4fc0-a8f2-c2d29f88e9be admin admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:11:05.599882 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07561b5-57e0-4fc0-a8f2-c2d29f88e9be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:11:05.601559 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07561b5-57e0-4fc0-a8f2-c2d29f88e9be admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:11:05.613373 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1429/2855] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:11:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:11:05.617497 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ac7caa-be10-4798-b1a4-d9889fe8ff0b admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:11:05.627334 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ac7caa-be10-4798-b1a4-d9889fe8ff0b admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:11:05.631720 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bd2e03-3451-4f01-8fb7-631334b0375d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:11:05.632354 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bd2e03-3451-4f01-8fb7-631334b0375d admin admin] REQUEST_METHOD: `PUT` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:11:05.632655 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bd2e03-3451-4f01-8fb7-631334b0375d admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:11:05.632929 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bd2e03-3451-4f01-8fb7-631334b0375d admin admin] PATH_INFO: `/v3/projects/16d464818e984febb0abf9c5bfe1cea0/users/8510312c94b44c80bfe3cf263fd064ef/roles/ab4307f3b7994c1c80036fa7db93b6b9` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:11:05.647965 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bd2e03-3451-4f01-8fb7-631334b0375d admin admin] RBAC: Authorizing `identity:create_grant(project_id=16d464818e984febb0abf9c5bfe1cea0, user_id=8510312c94b44c80bfe3cf263fd064ef, role_id=ab4307f3b7994c1c80036fa7db93b6b9)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:11:05.650642 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bd2e03-3451-4f01-8fb7-631334b0375d admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:11:05.741465 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1427/2856] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Oct 4 12:11:05 2022] PUT /identity/v3/projects/16d464818e984febb0abf9c5bfe1cea0/users/8510312c94b44c80bfe3cf263fd064ef/roles/ab4307f3b7994c1c80036fa7db93b6b9 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:11:05.757291 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69580b37-a795-4f19-a337-a462ea01bd82 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:11:05.757579 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69580b37-a795-4f19-a337-a462ea01bd82 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:11:05.757854 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69580b37-a795-4f19-a337-a462ea01bd82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:11:05.787416 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-69580b37-a795-4f19-a337-a462ea01bd82 None None] MFA Rules not processed for user `8510312c94b44c80bfe3cf263fd064ef`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:11:05.788649 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-69580b37-a795-4f19-a337-a462ea01bd82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:11:05.853762 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1430/2857] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:11:05 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:11:05.865834 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bd2e03-3451-4f01-8fb7-631334b0375d admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:11:05.867528 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-e5bd2e03-3451-4f01-8fb7-631334b0375d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:11:05.885565 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:DELETE=9,keystone:SELECT=88,keystone:INSERT=3 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:11:05.924198 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bd2e03-3451-4f01-8fb7-631334b0375d admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:11:05.927842 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1bcecf-a0d1-4d11-8a61-cda0177b2cc9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd516d0755be84b7293156625df1b13b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:11:05.928488 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1bcecf-a0d1-4d11-8a61-cda0177b2cc9 service glance] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:11:05.928802 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1bcecf-a0d1-4d11-8a61-cda0177b2cc9 service glance] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:11:05.929084 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1bcecf-a0d1-4d11-8a61-cda0177b2cc9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:11:05.938053 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1bcecf-a0d1-4d11-8a61-cda0177b2cc9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:11:05.939476 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1bcecf-a0d1-4d11-8a61-cda0177b2cc9 service glance] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:11:05.948062 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1428/2858] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:11:05 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:11:15.850789 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=86,keystone:INSERT=3 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:11:16.040576 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=19 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:11:22.634016 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69580b37-a795-4f19-a337-a462ea01bd82 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:11:22.698638 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69580b37-a795-4f19-a337-a462ea01bd82 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:11:22.704749 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4d2ccf-c0fe-400a-8e03-0bacb4f60c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:11:22.705376 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4d2ccf-c0fe-400a-8e03-0bacb4f60c24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:11:22.705651 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4d2ccf-c0fe-400a-8e03-0bacb4f60c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:11:22.705922 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4d2ccf-c0fe-400a-8e03-0bacb4f60c24 admin admin] PATH_INFO: `/v3/users/8510312c94b44c80bfe3cf263fd064ef` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:11:22.707040 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4d2ccf-c0fe-400a-8e03-0bacb4f60c24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8510312c94b44c80bfe3cf263fd064ef)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:11:22.709023 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4d2ccf-c0fe-400a-8e03-0bacb4f60c24 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:11:22.954182 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-1e4d2ccf-c0fe-400a-8e03-0bacb4f60c24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8510312c94b44c80bfe3cf263fd064ef'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:11:22.961190 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-1e4d2ccf-c0fe-400a-8e03-0bacb4f60c24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8510312c94b44c80bfe3cf263fd064ef'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:11:22.961863 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-1e4d2ccf-c0fe-400a-8e03-0bacb4f60c24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8510312c94b44c80bfe3cf263fd064ef'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:11:22.962474 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-1e4d2ccf-c0fe-400a-8e03-0bacb4f60c24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8510312c94b44c80bfe3cf263fd064ef'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:11:23.077234 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-1e4d2ccf-c0fe-400a-8e03-0bacb4f60c24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8510312c94b44c80bfe3cf263fd064ef'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:11:23.099545 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1431/2859] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Oct 4 12:11:22 2022] DELETE /identity/v3/users/8510312c94b44c80bfe3cf263fd064ef => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:11:23.104051 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5460fc-514a-4436-b471-cf6b3f92ad74 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:11:23.104626 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5460fc-514a-4436-b471-cf6b3f92ad74 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:11:23.104626 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5460fc-514a-4436-b471-cf6b3f92ad74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:11:23.127409 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-2a5460fc-514a-4436-b471-cf6b3f92ad74 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:11:23.128651 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-2a5460fc-514a-4436-b471-cf6b3f92ad74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:11:23.194828 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1429/2860] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:11:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:11:23.204705 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4d2ccf-c0fe-400a-8e03-0bacb4f60c24 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:11:23.206095 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-1e4d2ccf-c0fe-400a-8e03-0bacb4f60c24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:11:23.274607 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4d2ccf-c0fe-400a-8e03-0bacb4f60c24 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:11:23.280162 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a94cd8-679e-4c12-8c9f-d46c5a28f69a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7289515c5c44914a19daa439de98cb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:11:23.281155 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a94cd8-679e-4c12-8c9f-d46c5a28f69a service neutron] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:11:23.281608 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a94cd8-679e-4c12-8c9f-d46c5a28f69a service neutron] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:11:23.282060 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a94cd8-679e-4c12-8c9f-d46c5a28f69a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:11:23.291933 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a94cd8-679e-4c12-8c9f-d46c5a28f69a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:11:23.293899 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a94cd8-679e-4c12-8c9f-d46c5a28f69a service neutron] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:11:23.303993 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1432/2861] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:11:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:11:23.781835 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5460fc-514a-4436-b471-cf6b3f92ad74 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:11:23.783276 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-2a5460fc-514a-4436-b471-cf6b3f92ad74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:11:23.797875 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5460fc-514a-4436-b471-cf6b3f92ad74 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:11:23.802523 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac0b4e0-6ad5-431f-ba07-ba36fd95c164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:11:23.803162 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac0b4e0-6ad5-431f-ba07-ba36fd95c164 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:11:23.803443 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac0b4e0-6ad5-431f-ba07-ba36fd95c164 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:11:23.803720 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac0b4e0-6ad5-431f-ba07-ba36fd95c164 admin admin] PATH_INFO: `/v3/projects/16d464818e984febb0abf9c5bfe1cea0` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:11:23.805021 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac0b4e0-6ad5-431f-ba07-ba36fd95c164 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16d464818e984febb0abf9c5bfe1cea0)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:11:23.806948 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac0b4e0-6ad5-431f-ba07-ba36fd95c164 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:11:23.999340 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-fac0b4e0-6ad5-431f-ba07-ba36fd95c164 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16d464818e984febb0abf9c5bfe1cea0', 'request_id': 'req-fac0b4e0-6ad5-431f-ba07-ba36fd95c164'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:11:24.006287 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-fac0b4e0-6ad5-431f-ba07-ba36fd95c164 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16d464818e984febb0abf9c5bfe1cea0', 'request_id': 'req-fac0b4e0-6ad5-431f-ba07-ba36fd95c164'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:11:24.122429 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-fac0b4e0-6ad5-431f-ba07-ba36fd95c164 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16d464818e984febb0abf9c5bfe1cea0', 'request_id': 'req-fac0b4e0-6ad5-431f-ba07-ba36fd95c164'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:11:24.133821 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-fac0b4e0-6ad5-431f-ba07-ba36fd95c164 admin admin] The token cache is being invalidate because project 16d464818e984febb0abf9c5bfe1cea0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:11:24.134107 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-fac0b4e0-6ad5-431f-ba07-ba36fd95c164 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:11:24.134742 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-fac0b4e0-6ad5-431f-ba07-ba36fd95c164 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:11:24.136217 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1430/2862] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Oct 4 12:11:23 2022] DELETE /identity/v3/projects/16d464818e984febb0abf9c5bfe1cea0 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:11:24.141683 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97efafde-bed5-4055-a269-c5128ff51f59 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:11:24.142156 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97efafde-bed5-4055-a269-c5128ff51f59 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:11:24.142274 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97efafde-bed5-4055-a269-c5128ff51f59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:11:24.163444 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-97efafde-bed5-4055-a269-c5128ff51f59 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:11:24.172743 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-97efafde-bed5-4055-a269-c5128ff51f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:11:24.182835 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:11:24.233153 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1433/2863] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:11:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:11:24.241325 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf38476a-b843-4cd0-a2d9-c0fd82bc4465 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:11:24.241618 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf38476a-b843-4cd0-a2d9-c0fd82bc4465 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:11:24.241896 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf38476a-b843-4cd0-a2d9-c0fd82bc4465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:11:24.262138 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-bf38476a-b843-4cd0-a2d9-c0fd82bc4465 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:11:24.263290 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-bf38476a-b843-4cd0-a2d9-c0fd82bc4465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:11:24.271170 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1431/2864] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:11:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:11:24.275431 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97efafde-bed5-4055-a269-c5128ff51f59 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:11:24.285006 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97efafde-bed5-4055-a269-c5128ff51f59 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:11:24.289476 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f48407b-e3cc-4ab5-8d96-d0bcafd842d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:11:24.294182 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f48407b-e3cc-4ab5-8d96-d0bcafd842d1 admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:11:24.294182 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f48407b-e3cc-4ab5-8d96-d0bcafd842d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:11:24.294182 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f48407b-e3cc-4ab5-8d96-d0bcafd842d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:11:24.294182 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f48407b-e3cc-4ab5-8d96-d0bcafd842d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:11:24.294182 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f48407b-e3cc-4ab5-8d96-d0bcafd842d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:11:24.294182 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f48407b-e3cc-4ab5-8d96-d0bcafd842d1 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:11:24.305214 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1434/2865] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Oct 4 12:11:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:11:24.310631 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf38476a-b843-4cd0-a2d9-c0fd82bc4465 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:11:24.320148 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf38476a-b843-4cd0-a2d9-c0fd82bc4465 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:11:24.325096 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed5442f-cc53-40e3-8b8a-0ed5471c8657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:11:24.325735 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed5442f-cc53-40e3-8b8a-0ed5471c8657 admin admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:11:24.326019 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed5442f-cc53-40e3-8b8a-0ed5471c8657 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:11:24.326296 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed5442f-cc53-40e3-8b8a-0ed5471c8657 admin admin] PATH_INFO: `/v3/projects` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:11:24.326947 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed5442f-cc53-40e3-8b8a-0ed5471c8657 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:11:24.328906 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed5442f-cc53-40e3-8b8a-0ed5471c8657 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:11:24.482488 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1432/2866] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Oct 4 12:11:24 2022] POST /identity/v3/projects => generated 373 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:11:24.486866 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f48407b-e3cc-4ab5-8d96-d0bcafd842d1 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:11:24.496909 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f48407b-e3cc-4ab5-8d96-d0bcafd842d1 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:11:24.557727 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d0aa82-2a8e-4ab4-9f94-eb0e47f731c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:11:24.558538 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d0aa82-2a8e-4ab4-9f94-eb0e47f731c1 admin admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:11:24.558922 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d0aa82-2a8e-4ab4-9f94-eb0e47f731c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:11:24.559416 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d0aa82-2a8e-4ab4-9f94-eb0e47f731c1 admin admin] PATH_INFO: `/v3/users` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:11:24.560152 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d0aa82-2a8e-4ab4-9f94-eb0e47f731c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:11:24.562133 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d0aa82-2a8e-4ab4-9f94-eb0e47f731c1 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:11:24.703655 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1435/2867] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Oct 4 12:11:24 2022] POST /identity/v3/users => generated 287 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:11:24.708174 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed5442f-cc53-40e3-8b8a-0ed5471c8657 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:11:24.720330 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed5442f-cc53-40e3-8b8a-0ed5471c8657 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:11:24.725082 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dd4dd3-d33f-4ddc-83ca-98f56bbf13cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:11:24.725679 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dd4dd3-d33f-4ddc-83ca-98f56bbf13cd admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:11:24.725955 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dd4dd3-d33f-4ddc-83ca-98f56bbf13cd admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:11:24.726226 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dd4dd3-d33f-4ddc-83ca-98f56bbf13cd admin admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:11:24.726863 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dd4dd3-d33f-4ddc-83ca-98f56bbf13cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:11:24.728443 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dd4dd3-d33f-4ddc-83ca-98f56bbf13cd admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:11:24.740717 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1433/2868] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:11:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:11:24.743104 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d0aa82-2a8e-4ab4-9f94-eb0e47f731c1 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:11:24.753302 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d0aa82-2a8e-4ab4-9f94-eb0e47f731c1 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:11:24.757925 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c337ee-2679-401d-aabf-ce88e6c18ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:11:24.758524 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c337ee-2679-401d-aabf-ce88e6c18ef5 admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:11:24.758807 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c337ee-2679-401d-aabf-ce88e6c18ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:11:24.759081 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c337ee-2679-401d-aabf-ce88e6c18ef5 admin admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:11:24.759724 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c337ee-2679-401d-aabf-ce88e6c18ef5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:11:24.761359 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c337ee-2679-401d-aabf-ce88e6c18ef5 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:11:24.772320 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1436/2869] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:11:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:11:24.777051 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dd4dd3-d33f-4ddc-83ca-98f56bbf13cd admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:11:24.788709 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dd4dd3-d33f-4ddc-83ca-98f56bbf13cd admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:11:24.793454 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd41a20-ba50-4fba-bf8f-8d0178776a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:11:24.794171 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd41a20-ba50-4fba-bf8f-8d0178776a34 admin admin] REQUEST_METHOD: `PUT` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:11:24.794455 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd41a20-ba50-4fba-bf8f-8d0178776a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:11:24.794731 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd41a20-ba50-4fba-bf8f-8d0178776a34 admin admin] PATH_INFO: `/v3/projects/85123409ec694ca19f2f17288553e0f7/users/515d781da6d24c3a82275234b4c4c8b9/roles/ab4307f3b7994c1c80036fa7db93b6b9` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:11:24.809708 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd41a20-ba50-4fba-bf8f-8d0178776a34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85123409ec694ca19f2f17288553e0f7, user_id=515d781da6d24c3a82275234b4c4c8b9, role_id=ab4307f3b7994c1c80036fa7db93b6b9)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:11:24.812359 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd41a20-ba50-4fba-bf8f-8d0178776a34 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:11:24.903412 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1434/2870] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Oct 4 12:11:24 2022] PUT /identity/v3/projects/85123409ec694ca19f2f17288553e0f7/users/515d781da6d24c3a82275234b4c4c8b9/roles/ab4307f3b7994c1c80036fa7db93b6b9 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:11:24.974825 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9d4e11-d607-45f0-ae68-f7a244ec64a7 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:11:24.975116 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9d4e11-d607-45f0-ae68-f7a244ec64a7 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:11:24.975389 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9d4e11-d607-45f0-ae68-f7a244ec64a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:11:25.003957 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-cf9d4e11-d607-45f0-ae68-f7a244ec64a7 None None] MFA Rules not processed for user `515d781da6d24c3a82275234b4c4c8b9`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:11:25.005194 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-cf9d4e11-d607-45f0-ae68-f7a244ec64a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:11:25.072987 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1437/2871] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:11:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:11:25.078898 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd41a20-ba50-4fba-bf8f-8d0178776a34 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:11:25.091829 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:11:25.143456 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd41a20-ba50-4fba-bf8f-8d0178776a34 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:11:25.148372 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e490a8-ec0c-477b-a840-5f95cc5838a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:11:25.149903 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e490a8-ec0c-477b-a840-5f95cc5838a4 admin admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:11:25.149903 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e490a8-ec0c-477b-a840-5f95cc5838a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:11:25.149903 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e490a8-ec0c-477b-a840-5f95cc5838a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:11:25.150224 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e490a8-ec0c-477b-a840-5f95cc5838a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:11:25.152132 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e490a8-ec0c-477b-a840-5f95cc5838a4 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:11:25.302009 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1435/2872] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Oct 4 12:11:25 2022] POST /identity/v3/projects => generated 371 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:11:25.305989 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9d4e11-d607-45f0-ae68-f7a244ec64a7 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:11:25.318137 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9d4e11-d607-45f0-ae68-f7a244ec64a7 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:11:25.331593 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:11:25.376750 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a00742-c19b-4467-8ca4-8af1289b790a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:11:25.377357 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a00742-c19b-4467-8ca4-8af1289b790a admin admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:11:25.377635 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a00742-c19b-4467-8ca4-8af1289b790a admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:11:25.377906 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a00742-c19b-4467-8ca4-8af1289b790a admin admin] PATH_INFO: `/v3/users` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:11:25.378543 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a00742-c19b-4467-8ca4-8af1289b790a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:11:25.380500 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a00742-c19b-4467-8ca4-8af1289b790a admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:11:25.828776 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1438/2873] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Oct 4 12:11:25 2022] POST /identity/v3/users => generated 292 bytes in 523 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:11:25.832936 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e490a8-ec0c-477b-a840-5f95cc5838a4 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:11:25.844386 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e490a8-ec0c-477b-a840-5f95cc5838a4 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:11:25.848860 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afed25de-1481-4553-a948-c1a35473a12c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:11:25.849482 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afed25de-1481-4553-a948-c1a35473a12c admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:11:25.849758 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afed25de-1481-4553-a948-c1a35473a12c admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:11:25.850028 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afed25de-1481-4553-a948-c1a35473a12c admin admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:11:25.850661 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afed25de-1481-4553-a948-c1a35473a12c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:11:25.852238 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afed25de-1481-4553-a948-c1a35473a12c admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:11:25.863497 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1436/2874] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:11:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:11:25.867567 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a00742-c19b-4467-8ca4-8af1289b790a admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:11:25.877791 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a00742-c19b-4467-8ca4-8af1289b790a admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:11:25.882907 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3523f597-0fa4-46b2-acaf-ea18315cd4b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:11:25.886984 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3523f597-0fa4-46b2-acaf-ea18315cd4b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:11:25.886984 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3523f597-0fa4-46b2-acaf-ea18315cd4b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:11:25.886984 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3523f597-0fa4-46b2-acaf-ea18315cd4b8 admin admin] PATH_INFO: `/v3/projects/d3a7bf2e7fcf4f6eb81053c710026991/users/b47ff979437d460b8bba7e5a2fb86a82/roles/d6e7421d1ff9451c808004b818354550` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:11:25.898652 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3523f597-0fa4-46b2-acaf-ea18315cd4b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3a7bf2e7fcf4f6eb81053c710026991, user_id=b47ff979437d460b8bba7e5a2fb86a82, role_id=d6e7421d1ff9451c808004b818354550)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:11:25.901367 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3523f597-0fa4-46b2-acaf-ea18315cd4b8 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:11:26.009476 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1439/2875] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Oct 4 12:11:25 2022] PUT /identity/v3/projects/d3a7bf2e7fcf4f6eb81053c710026991/users/b47ff979437d460b8bba7e5a2fb86a82/roles/d6e7421d1ff9451c808004b818354550 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:11:26.013740 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afed25de-1481-4553-a948-c1a35473a12c admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:11:26.024056 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afed25de-1481-4553-a948-c1a35473a12c admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:11:26.081222 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a04a7e-eb31-4c89-8342-c4ee90f16b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:11:26.081833 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a04a7e-eb31-4c89-8342-c4ee90f16b3b admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:11:26.082115 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a04a7e-eb31-4c89-8342-c4ee90f16b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:11:26.082392 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a04a7e-eb31-4c89-8342-c4ee90f16b3b admin admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:11:26.083023 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a04a7e-eb31-4c89-8342-c4ee90f16b3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:11:26.084627 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a04a7e-eb31-4c89-8342-c4ee90f16b3b admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:11:26.094960 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1437/2876] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:11:26 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:11:26.099383 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3523f597-0fa4-46b2-acaf-ea18315cd4b8 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:11:26.111554 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3523f597-0fa4-46b2-acaf-ea18315cd4b8 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:11:26.116368 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e0fb85-71de-40d1-9af2-449a73e29fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:11:26.117041 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e0fb85-71de-40d1-9af2-449a73e29fa4 admin admin] REQUEST_METHOD: `PUT` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:11:26.117323 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e0fb85-71de-40d1-9af2-449a73e29fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:11:26.117603 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e0fb85-71de-40d1-9af2-449a73e29fa4 admin admin] PATH_INFO: `/v3/projects/d3a7bf2e7fcf4f6eb81053c710026991/users/b47ff979437d460b8bba7e5a2fb86a82/roles/d6e7421d1ff9451c808004b818354550` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:11:26.119508 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e0fb85-71de-40d1-9af2-449a73e29fa4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3a7bf2e7fcf4f6eb81053c710026991, user_id=b47ff979437d460b8bba7e5a2fb86a82, role_id=d6e7421d1ff9451c808004b818354550)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:11:26.122463 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e0fb85-71de-40d1-9af2-449a73e29fa4 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:11:26.133304 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1440/2877] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Oct 4 12:11:26 2022] PUT /identity/v3/projects/d3a7bf2e7fcf4f6eb81053c710026991/users/b47ff979437d460b8bba7e5a2fb86a82/roles/d6e7421d1ff9451c808004b818354550 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:11:26.143950 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363fada7-4b50-4fc1-9da4-923b8495c9a9 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:11:26.144458 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363fada7-4b50-4fc1-9da4-923b8495c9a9 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:11:26.144569 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363fada7-4b50-4fc1-9da4-923b8495c9a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:11:26.174210 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-363fada7-4b50-4fc1-9da4-923b8495c9a9 None None] MFA Rules not processed for user `b47ff979437d460b8bba7e5a2fb86a82`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:11:26.175362 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-363fada7-4b50-4fc1-9da4-923b8495c9a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:11:26.243202 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1438/2878] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:11:26 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:11:26.253982 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e0fb85-71de-40d1-9af2-449a73e29fa4 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:11:26.255772 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-b2e0fb85-71de-40d1-9af2-449a73e29fa4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:11:26.318067 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e0fb85-71de-40d1-9af2-449a73e29fa4 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:11:26.321739 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacf4ebe-a2ec-433e-b5f6-76e019712d28 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e2a05b782424ab2928b5864f1bfd556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:11:26.322344 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacf4ebe-a2ec-433e-b5f6-76e019712d28 service cinder] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:11:26.322626 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacf4ebe-a2ec-433e-b5f6-76e019712d28 service cinder] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:11:26.322900 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacf4ebe-a2ec-433e-b5f6-76e019712d28 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:11:26.392879 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacf4ebe-a2ec-433e-b5f6-76e019712d28 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:11:26.394365 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacf4ebe-a2ec-433e-b5f6-76e019712d28 service cinder] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:11:26.404394 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1441/2879] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:11:26 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:11:29.834120 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363fada7-4b50-4fc1-9da4-923b8495c9a9 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:11:29.842915 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:11:29.895771 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363fada7-4b50-4fc1-9da4-923b8495c9a9 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:11:29.900845 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050e51b4-b625-421a-a774-e205878be180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:11:29.901482 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050e51b4-b625-421a-a774-e205878be180 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:11:29.901762 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050e51b4-b625-421a-a774-e205878be180 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:11:29.902038 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050e51b4-b625-421a-a774-e205878be180 admin admin] PATH_INFO: `/v3/users/515d781da6d24c3a82275234b4c4c8b9` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:11:29.903384 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050e51b4-b625-421a-a774-e205878be180 admin admin] RBAC: Authorizing `identity:delete_user(user_id=515d781da6d24c3a82275234b4c4c8b9)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:11:29.905391 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050e51b4-b625-421a-a774-e205878be180 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:11:30.145004 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-050e51b4-b625-421a-a774-e205878be180 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '515d781da6d24c3a82275234b4c4c8b9'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:11:30.151771 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-050e51b4-b625-421a-a774-e205878be180 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '515d781da6d24c3a82275234b4c4c8b9'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:11:30.152457 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-050e51b4-b625-421a-a774-e205878be180 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '515d781da6d24c3a82275234b4c4c8b9'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:11:30.153185 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-050e51b4-b625-421a-a774-e205878be180 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '515d781da6d24c3a82275234b4c4c8b9'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:11:30.259337 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-050e51b4-b625-421a-a774-e205878be180 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '515d781da6d24c3a82275234b4c4c8b9'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:11:30.276892 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1439/2880] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Oct 4 12:11:29 2022] DELETE /identity/v3/users/515d781da6d24c3a82275234b4c4c8b9 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:11:30.281437 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d21456-a117-4e66-8e20-abfe8e3a7167 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:11:30.281944 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d21456-a117-4e66-8e20-abfe8e3a7167 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:11:30.282057 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d21456-a117-4e66-8e20-abfe8e3a7167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:11:30.301416 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-49d21456-a117-4e66-8e20-abfe8e3a7167 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:11:30.302605 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-49d21456-a117-4e66-8e20-abfe8e3a7167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:11:30.321148 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:11:30.361292 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1442/2881] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:11:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:11:30.372196 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050e51b4-b625-421a-a774-e205878be180 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:11:30.373673 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-050e51b4-b625-421a-a774-e205878be180 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:11:30.432817 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050e51b4-b625-421a-a774-e205878be180 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:11:30.437623 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2df5956-22fe-4c6c-bb21-659893344e84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7289515c5c44914a19daa439de98cb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:11:30.438294 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2df5956-22fe-4c6c-bb21-659893344e84 service neutron] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:11:30.438622 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2df5956-22fe-4c6c-bb21-659893344e84 service neutron] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:11:30.438936 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2df5956-22fe-4c6c-bb21-659893344e84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:11:30.448666 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2df5956-22fe-4c6c-bb21-659893344e84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:11:30.450825 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2df5956-22fe-4c6c-bb21-659893344e84 service neutron] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:11:30.460503 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1440/2882] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:11:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:11:30.937817 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d21456-a117-4e66-8e20-abfe8e3a7167 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:11:30.937817 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-49d21456-a117-4e66-8e20-abfe8e3a7167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:11:30.948659 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d21456-a117-4e66-8e20-abfe8e3a7167 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:11:30.953855 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5df8ab4-07ed-46dd-86d1-ed24f78dc7e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:11:30.954488 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5df8ab4-07ed-46dd-86d1-ed24f78dc7e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:11:30.954762 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5df8ab4-07ed-46dd-86d1-ed24f78dc7e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:11:30.955030 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5df8ab4-07ed-46dd-86d1-ed24f78dc7e7 admin admin] PATH_INFO: `/v3/projects/85123409ec694ca19f2f17288553e0f7` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:11:30.956159 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5df8ab4-07ed-46dd-86d1-ed24f78dc7e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85123409ec694ca19f2f17288553e0f7)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:11:30.958285 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5df8ab4-07ed-46dd-86d1-ed24f78dc7e7 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:11:31.138582 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-d5df8ab4-07ed-46dd-86d1-ed24f78dc7e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85123409ec694ca19f2f17288553e0f7', 'request_id': 'req-d5df8ab4-07ed-46dd-86d1-ed24f78dc7e7'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:11:31.268023 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-d5df8ab4-07ed-46dd-86d1-ed24f78dc7e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85123409ec694ca19f2f17288553e0f7', 'request_id': 'req-d5df8ab4-07ed-46dd-86d1-ed24f78dc7e7'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:11:31.274950 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-d5df8ab4-07ed-46dd-86d1-ed24f78dc7e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85123409ec694ca19f2f17288553e0f7', 'request_id': 'req-d5df8ab4-07ed-46dd-86d1-ed24f78dc7e7'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:11:31.286163 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-d5df8ab4-07ed-46dd-86d1-ed24f78dc7e7 admin admin] The token cache is being invalidate because project 85123409ec694ca19f2f17288553e0f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:11:31.286757 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-d5df8ab4-07ed-46dd-86d1-ed24f78dc7e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:11:31.289417 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-d5df8ab4-07ed-46dd-86d1-ed24f78dc7e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:11:31.289417 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1443/2883] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Oct 4 12:11:30 2022] DELETE /identity/v3/projects/85123409ec694ca19f2f17288553e0f7 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:11:31.292682 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2df5956-22fe-4c6c-bb21-659893344e84 service neutron] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:11:31.302304 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2df5956-22fe-4c6c-bb21-659893344e84 service neutron] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:11:31.328227 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:11:31.358213 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91e83b6-8d61-490e-a67b-b46c39956f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:11:31.358999 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91e83b6-8d61-490e-a67b-b46c39956f79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:11:31.359158 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91e83b6-8d61-490e-a67b-b46c39956f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:11:31.359450 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91e83b6-8d61-490e-a67b-b46c39956f79 admin admin] PATH_INFO: `/v3/users/b47ff979437d460b8bba7e5a2fb86a82` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:11:31.360560 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91e83b6-8d61-490e-a67b-b46c39956f79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b47ff979437d460b8bba7e5a2fb86a82)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:11:31.362967 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91e83b6-8d61-490e-a67b-b46c39956f79 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:11:31.593386 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-e91e83b6-8d61-490e-a67b-b46c39956f79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b47ff979437d460b8bba7e5a2fb86a82'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:11:31.600111 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-e91e83b6-8d61-490e-a67b-b46c39956f79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b47ff979437d460b8bba7e5a2fb86a82'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:11:31.600853 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-e91e83b6-8d61-490e-a67b-b46c39956f79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b47ff979437d460b8bba7e5a2fb86a82'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:11:31.601475 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-e91e83b6-8d61-490e-a67b-b46c39956f79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b47ff979437d460b8bba7e5a2fb86a82'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:11:31.725904 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-e91e83b6-8d61-490e-a67b-b46c39956f79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b47ff979437d460b8bba7e5a2fb86a82'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:11:31.744064 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1441/2884] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Oct 4 12:11:31 2022] DELETE /identity/v3/users/b47ff979437d460b8bba7e5a2fb86a82 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:11:32.178863 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5df8ab4-07ed-46dd-86d1-ed24f78dc7e7 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:11:32.180395 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-d5df8ab4-07ed-46dd-86d1-ed24f78dc7e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:11:32.195848 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5df8ab4-07ed-46dd-86d1-ed24f78dc7e7 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:11:32.256194 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af4bb83-0601-4072-b2ab-fff067315403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:11:32.256853 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af4bb83-0601-4072-b2ab-fff067315403 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:11:32.257133 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af4bb83-0601-4072-b2ab-fff067315403 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:11:32.257405 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af4bb83-0601-4072-b2ab-fff067315403 admin admin] PATH_INFO: `/v3/projects/d3a7bf2e7fcf4f6eb81053c710026991` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:11:32.258513 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af4bb83-0601-4072-b2ab-fff067315403 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3a7bf2e7fcf4f6eb81053c710026991)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:11:32.260412 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af4bb83-0601-4072-b2ab-fff067315403 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:11:32.396751 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-1af4bb83-0601-4072-b2ab-fff067315403 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3a7bf2e7fcf4f6eb81053c710026991', 'request_id': 'req-1af4bb83-0601-4072-b2ab-fff067315403'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:11:32.398534 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:11:32.497344 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-1af4bb83-0601-4072-b2ab-fff067315403 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3a7bf2e7fcf4f6eb81053c710026991', 'request_id': 'req-1af4bb83-0601-4072-b2ab-fff067315403'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:11:32.504147 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-1af4bb83-0601-4072-b2ab-fff067315403 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3a7bf2e7fcf4f6eb81053c710026991', 'request_id': 'req-1af4bb83-0601-4072-b2ab-fff067315403'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:11:32.515633 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-1af4bb83-0601-4072-b2ab-fff067315403 admin admin] The token cache is being invalidate because project d3a7bf2e7fcf4f6eb81053c710026991 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:11:32.515941 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-1af4bb83-0601-4072-b2ab-fff067315403 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:11:32.516588 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-1af4bb83-0601-4072-b2ab-fff067315403 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:11:32.518097 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1444/2885] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Oct 4 12:11:32 2022] DELETE /identity/v3/projects/d3a7bf2e7fcf4f6eb81053c710026991 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:11:32.523023 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57491ca-5aee-4ba4-b64e-7d7034faa131 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:11:32.523517 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57491ca-5aee-4ba4-b64e-7d7034faa131 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:11:32.523629 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57491ca-5aee-4ba4-b64e-7d7034faa131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:11:32.543528 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-a57491ca-5aee-4ba4-b64e-7d7034faa131 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:11:32.544752 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-a57491ca-5aee-4ba4-b64e-7d7034faa131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:11:32.601710 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1442/2886] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:11:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 12:11:32.610153 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad29d6f-e716-4430-8403-3afca2075a2a None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:11:32.612686 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad29d6f-e716-4430-8403-3afca2075a2a None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:11:32.612686 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad29d6f-e716-4430-8403-3afca2075a2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:11:32.630780 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-aad29d6f-e716-4430-8403-3afca2075a2a None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:11:32.632002 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-aad29d6f-e716-4430-8403-3afca2075a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:11:32.639859 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1445/2887] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:11:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:11:32.644039 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57491ca-5aee-4ba4-b64e-7d7034faa131 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:11:32.654724 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57491ca-5aee-4ba4-b64e-7d7034faa131 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:11:32.659249 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04215d6d-c3e8-4a15-95c9-0d00a5312b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:11:32.659842 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04215d6d-c3e8-4a15-95c9-0d00a5312b88 admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:11:32.660145 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04215d6d-c3e8-4a15-95c9-0d00a5312b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:11:32.660417 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04215d6d-c3e8-4a15-95c9-0d00a5312b88 admin admin] PATH_INFO: `/v3/domains` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:11:32.661092 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04215d6d-c3e8-4a15-95c9-0d00a5312b88 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:11:32.661397 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04215d6d-c3e8-4a15-95c9-0d00a5312b88 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:11:32.662976 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04215d6d-c3e8-4a15-95c9-0d00a5312b88 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:11:32.675229 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1443/2888] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Oct 4 12:11:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:11:32.679383 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad29d6f-e716-4430-8403-3afca2075a2a None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:11:32.688503 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad29d6f-e716-4430-8403-3afca2075a2a None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:11:32.693064 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa752629-43a4-489c-8152-f1d3b2df0590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:11:32.693648 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa752629-43a4-489c-8152-f1d3b2df0590 admin admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:11:32.693922 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa752629-43a4-489c-8152-f1d3b2df0590 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:11:32.694191 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa752629-43a4-489c-8152-f1d3b2df0590 admin admin] PATH_INFO: `/v3/projects` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:11:32.694814 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa752629-43a4-489c-8152-f1d3b2df0590 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:11:32.696707 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa752629-43a4-489c-8152-f1d3b2df0590 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:11:32.803927 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1446/2889] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Oct 4 12:11:32 2022] POST /identity/v3/projects => generated 375 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 12:11:32.807926 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04215d6d-c3e8-4a15-95c9-0d00a5312b88 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:11:32.818387 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04215d6d-c3e8-4a15-95c9-0d00a5312b88 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:11:32.851333 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:11:32.876550 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5891a21e-86e5-4fd5-8baa-2420cbbf6e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:11:32.877178 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5891a21e-86e5-4fd5-8baa-2420cbbf6e89 admin admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:11:32.877455 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5891a21e-86e5-4fd5-8baa-2420cbbf6e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:11:32.877724 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5891a21e-86e5-4fd5-8baa-2420cbbf6e89 admin admin] PATH_INFO: `/v3/users` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:11:32.878353 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5891a21e-86e5-4fd5-8baa-2420cbbf6e89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:11:32.880247 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5891a21e-86e5-4fd5-8baa-2420cbbf6e89 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:11:32.985033 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1444/2890] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Oct 4 12:11:32 2022] POST /identity/v3/users => generated 288 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:11:32.989529 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa752629-43a4-489c-8152-f1d3b2df0590 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:11:33.000295 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa752629-43a4-489c-8152-f1d3b2df0590 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:11:33.005009 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72cef62-34cd-4aac-af58-cb8a58605e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:11:33.005606 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72cef62-34cd-4aac-af58-cb8a58605e11 admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:11:33.005887 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72cef62-34cd-4aac-af58-cb8a58605e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:11:33.006161 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72cef62-34cd-4aac-af58-cb8a58605e11 admin admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:11:33.006801 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72cef62-34cd-4aac-af58-cb8a58605e11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:11:33.008399 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72cef62-34cd-4aac-af58-cb8a58605e11 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:11:33.018901 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1447/2891] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:11:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:11:33.022845 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5891a21e-86e5-4fd5-8baa-2420cbbf6e89 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:11:33.033591 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5891a21e-86e5-4fd5-8baa-2420cbbf6e89 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:11:33.038750 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ab7f9a-0f7b-4f4f-adc4-3994a13f61ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:11:33.039341 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ab7f9a-0f7b-4f4f-adc4-3994a13f61ed admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:11:33.039616 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ab7f9a-0f7b-4f4f-adc4-3994a13f61ed admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:11:33.039884 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ab7f9a-0f7b-4f4f-adc4-3994a13f61ed admin admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:11:33.040517 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ab7f9a-0f7b-4f4f-adc4-3994a13f61ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:11:33.042229 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ab7f9a-0f7b-4f4f-adc4-3994a13f61ed admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:11:33.055506 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1445/2892] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:11:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:11:33.056695 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72cef62-34cd-4aac-af58-cb8a58605e11 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:11:33.066699 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72cef62-34cd-4aac-af58-cb8a58605e11 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:11:33.071247 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd67924-7f6f-4220-85c8-5b630b3b218d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:11:33.071873 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd67924-7f6f-4220-85c8-5b630b3b218d admin admin] REQUEST_METHOD: `PUT` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:11:33.075353 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd67924-7f6f-4220-85c8-5b630b3b218d admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:11:33.075353 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd67924-7f6f-4220-85c8-5b630b3b218d admin admin] PATH_INFO: `/v3/projects/7a0be5b9afbd48808e44acd793e60dcc/users/0be7de1819a94d819950f34b6d242756/roles/ab4307f3b7994c1c80036fa7db93b6b9` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:11:33.087117 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd67924-7f6f-4220-85c8-5b630b3b218d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a0be5b9afbd48808e44acd793e60dcc, user_id=0be7de1819a94d819950f34b6d242756, role_id=ab4307f3b7994c1c80036fa7db93b6b9)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:11:33.090351 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd67924-7f6f-4220-85c8-5b630b3b218d admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:11:33.188529 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1448/2893] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Oct 4 12:11:33 2022] PUT /identity/v3/projects/7a0be5b9afbd48808e44acd793e60dcc/users/0be7de1819a94d819950f34b6d242756/roles/ab4307f3b7994c1c80036fa7db93b6b9 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:11:33.200749 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9f5274-8f39-40c4-8669-77d875daeab6 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:11:33.201036 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9f5274-8f39-40c4-8669-77d875daeab6 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:11:33.201309 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9f5274-8f39-40c4-8669-77d875daeab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:11:33.229328 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-cb9f5274-8f39-40c4-8669-77d875daeab6 None None] MFA Rules not processed for user `0be7de1819a94d819950f34b6d242756`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:11:33.230884 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-cb9f5274-8f39-40c4-8669-77d875daeab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:11:33.296873 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1446/2894] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:11:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:11:33.301426 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd67924-7f6f-4220-85c8-5b630b3b218d admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:11:33.363337 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd67924-7f6f-4220-85c8-5b630b3b218d admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:11:33.367903 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1988c31-46f9-44be-b017-d80af245e18f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:11:33.368500 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1988c31-46f9-44be-b017-d80af245e18f admin admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:11:33.368832 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1988c31-46f9-44be-b017-d80af245e18f admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:11:33.369093 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1988c31-46f9-44be-b017-d80af245e18f admin admin] PATH_INFO: `/v3/projects` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:11:33.369714 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1988c31-46f9-44be-b017-d80af245e18f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:11:33.372571 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1988c31-46f9-44be-b017-d80af245e18f admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:11:33.475345 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1449/2895] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Oct 4 12:11:33 2022] POST /identity/v3/projects => generated 375 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:11:33.479513 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9f5274-8f39-40c4-8669-77d875daeab6 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:11:33.490975 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9f5274-8f39-40c4-8669-77d875daeab6 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:11:33.547643 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43442234-3548-484c-bc21-2c1ae627de5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:11:33.548255 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43442234-3548-484c-bc21-2c1ae627de5e admin admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:11:33.548519 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43442234-3548-484c-bc21-2c1ae627de5e admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:11:33.548821 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43442234-3548-484c-bc21-2c1ae627de5e admin admin] PATH_INFO: `/v3/users` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:11:33.549446 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43442234-3548-484c-bc21-2c1ae627de5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:11:33.551344 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43442234-3548-484c-bc21-2c1ae627de5e admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:11:33.642091 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1447/2896] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Oct 4 12:11:33 2022] POST /identity/v3/users => generated 288 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:11:33.646070 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1988c31-46f9-44be-b017-d80af245e18f admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:11:33.657087 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1988c31-46f9-44be-b017-d80af245e18f admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:11:33.661642 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68a24a7-00ce-4638-af7d-d0a54804a262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:11:33.662233 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68a24a7-00ce-4638-af7d-d0a54804a262 admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:11:33.662517 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68a24a7-00ce-4638-af7d-d0a54804a262 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:11:33.662787 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68a24a7-00ce-4638-af7d-d0a54804a262 admin admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:11:33.663416 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68a24a7-00ce-4638-af7d-d0a54804a262 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:11:33.665035 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68a24a7-00ce-4638-af7d-d0a54804a262 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:11:33.676279 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1450/2897] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:11:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:11:33.680129 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43442234-3548-484c-bc21-2c1ae627de5e admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:11:33.690551 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43442234-3548-484c-bc21-2c1ae627de5e admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:11:33.695229 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea5de6b-f5c3-445f-b3a3-881d41f40317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:11:33.695852 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea5de6b-f5c3-445f-b3a3-881d41f40317 admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:11:33.696131 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea5de6b-f5c3-445f-b3a3-881d41f40317 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:11:33.696404 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea5de6b-f5c3-445f-b3a3-881d41f40317 admin admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:11:33.697077 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea5de6b-f5c3-445f-b3a3-881d41f40317 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:11:33.698647 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea5de6b-f5c3-445f-b3a3-881d41f40317 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:11:33.709525 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1448/2898] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:11:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:11:33.713531 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68a24a7-00ce-4638-af7d-d0a54804a262 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:11:33.724043 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68a24a7-00ce-4638-af7d-d0a54804a262 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:11:33.728619 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb6b346-0e2b-4a80-a128-c45912d54a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:11:33.729250 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb6b346-0e2b-4a80-a128-c45912d54a79 admin admin] REQUEST_METHOD: `PUT` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:11:33.729527 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb6b346-0e2b-4a80-a128-c45912d54a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:11:33.729799 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb6b346-0e2b-4a80-a128-c45912d54a79 admin admin] PATH_INFO: `/v3/projects/52c6ba4a84604b468bdf2e67953691a6/users/39defca97434464c9a797e1a40f2584c/roles/ab4307f3b7994c1c80036fa7db93b6b9` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:11:33.744378 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb6b346-0e2b-4a80-a128-c45912d54a79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52c6ba4a84604b468bdf2e67953691a6, user_id=39defca97434464c9a797e1a40f2584c, role_id=ab4307f3b7994c1c80036fa7db93b6b9)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:11:33.747150 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb6b346-0e2b-4a80-a128-c45912d54a79 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:11:33.873582 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1451/2899] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Oct 4 12:11:33 2022] PUT /identity/v3/projects/52c6ba4a84604b468bdf2e67953691a6/users/39defca97434464c9a797e1a40f2584c/roles/ab4307f3b7994c1c80036fa7db93b6b9 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:11:33.889242 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459bf9fa-064e-4a3a-a59f-5ca1ee67d143 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:11:33.889572 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459bf9fa-064e-4a3a-a59f-5ca1ee67d143 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:11:33.889899 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459bf9fa-064e-4a3a-a59f-5ca1ee67d143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:11:33.918409 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-459bf9fa-064e-4a3a-a59f-5ca1ee67d143 None None] MFA Rules not processed for user `39defca97434464c9a797e1a40f2584c`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:11:33.919539 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-459bf9fa-064e-4a3a-a59f-5ca1ee67d143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:11:33.929030 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:11:33.982539 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1449/2900] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:11:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:11:34.020643 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb6b346-0e2b-4a80-a128-c45912d54a79 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:11:34.048332 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:INSERT=5,keystone:DELETE=3,keystone:SELECT=92 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:11:34.083327 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb6b346-0e2b-4a80-a128-c45912d54a79 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:11:34.088036 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881669d1-03e0-4c85-8651-915d4dd75f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:11:34.088662 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881669d1-03e0-4c85-8651-915d4dd75f12 admin admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:11:34.088948 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881669d1-03e0-4c85-8651-915d4dd75f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:11:34.089219 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881669d1-03e0-4c85-8651-915d4dd75f12 admin admin] PATH_INFO: `/v3/projects` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:11:34.089961 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881669d1-03e0-4c85-8651-915d4dd75f12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:11:34.092160 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881669d1-03e0-4c85-8651-915d4dd75f12 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:11:34.214922 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1452/2901] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Oct 4 12:11:34 2022] POST /identity/v3/projects => generated 377 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:11:34.219279 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459bf9fa-064e-4a3a-a59f-5ca1ee67d143 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:11:34.230567 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459bf9fa-064e-4a3a-a59f-5ca1ee67d143 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:11:34.286366 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9e3a01-1423-4763-b1c8-f59bb314103f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:11:34.286973 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9e3a01-1423-4763-b1c8-f59bb314103f admin admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:11:34.287254 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9e3a01-1423-4763-b1c8-f59bb314103f admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:11:34.287526 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9e3a01-1423-4763-b1c8-f59bb314103f admin admin] PATH_INFO: `/v3/users` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:11:34.288147 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9e3a01-1423-4763-b1c8-f59bb314103f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:11:34.290076 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9e3a01-1423-4763-b1c8-f59bb314103f admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:11:34.373858 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1450/2902] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Oct 4 12:11:34 2022] POST /identity/v3/users => generated 295 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:11:34.377827 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881669d1-03e0-4c85-8651-915d4dd75f12 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:11:34.388452 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881669d1-03e0-4c85-8651-915d4dd75f12 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:11:34.392995 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17de68de-37c6-4482-8bf9-3cef0ffe3abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:11:34.393583 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17de68de-37c6-4482-8bf9-3cef0ffe3abf admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:11:34.393881 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17de68de-37c6-4482-8bf9-3cef0ffe3abf admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:11:34.394155 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17de68de-37c6-4482-8bf9-3cef0ffe3abf admin admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:11:34.394784 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17de68de-37c6-4482-8bf9-3cef0ffe3abf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:11:34.396368 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17de68de-37c6-4482-8bf9-3cef0ffe3abf admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:11:34.407001 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1453/2903] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:11:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:11:34.411277 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9e3a01-1423-4763-b1c8-f59bb314103f admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:11:34.422414 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9e3a01-1423-4763-b1c8-f59bb314103f admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:11:34.427082 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f615ea7-917c-4686-ab58-9b7860afb78a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:11:34.427741 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f615ea7-917c-4686-ab58-9b7860afb78a admin admin] REQUEST_METHOD: `PUT` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:11:34.428023 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f615ea7-917c-4686-ab58-9b7860afb78a admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:11:34.428301 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f615ea7-917c-4686-ab58-9b7860afb78a admin admin] PATH_INFO: `/v3/projects/c100bce287314187b64814d832e20c26/users/a13510eee609494181a6b0a60a59bb59/roles/d6e7421d1ff9451c808004b818354550` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:11:34.443844 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f615ea7-917c-4686-ab58-9b7860afb78a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c100bce287314187b64814d832e20c26, user_id=a13510eee609494181a6b0a60a59bb59, role_id=d6e7421d1ff9451c808004b818354550)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:11:34.446522 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f615ea7-917c-4686-ab58-9b7860afb78a admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:11:34.534143 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1451/2904] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Oct 4 12:11:34 2022] PUT /identity/v3/projects/c100bce287314187b64814d832e20c26/users/a13510eee609494181a6b0a60a59bb59/roles/d6e7421d1ff9451c808004b818354550 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:11:34.538269 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17de68de-37c6-4482-8bf9-3cef0ffe3abf admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:11:34.549725 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17de68de-37c6-4482-8bf9-3cef0ffe3abf admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:11:34.607273 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5791293d-4fe0-4cdb-9aee-01bec4aa9536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:11:34.607868 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5791293d-4fe0-4cdb-9aee-01bec4aa9536 admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:11:34.608150 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5791293d-4fe0-4cdb-9aee-01bec4aa9536 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:11:34.608421 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5791293d-4fe0-4cdb-9aee-01bec4aa9536 admin admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:11:34.609081 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5791293d-4fe0-4cdb-9aee-01bec4aa9536 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:11:34.610668 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5791293d-4fe0-4cdb-9aee-01bec4aa9536 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:11:34.620252 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1454/2905] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:11:34 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:11:34.625228 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f615ea7-917c-4686-ab58-9b7860afb78a admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:11:34.635630 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f615ea7-917c-4686-ab58-9b7860afb78a admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:11:34.640732 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a11f461-c160-4f07-b441-ca6550e55bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:11:34.641383 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a11f461-c160-4f07-b441-ca6550e55bd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:11:34.641659 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a11f461-c160-4f07-b441-ca6550e55bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:11:34.641930 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a11f461-c160-4f07-b441-ca6550e55bd2 admin admin] PATH_INFO: `/v3/projects/c100bce287314187b64814d832e20c26/users/a13510eee609494181a6b0a60a59bb59/roles/d6e7421d1ff9451c808004b818354550` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:11:34.643972 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a11f461-c160-4f07-b441-ca6550e55bd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c100bce287314187b64814d832e20c26, user_id=a13510eee609494181a6b0a60a59bb59, role_id=d6e7421d1ff9451c808004b818354550)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:11:34.646646 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a11f461-c160-4f07-b441-ca6550e55bd2 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:11:34.656760 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1452/2906] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Oct 4 12:11:34 2022] PUT /identity/v3/projects/c100bce287314187b64814d832e20c26/users/a13510eee609494181a6b0a60a59bb59/roles/d6e7421d1ff9451c808004b818354550 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:11:34.666780 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ef000e-7daa-4ccc-aedf-bcf898c02a52 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:11:34.667064 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ef000e-7daa-4ccc-aedf-bcf898c02a52 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:11:34.667334 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ef000e-7daa-4ccc-aedf-bcf898c02a52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:11:34.695960 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-b0ef000e-7daa-4ccc-aedf-bcf898c02a52 None None] MFA Rules not processed for user `a13510eee609494181a6b0a60a59bb59`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:11:34.697192 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-b0ef000e-7daa-4ccc-aedf-bcf898c02a52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:11:34.764408 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1455/2907] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:11:34 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:11:34.775486 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a11f461-c160-4f07-b441-ca6550e55bd2 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:11:34.777244 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-5a11f461-c160-4f07-b441-ca6550e55bd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:11:34.834458 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a11f461-c160-4f07-b441-ca6550e55bd2 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:11:34.838102 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5338f2-3a5f-498c-9c78-afbc132131c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e2a05b782424ab2928b5864f1bfd556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:11:34.838697 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5338f2-3a5f-498c-9c78-afbc132131c3 service cinder] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:11:34.838977 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5338f2-3a5f-498c-9c78-afbc132131c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:11:34.839248 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5338f2-3a5f-498c-9c78-afbc132131c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:11:34.856762 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:11:34.895219 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5338f2-3a5f-498c-9c78-afbc132131c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:11:34.896714 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5338f2-3a5f-498c-9c78-afbc132131c3 service cinder] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:11:34.906059 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1453/2908] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:11:34 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:11:37.204909 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ef000e-7daa-4ccc-aedf-bcf898c02a52 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:11:37.206338 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-b0ef000e-7daa-4ccc-aedf-bcf898c02a52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:11:37.219422 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ef000e-7daa-4ccc-aedf-bcf898c02a52 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:11:37.222964 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab461683-acb4-421b-939c-4bb423dcacf3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e2a05b782424ab2928b5864f1bfd556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:11:37.223564 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab461683-acb4-421b-939c-4bb423dcacf3 service cinder] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:11:37.223841 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab461683-acb4-421b-939c-4bb423dcacf3 service cinder] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:11:37.224115 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab461683-acb4-421b-939c-4bb423dcacf3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:11:37.241736 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:11:37.280234 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab461683-acb4-421b-939c-4bb423dcacf3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:11:37.281711 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab461683-acb4-421b-939c-4bb423dcacf3 service cinder] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:11:37.290906 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1456/2909] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:11:37 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:11:38.860977 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5338f2-3a5f-498c-9c78-afbc132131c3 service cinder] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:11:38.869870 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5338f2-3a5f-498c-9c78-afbc132131c3 service cinder] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:11:38.873965 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730765c4-96fa-4c24-9b1a-56b716eeb51f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e2a05b782424ab2928b5864f1bfd556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:11:38.874557 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730765c4-96fa-4c24-9b1a-56b716eeb51f service cinder] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:11:38.874833 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730765c4-96fa-4c24-9b1a-56b716eeb51f service cinder] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:11:38.875103 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730765c4-96fa-4c24-9b1a-56b716eeb51f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:11:38.883700 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730765c4-96fa-4c24-9b1a-56b716eeb51f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:11:38.885142 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730765c4-96fa-4c24-9b1a-56b716eeb51f service cinder] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:11:38.894926 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1454/2910] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:11:38 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:11:43.820873 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab461683-acb4-421b-939c-4bb423dcacf3 service cinder] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:11:43.883590 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab461683-acb4-421b-939c-4bb423dcacf3 service cinder] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:11:43.888801 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d3522e-6916-4462-925c-8212e14acc84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:11:43.889425 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d3522e-6916-4462-925c-8212e14acc84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:11:43.889706 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d3522e-6916-4462-925c-8212e14acc84 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:11:43.889992 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d3522e-6916-4462-925c-8212e14acc84 admin admin] PATH_INFO: `/v3/users/0be7de1819a94d819950f34b6d242756` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:11:43.891100 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d3522e-6916-4462-925c-8212e14acc84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0be7de1819a94d819950f34b6d242756)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:11:43.893178 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d3522e-6916-4462-925c-8212e14acc84 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:11:44.111485 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-22d3522e-6916-4462-925c-8212e14acc84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0be7de1819a94d819950f34b6d242756'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:11:44.118546 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-22d3522e-6916-4462-925c-8212e14acc84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0be7de1819a94d819950f34b6d242756'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:11:44.119200 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-22d3522e-6916-4462-925c-8212e14acc84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0be7de1819a94d819950f34b6d242756'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:11:44.119794 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-22d3522e-6916-4462-925c-8212e14acc84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0be7de1819a94d819950f34b6d242756'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:11:44.207533 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-22d3522e-6916-4462-925c-8212e14acc84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0be7de1819a94d819950f34b6d242756'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:11:44.225660 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1457/2911] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Oct 4 12:11:43 2022] DELETE /identity/v3/users/0be7de1819a94d819950f34b6d242756 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:11:44.230838 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc5cd9c-e86c-4cd0-bcff-8e3215f1ffac None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:11:44.238658 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc5cd9c-e86c-4cd0-bcff-8e3215f1ffac None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:11:44.238658 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc5cd9c-e86c-4cd0-bcff-8e3215f1ffac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:11:44.252270 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-9dc5cd9c-e86c-4cd0-bcff-8e3215f1ffac None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:11:44.253501 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-9dc5cd9c-e86c-4cd0-bcff-8e3215f1ffac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:11:44.311356 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1455/2912] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:11:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:11:44.321241 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d3522e-6916-4462-925c-8212e14acc84 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:11:44.323215 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-22d3522e-6916-4462-925c-8212e14acc84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:11:44.365688 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:11:44.380675 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d3522e-6916-4462-925c-8212e14acc84 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:11:44.384204 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50359d4-f423-4deb-80de-ddbf2a2f2831 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7289515c5c44914a19daa439de98cb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:11:44.384836 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50359d4-f423-4deb-80de-ddbf2a2f2831 service neutron] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:11:44.385115 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50359d4-f423-4deb-80de-ddbf2a2f2831 service neutron] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:11:44.385387 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50359d4-f423-4deb-80de-ddbf2a2f2831 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:11:44.395090 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50359d4-f423-4deb-80de-ddbf2a2f2831 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:11:44.396510 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50359d4-f423-4deb-80de-ddbf2a2f2831 service neutron] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:11:44.406605 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1458/2913] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:11:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:11:44.803082 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc5cd9c-e86c-4cd0-bcff-8e3215f1ffac None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:11:44.804653 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-9dc5cd9c-e86c-4cd0-bcff-8e3215f1ffac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:11:44.818085 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc5cd9c-e86c-4cd0-bcff-8e3215f1ffac None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:11:44.823002 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505f4eb9-8a51-4121-91b3-7d6fd599fb9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:11:44.824257 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505f4eb9-8a51-4121-91b3-7d6fd599fb9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:11:44.824544 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505f4eb9-8a51-4121-91b3-7d6fd599fb9c admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:11:44.824839 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505f4eb9-8a51-4121-91b3-7d6fd599fb9c admin admin] PATH_INFO: `/v3/projects/7a0be5b9afbd48808e44acd793e60dcc` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:11:44.825996 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505f4eb9-8a51-4121-91b3-7d6fd599fb9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a0be5b9afbd48808e44acd793e60dcc)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:11:44.827900 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505f4eb9-8a51-4121-91b3-7d6fd599fb9c admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:11:44.943772 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-505f4eb9-8a51-4121-91b3-7d6fd599fb9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a0be5b9afbd48808e44acd793e60dcc', 'request_id': 'req-505f4eb9-8a51-4121-91b3-7d6fd599fb9c'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:11:44.950106 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-505f4eb9-8a51-4121-91b3-7d6fd599fb9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a0be5b9afbd48808e44acd793e60dcc', 'request_id': 'req-505f4eb9-8a51-4121-91b3-7d6fd599fb9c'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:11:45.047008 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-505f4eb9-8a51-4121-91b3-7d6fd599fb9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a0be5b9afbd48808e44acd793e60dcc', 'request_id': 'req-505f4eb9-8a51-4121-91b3-7d6fd599fb9c'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:11:45.059329 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-505f4eb9-8a51-4121-91b3-7d6fd599fb9c admin admin] The token cache is being invalidate because project 7a0be5b9afbd48808e44acd793e60dcc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:11:45.059617 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-505f4eb9-8a51-4121-91b3-7d6fd599fb9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:11:45.060404 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-505f4eb9-8a51-4121-91b3-7d6fd599fb9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:11:45.062503 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1456/2914] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Oct 4 12:11:44 2022] DELETE /identity/v3/projects/7a0be5b9afbd48808e44acd793e60dcc => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:11:45.066161 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50359d4-f423-4deb-80de-ddbf2a2f2831 service neutron] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:11:45.076750 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50359d4-f423-4deb-80de-ddbf2a2f2831 service neutron] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:11:45.132592 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55a4f80-9006-47f5-81ed-936b26cad29c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:11:45.133245 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55a4f80-9006-47f5-81ed-936b26cad29c admin admin] REQUEST_METHOD: `DELETE` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:11:45.133524 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55a4f80-9006-47f5-81ed-936b26cad29c admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:11:45.133799 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55a4f80-9006-47f5-81ed-936b26cad29c admin admin] PATH_INFO: `/v3/users/39defca97434464c9a797e1a40f2584c` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:11:45.134932 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55a4f80-9006-47f5-81ed-936b26cad29c admin admin] RBAC: Authorizing `identity:delete_user(user_id=39defca97434464c9a797e1a40f2584c)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:11:45.137552 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55a4f80-9006-47f5-81ed-936b26cad29c admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:11:45.298975 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-f55a4f80-9006-47f5-81ed-936b26cad29c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39defca97434464c9a797e1a40f2584c'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:11:45.306050 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-f55a4f80-9006-47f5-81ed-936b26cad29c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39defca97434464c9a797e1a40f2584c'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:11:45.306760 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-f55a4f80-9006-47f5-81ed-936b26cad29c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39defca97434464c9a797e1a40f2584c'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:11:45.307371 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-f55a4f80-9006-47f5-81ed-936b26cad29c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39defca97434464c9a797e1a40f2584c'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:11:45.393931 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-f55a4f80-9006-47f5-81ed-936b26cad29c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39defca97434464c9a797e1a40f2584c'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:11:45.411795 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1459/2915] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Oct 4 12:11:45 2022] DELETE /identity/v3/users/39defca97434464c9a797e1a40f2584c => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:11:45.918724 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505f4eb9-8a51-4121-91b3-7d6fd599fb9c admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:11:45.920203 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-505f4eb9-8a51-4121-91b3-7d6fd599fb9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:11:45.934642 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505f4eb9-8a51-4121-91b3-7d6fd599fb9c admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:11:45.964726 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:11:45.994157 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf96c6d-261e-437e-aae1-05a99221c207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:11:46.005977 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf96c6d-261e-437e-aae1-05a99221c207 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:11:46.005977 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf96c6d-261e-437e-aae1-05a99221c207 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:11:46.005977 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf96c6d-261e-437e-aae1-05a99221c207 admin admin] PATH_INFO: `/v3/projects/52c6ba4a84604b468bdf2e67953691a6` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:11:46.005977 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf96c6d-261e-437e-aae1-05a99221c207 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52c6ba4a84604b468bdf2e67953691a6)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:11:46.005977 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf96c6d-261e-437e-aae1-05a99221c207 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:11:46.109450 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-fdf96c6d-261e-437e-aae1-05a99221c207 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52c6ba4a84604b468bdf2e67953691a6', 'request_id': 'req-fdf96c6d-261e-437e-aae1-05a99221c207'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:11:46.116426 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-fdf96c6d-261e-437e-aae1-05a99221c207 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52c6ba4a84604b468bdf2e67953691a6', 'request_id': 'req-fdf96c6d-261e-437e-aae1-05a99221c207'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:11:46.290958 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-fdf96c6d-261e-437e-aae1-05a99221c207 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52c6ba4a84604b468bdf2e67953691a6', 'request_id': 'req-fdf96c6d-261e-437e-aae1-05a99221c207'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:11:46.302551 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-fdf96c6d-261e-437e-aae1-05a99221c207 admin admin] The token cache is being invalidate because project 52c6ba4a84604b468bdf2e67953691a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:11:46.306142 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-fdf96c6d-261e-437e-aae1-05a99221c207 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:11:46.306142 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-fdf96c6d-261e-437e-aae1-05a99221c207 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:11:46.306142 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1457/2916] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Oct 4 12:11:45 2022] DELETE /identity/v3/projects/52c6ba4a84604b468bdf2e67953691a6 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:11:46.309145 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55a4f80-9006-47f5-81ed-936b26cad29c admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:11:46.310612 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-f55a4f80-9006-47f5-81ed-936b26cad29c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:11:46.323582 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55a4f80-9006-47f5-81ed-936b26cad29c admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:11:46.380886 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad582ab8-f1a7-4dce-b7ac-48e970392ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:11:46.381514 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad582ab8-f1a7-4dce-b7ac-48e970392ba5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:11:46.381796 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad582ab8-f1a7-4dce-b7ac-48e970392ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:11:46.382073 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad582ab8-f1a7-4dce-b7ac-48e970392ba5 admin admin] PATH_INFO: `/v3/users/a13510eee609494181a6b0a60a59bb59` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:11:46.383191 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad582ab8-f1a7-4dce-b7ac-48e970392ba5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a13510eee609494181a6b0a60a59bb59)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:11:46.385165 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad582ab8-f1a7-4dce-b7ac-48e970392ba5 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:11:46.386818 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:11:46.643142 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-ad582ab8-f1a7-4dce-b7ac-48e970392ba5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a13510eee609494181a6b0a60a59bb59'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:11:46.649907 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-ad582ab8-f1a7-4dce-b7ac-48e970392ba5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a13510eee609494181a6b0a60a59bb59'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:11:46.650557 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-ad582ab8-f1a7-4dce-b7ac-48e970392ba5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a13510eee609494181a6b0a60a59bb59'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:11:46.651145 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-ad582ab8-f1a7-4dce-b7ac-48e970392ba5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a13510eee609494181a6b0a60a59bb59'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:11:46.733098 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-ad582ab8-f1a7-4dce-b7ac-48e970392ba5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a13510eee609494181a6b0a60a59bb59'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:11:46.750664 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1460/2917] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Oct 4 12:11:46 2022] DELETE /identity/v3/users/a13510eee609494181a6b0a60a59bb59 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:11:47.201060 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf96c6d-261e-437e-aae1-05a99221c207 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:11:47.202579 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-fdf96c6d-261e-437e-aae1-05a99221c207 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:11:47.216574 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf96c6d-261e-437e-aae1-05a99221c207 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:11:47.280252 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db28697e-2cee-4096-85d3-da9dcffea792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:11:47.280926 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db28697e-2cee-4096-85d3-da9dcffea792 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:11:47.281201 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db28697e-2cee-4096-85d3-da9dcffea792 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:11:47.281469 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db28697e-2cee-4096-85d3-da9dcffea792 admin admin] PATH_INFO: `/v3/projects/c100bce287314187b64814d832e20c26` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:11:47.282638 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db28697e-2cee-4096-85d3-da9dcffea792 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c100bce287314187b64814d832e20c26)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:11:47.284531 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db28697e-2cee-4096-85d3-da9dcffea792 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:11:47.445187 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-db28697e-2cee-4096-85d3-da9dcffea792 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c100bce287314187b64814d832e20c26', 'request_id': 'req-db28697e-2cee-4096-85d3-da9dcffea792'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:11:47.453523 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-db28697e-2cee-4096-85d3-da9dcffea792 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c100bce287314187b64814d832e20c26', 'request_id': 'req-db28697e-2cee-4096-85d3-da9dcffea792'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:11:47.550350 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-db28697e-2cee-4096-85d3-da9dcffea792 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c100bce287314187b64814d832e20c26', 'request_id': 'req-db28697e-2cee-4096-85d3-da9dcffea792'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:11:47.551908 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:11:47.562413 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-db28697e-2cee-4096-85d3-da9dcffea792 admin admin] The token cache is being invalidate because project c100bce287314187b64814d832e20c26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:11:47.564970 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-db28697e-2cee-4096-85d3-da9dcffea792 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:11:47.564970 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-db28697e-2cee-4096-85d3-da9dcffea792 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:11:47.564970 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1458/2918] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Oct 4 12:11:47 2022] DELETE /identity/v3/projects/c100bce287314187b64814d832e20c26 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:11:47.569738 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145128e3-fba5-4a4c-82ab-01464d0e1359 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:11:47.570205 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145128e3-fba5-4a4c-82ab-01464d0e1359 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:11:47.570312 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145128e3-fba5-4a4c-82ab-01464d0e1359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:11:47.592263 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-145128e3-fba5-4a4c-82ab-01464d0e1359 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:11:47.594364 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-145128e3-fba5-4a4c-82ab-01464d0e1359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:11:47.653347 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1461/2919] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:11:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:11:47.661636 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f3aa7e-8c35-43e5-81de-80f7dcf7644d None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:11:47.663870 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f3aa7e-8c35-43e5-81de-80f7dcf7644d None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:11:47.663870 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f3aa7e-8c35-43e5-81de-80f7dcf7644d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:11:47.682159 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-82f3aa7e-8c35-43e5-81de-80f7dcf7644d None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:11:47.683645 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-82f3aa7e-8c35-43e5-81de-80f7dcf7644d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:11:47.691461 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1459/2920] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:11:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:11:47.696052 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145128e3-fba5-4a4c-82ab-01464d0e1359 None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:11:47.706138 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145128e3-fba5-4a4c-82ab-01464d0e1359 None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:11:47.710718 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570dd93b-a2c1-409c-a213-cdcd8cc8b97b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:11:47.711340 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570dd93b-a2c1-409c-a213-cdcd8cc8b97b admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:11:47.711614 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570dd93b-a2c1-409c-a213-cdcd8cc8b97b admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:11:47.711882 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570dd93b-a2c1-409c-a213-cdcd8cc8b97b admin admin] PATH_INFO: `/v3/domains` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:11:47.712586 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570dd93b-a2c1-409c-a213-cdcd8cc8b97b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:11:47.712957 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570dd93b-a2c1-409c-a213-cdcd8cc8b97b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:11:47.715124 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570dd93b-a2c1-409c-a213-cdcd8cc8b97b admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:11:47.727043 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1462/2921] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Oct 4 12:11:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:11:47.731893 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f3aa7e-8c35-43e5-81de-80f7dcf7644d None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:11:47.741781 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f3aa7e-8c35-43e5-81de-80f7dcf7644d None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:11:47.746401 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5883325d-dcb0-4219-b3d9-574a2f643175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:11:47.746990 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5883325d-dcb0-4219-b3d9-574a2f643175 admin admin] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:11:47.747274 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5883325d-dcb0-4219-b3d9-574a2f643175 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:11:47.747545 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5883325d-dcb0-4219-b3d9-574a2f643175 admin admin] PATH_INFO: `/v3/projects` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:11:47.748170 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5883325d-dcb0-4219-b3d9-574a2f643175 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:11:47.750074 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5883325d-dcb0-4219-b3d9-574a2f643175 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:11:47.844324 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1460/2922] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Oct 4 12:11:47 2022] POST /identity/v3/projects => generated 375 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:11:47.848488 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570dd93b-a2c1-409c-a213-cdcd8cc8b97b admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:11:47.859571 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570dd93b-a2c1-409c-a213-cdcd8cc8b97b admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:11:47.914253 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db691a2e-7fc3-4fa6-a6e7-d536dcbc3c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:11:47.914849 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db691a2e-7fc3-4fa6-a6e7-d536dcbc3c73 admin admin] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:11:47.915123 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db691a2e-7fc3-4fa6-a6e7-d536dcbc3c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:11:47.915387 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db691a2e-7fc3-4fa6-a6e7-d536dcbc3c73 admin admin] PATH_INFO: `/v3/users` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:11:47.916010 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db691a2e-7fc3-4fa6-a6e7-d536dcbc3c73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:11:47.918662 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db691a2e-7fc3-4fa6-a6e7-d536dcbc3c73 admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:11:47.929635 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:11:48.036197 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1463/2923] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Oct 4 12:11:47 2022] POST /identity/v3/users => generated 288 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:11:48.040654 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5883325d-dcb0-4219-b3d9-574a2f643175 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:11:48.051096 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5883325d-dcb0-4219-b3d9-574a2f643175 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:11:48.055651 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79fafd2-bdc5-4b9a-b04d-4494acf382b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:11:48.056297 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79fafd2-bdc5-4b9a-b04d-4494acf382b3 admin admin] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:11:48.056580 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79fafd2-bdc5-4b9a-b04d-4494acf382b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:11:48.056890 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79fafd2-bdc5-4b9a-b04d-4494acf382b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:11:48.057530 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79fafd2-bdc5-4b9a-b04d-4494acf382b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:11:48.059151 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79fafd2-bdc5-4b9a-b04d-4494acf382b3 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:11:48.069792 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1461/2924] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:11:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:11:48.077075 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db691a2e-7fc3-4fa6-a6e7-d536dcbc3c73 admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:11:48.086872 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db691a2e-7fc3-4fa6-a6e7-d536dcbc3c73 admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:11:48.092534 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028d78c8-d64c-4973-ae50-9d406fd0729b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:11:48.093331 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028d78c8-d64c-4973-ae50-9d406fd0729b admin admin] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:11:48.094002 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028d78c8-d64c-4973-ae50-9d406fd0729b admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:11:48.094399 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028d78c8-d64c-4973-ae50-9d406fd0729b admin admin] PATH_INFO: `/v3/roles` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:11:48.095099 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028d78c8-d64c-4973-ae50-9d406fd0729b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:11:48.096696 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028d78c8-d64c-4973-ae50-9d406fd0729b admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:11:48.107316 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1464/2925] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Oct 4 12:11:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:11:48.111464 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79fafd2-bdc5-4b9a-b04d-4494acf382b3 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:11:48.121683 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79fafd2-bdc5-4b9a-b04d-4494acf382b3 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:11:48.126459 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c2522c-f0cc-448d-869d-e21523a2f748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:11:48.127109 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c2522c-f0cc-448d-869d-e21523a2f748 admin admin] REQUEST_METHOD: `PUT` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:11:48.127388 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c2522c-f0cc-448d-869d-e21523a2f748 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:11:48.127665 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c2522c-f0cc-448d-869d-e21523a2f748 admin admin] PATH_INFO: `/v3/projects/42171d0e6d7c478bb45a1d49d4f20f94/users/34120a5683ed4102bcd6be7de8e46be9/roles/ab4307f3b7994c1c80036fa7db93b6b9` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:11:48.142741 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c2522c-f0cc-448d-869d-e21523a2f748 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42171d0e6d7c478bb45a1d49d4f20f94, user_id=34120a5683ed4102bcd6be7de8e46be9, role_id=ab4307f3b7994c1c80036fa7db93b6b9)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:11:48.145508 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c2522c-f0cc-448d-869d-e21523a2f748 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:11:48.287324 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1462/2926] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Oct 4 12:11:48 2022] PUT /identity/v3/projects/42171d0e6d7c478bb45a1d49d4f20f94/users/34120a5683ed4102bcd6be7de8e46be9/roles/ab4307f3b7994c1c80036fa7db93b6b9 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:11:48.297510 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb46b2c-01e9-4072-8635-665eedf19c42 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:11:48.299656 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb46b2c-01e9-4072-8635-665eedf19c42 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:11:48.299656 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb46b2c-01e9-4072-8635-665eedf19c42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:11:48.325673 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-8bb46b2c-01e9-4072-8635-665eedf19c42 None None] MFA Rules not processed for user `34120a5683ed4102bcd6be7de8e46be9`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:11:48.326859 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-8bb46b2c-01e9-4072-8635-665eedf19c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:11:48.389801 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1465/2927] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:11:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:11:48.400373 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c2522c-f0cc-448d-869d-e21523a2f748 admin admin] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:11:48.402759 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-54c2522c-f0cc-448d-869d-e21523a2f748 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:11:48.460341 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c2522c-f0cc-448d-869d-e21523a2f748 admin admin] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:11:48.463911 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c87ee4a-aeaf-4b9a-b5d9-59569d39d8bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e2a05b782424ab2928b5864f1bfd556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:11:48.464862 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c87ee4a-aeaf-4b9a-b5d9-59569d39d8bf service cinder] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:11:48.465143 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c87ee4a-aeaf-4b9a-b5d9-59569d39d8bf service cinder] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:11:48.465416 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c87ee4a-aeaf-4b9a-b5d9-59569d39d8bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:11:48.473428 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c87ee4a-aeaf-4b9a-b5d9-59569d39d8bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:11:48.474839 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c87ee4a-aeaf-4b9a-b5d9-59569d39d8bf service cinder] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:11:48.483443 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1463/2928] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:11:48 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:11:50.506384 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd85ecb7-b5be-404a-b8d0-d46de056448a None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:11:50.509361 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd85ecb7-b5be-404a-b8d0-d46de056448a None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:11:50.509361 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd85ecb7-b5be-404a-b8d0-d46de056448a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:11:50.526343 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-bd85ecb7-b5be-404a-b8d0-d46de056448a None None] MFA Rules not processed for user `34120a5683ed4102bcd6be7de8e46be9`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:11:50.527401 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-bd85ecb7-b5be-404a-b8d0-d46de056448a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:11:50.534341 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1466/2929] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:11:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:11:50.572213 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c87ee4a-aeaf-4b9a-b5d9-59569d39d8bf service cinder] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:11:50.573731 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-0c87ee4a-aeaf-4b9a-b5d9-59569d39d8bf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:11:50.630561 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c87ee4a-aeaf-4b9a-b5d9-59569d39d8bf service cinder] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:11:50.634100 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c48e2c-1b96-4eb4-bc6a-ca4a000e6539 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd516d0755be84b7293156625df1b13b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:11:50.634693 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c48e2c-1b96-4eb4-bc6a-ca4a000e6539 service glance] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:11:50.634969 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c48e2c-1b96-4eb4-bc6a-ca4a000e6539 service glance] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:11:50.635238 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c48e2c-1b96-4eb4-bc6a-ca4a000e6539 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:11:50.637039 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-e2c48e2c-1b96-4eb4-bc6a-ca4a000e6539 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:11:50.678936 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:DELETE=2,keystone:SELECT=96,keystone:INSERT=2 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:11:50.707045 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c48e2c-1b96-4eb4-bc6a-ca4a000e6539 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:11:50.708473 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c48e2c-1b96-4eb4-bc6a-ca4a000e6539 service glance] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:11:50.720423 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1464/2930] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:11:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:11:51.289852 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd85ecb7-b5be-404a-b8d0-d46de056448a None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:11:51.294335 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-bd85ecb7-b5be-404a-b8d0-d46de056448a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:11:51.299511 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c48e2c-1b96-4eb4-bc6a-ca4a000e6539 service glance] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:11:51.301011 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-e2c48e2c-1b96-4eb4-bc6a-ca4a000e6539 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:11:51.360105 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c48e2c-1b96-4eb4-bc6a-ca4a000e6539 service glance] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:11:51.363952 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9c6ae4-a21b-4e8f-9df0-b3eeefcb5632 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7289515c5c44914a19daa439de98cb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:11:51.364579 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9c6ae4-a21b-4e8f-9df0-b3eeefcb5632 service neutron] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:11:51.364715 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd85ecb7-b5be-404a-b8d0-d46de056448a None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:11:51.364881 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9c6ae4-a21b-4e8f-9df0-b3eeefcb5632 service neutron] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:11:51.365165 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9c6ae4-a21b-4e8f-9df0-b3eeefcb5632 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:11:51.366831 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-0b9c6ae4-a21b-4e8f-9df0-b3eeefcb5632 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:11:51.369918 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b77c61e-6693-41a1-8eec-52b471cc5d97 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be119968b02440adbbbc85c553077b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:11:51.371054 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b77c61e-6693-41a1-8eec-52b471cc5d97 service placement] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:11:51.371339 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b77c61e-6693-41a1-8eec-52b471cc5d97 service placement] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:11:51.371625 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b77c61e-6693-41a1-8eec-52b471cc5d97 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:11:51.373410 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-0b77c61e-6693-41a1-8eec-52b471cc5d97 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:11:51.381998 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9c6ae4-a21b-4e8f-9df0-b3eeefcb5632 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:11:51.383401 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9c6ae4-a21b-4e8f-9df0-b3eeefcb5632 service neutron] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:11:51.385130 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b77c61e-6693-41a1-8eec-52b471cc5d97 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:11:51.387364 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b77c61e-6693-41a1-8eec-52b471cc5d97 service placement] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:11:51.395018 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1465/2931] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:11:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:11:51.398421 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1467/2932] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:11:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:11:55.350895 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9c6ae4-a21b-4e8f-9df0-b3eeefcb5632 service neutron] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:11:55.360309 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9c6ae4-a21b-4e8f-9df0-b3eeefcb5632 service neutron] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:11:55.364366 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792d816f-f437-48eb-870b-5520a69eac40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7289515c5c44914a19daa439de98cb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:11:55.365066 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792d816f-f437-48eb-870b-5520a69eac40 service neutron] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:11:55.365343 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792d816f-f437-48eb-870b-5520a69eac40 service neutron] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:11:55.365741 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792d816f-f437-48eb-870b-5520a69eac40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:11:55.367564 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-792d816f-f437-48eb-870b-5520a69eac40 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:11:55.378563 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792d816f-f437-48eb-870b-5520a69eac40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:11:55.380011 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792d816f-f437-48eb-870b-5520a69eac40 service neutron] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:11:55.389357 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1466/2933] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:11:55 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:12:01.394058 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=74 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:12:05.384321 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=46 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:12:09.869011 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9c116c-bc24-4189-b7bd-69480250484e None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:12:09.869576 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9c116c-bc24-4189-b7bd-69480250484e None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:12:09.870034 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9c116c-bc24-4189-b7bd-69480250484e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:12:09.929285 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-bd9c116c-bc24-4189-b7bd-69480250484e None None] MFA Rules not processed for user `06d1850ea27c483780eed67ede9cc1e3`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:12:09.930478 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-bd9c116c-bc24-4189-b7bd-69480250484e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:12:09.994959 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1468/2934] 10.222.0.59 () {58 vars in 1009 bytes} [Tue Oct 4 12:12:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:12:10.217208 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792d816f-f437-48eb-870b-5520a69eac40 service neutron] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:12:10.218613 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-792d816f-f437-48eb-870b-5520a69eac40 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:12:10.310239 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792d816f-f437-48eb-870b-5520a69eac40 service neutron] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:12:10.315186 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c70f698-ac76-47c9-b4a4-0f12b688f330 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1605c3e03b7a4bcba4e19f0d92c671bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:12:10.315821 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c70f698-ac76-47c9-b4a4-0f12b688f330 service swift] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:12:10.316102 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c70f698-ac76-47c9-b4a4-0f12b688f330 service swift] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:12:10.316374 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c70f698-ac76-47c9-b4a4-0f12b688f330 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:12:10.324572 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c70f698-ac76-47c9-b4a4-0f12b688f330 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:12:10.326161 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c70f698-ac76-47c9-b4a4-0f12b688f330 service swift] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:12:10.334196 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1467/2935] 10.222.0.59 () {60 vars in 1384 bytes} [Tue Oct 4 12:12:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 12:12:11.293828 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4291a28-55c6-4a65-a7a1-157a0f32a1e6 None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:12:11.294343 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4291a28-55c6-4a65-a7a1-157a0f32a1e6 None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:12:11.294441 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4291a28-55c6-4a65-a7a1-157a0f32a1e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:12:11.313908 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-b4291a28-55c6-4a65-a7a1-157a0f32a1e6 None None] MFA Rules not processed for user `06d1850ea27c483780eed67ede9cc1e3`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:12:11.315087 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-b4291a28-55c6-4a65-a7a1-157a0f32a1e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:12:11.322179 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1469/2936] 10.222.0.59 () {58 vars in 967 bytes} [Tue Oct 4 12:12:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:12:11.336419 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c70f698-ac76-47c9-b4a4-0f12b688f330 service swift] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:12:11.345644 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c70f698-ac76-47c9-b4a4-0f12b688f330 service swift] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:12:11.350602 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadcc237-9a7b-49f2-aaca-52775e48ab7a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1605c3e03b7a4bcba4e19f0d92c671bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:12:11.351192 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadcc237-9a7b-49f2-aaca-52775e48ab7a service swift] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:12:11.351558 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadcc237-9a7b-49f2-aaca-52775e48ab7a service swift] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:12:11.351761 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadcc237-9a7b-49f2-aaca-52775e48ab7a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:12:11.359647 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadcc237-9a7b-49f2-aaca-52775e48ab7a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:12:11.361249 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadcc237-9a7b-49f2-aaca-52775e48ab7a service swift] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:12:11.369965 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1468/2937] 10.222.0.59 () {60 vars in 1384 bytes} [Tue Oct 4 12:12:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 12:12:12.173474 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6710af67-4ad9-4b7f-9416-e3001291dcdf None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:12:12.173759 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6710af67-4ad9-4b7f-9416-e3001291dcdf None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:12:12.174032 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6710af67-4ad9-4b7f-9416-e3001291dcdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:12:12.194745 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-6710af67-4ad9-4b7f-9416-e3001291dcdf None None] MFA Rules not processed for user `06d1850ea27c483780eed67ede9cc1e3`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:12:12.195935 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-6710af67-4ad9-4b7f-9416-e3001291dcdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:12:12.203281 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1470/2938] 10.222.0.59 () {58 vars in 1009 bytes} [Tue Oct 4 12:12:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:12:12.216903 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadcc237-9a7b-49f2-aaca-52775e48ab7a service swift] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:12:12.227378 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadcc237-9a7b-49f2-aaca-52775e48ab7a service swift] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:12:12.233470 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cf3b4a-94a8-48c6-a267-e6012ea146f9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1605c3e03b7a4bcba4e19f0d92c671bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:12:12.234092 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cf3b4a-94a8-48c6-a267-e6012ea146f9 service swift] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:12:12.234396 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cf3b4a-94a8-48c6-a267-e6012ea146f9 service swift] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:12:12.234668 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cf3b4a-94a8-48c6-a267-e6012ea146f9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:12:12.242808 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cf3b4a-94a8-48c6-a267-e6012ea146f9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:12:12.244977 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cf3b4a-94a8-48c6-a267-e6012ea146f9 service swift] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:12:12.252870 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1469/2939] 10.222.0.59 () {60 vars in 1384 bytes} [Tue Oct 4 12:12:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 12:12:12.996205 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fda3325-0249-4afc-b20d-4aadcd1c444a None None] REQUEST_METHOD: `POST` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:12:12.996747 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fda3325-0249-4afc-b20d-4aadcd1c444a None None] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:12:12.996853 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fda3325-0249-4afc-b20d-4aadcd1c444a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:12:13.015826 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.auth.core [None req-5fda3325-0249-4afc-b20d-4aadcd1c444a None None] MFA Rules not processed for user `06d1850ea27c483780eed67ede9cc1e3`. Rule list: `[]` (Enabled: `True`). {{(pid=98475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:12:13.016971 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-5fda3325-0249-4afc-b20d-4aadcd1c444a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:12:13.023994 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1471/2940] 10.222.0.59 () {58 vars in 967 bytes} [Tue Oct 4 12:12:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:12:13.037121 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cf3b4a-94a8-48c6-a267-e6012ea146f9 service swift] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:12:13.047606 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cf3b4a-94a8-48c6-a267-e6012ea146f9 service swift] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:12:13.052651 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a1861a-b500-4421-a9eb-ddb688f209ac service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1605c3e03b7a4bcba4e19f0d92c671bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:12:13.053238 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a1861a-b500-4421-a9eb-ddb688f209ac service swift] REQUEST_METHOD: `GET` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:12:13.053515 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a1861a-b500-4421-a9eb-ddb688f209ac service swift] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:12:13.053782 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a1861a-b500-4421-a9eb-ddb688f209ac service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:12:13.062181 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a1861a-b500-4421-a9eb-ddb688f209ac service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:12:13.063743 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a1861a-b500-4421-a9eb-ddb688f209ac service swift] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:12:13.071674 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1470/2941] 10.222.0.59 () {60 vars in 1384 bytes} [Tue Oct 4 12:12:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 12:12:15.956019 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fda3325-0249-4afc-b20d-4aadcd1c444a None None] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:12:16.019769 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fda3325-0249-4afc-b20d-4aadcd1c444a None None] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:12:16.024737 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2d8dcc-1389-4c39-aa8e-58e07f8b463b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:12:16.025924 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2d8dcc-1389-4c39-aa8e-58e07f8b463b admin admin] REQUEST_METHOD: `DELETE` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:12:16.026315 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2d8dcc-1389-4c39-aa8e-58e07f8b463b admin admin] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:12:16.026505 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2d8dcc-1389-4c39-aa8e-58e07f8b463b admin admin] PATH_INFO: `/v3/users/34120a5683ed4102bcd6be7de8e46be9` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:12:16.027681 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2d8dcc-1389-4c39-aa8e-58e07f8b463b admin admin] RBAC: Authorizing `identity:delete_user(user_id=34120a5683ed4102bcd6be7de8e46be9)` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:12:16.029663 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2d8dcc-1389-4c39-aa8e-58e07f8b463b admin admin] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:12:16.256484 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:12:16.258023 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-af2d8dcc-1389-4c39-aa8e-58e07f8b463b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34120a5683ed4102bcd6be7de8e46be9'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:12:16.265502 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-af2d8dcc-1389-4c39-aa8e-58e07f8b463b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34120a5683ed4102bcd6be7de8e46be9'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:12:16.266153 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-af2d8dcc-1389-4c39-aa8e-58e07f8b463b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34120a5683ed4102bcd6be7de8e46be9'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:12:16.266745 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-af2d8dcc-1389-4c39-aa8e-58e07f8b463b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34120a5683ed4102bcd6be7de8e46be9'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:12:16.353404 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.notifications [None req-af2d8dcc-1389-4c39-aa8e-58e07f8b463b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34120a5683ed4102bcd6be7de8e46be9'} {{(pid=98475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:12:16.372202 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1472/2942] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Oct 4 12:12:15 2022] DELETE /identity/v3/users/34120a5683ed4102bcd6be7de8e46be9 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:12:16.376800 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd65d51e-9373-4396-b771-6f6de0c24205 None None] REQUEST_METHOD: `POST` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:12:16.377331 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd65d51e-9373-4396-b771-6f6de0c24205 None None] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:12:16.377437 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd65d51e-9373-4396-b771-6f6de0c24205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:12:16.397776 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.auth.core [None req-dd65d51e-9373-4396-b771-6f6de0c24205 None None] MFA Rules not processed for user `6d735c10f69940bfb89355f7b5643d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=98474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:12:16.398970 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-dd65d51e-9373-4396-b771-6f6de0c24205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:12:16.457399 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1471/2943] 10.222.0.59 () {58 vars in 958 bytes} [Tue Oct 4 12:12:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:12:16.467373 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2d8dcc-1389-4c39-aa8e-58e07f8b463b admin admin] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:12:16.468800 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-af2d8dcc-1389-4c39-aa8e-58e07f8b463b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:12:16.527807 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2d8dcc-1389-4c39-aa8e-58e07f8b463b admin admin] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:12:16.531512 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bda169-249a-4cc6-b2ab-9dca55ae9516 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7289515c5c44914a19daa439de98cb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:12:16.532148 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bda169-249a-4cc6-b2ab-9dca55ae9516 service neutron] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:12:16.532421 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bda169-249a-4cc6-b2ab-9dca55ae9516 service neutron] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:12:16.532719 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bda169-249a-4cc6-b2ab-9dca55ae9516 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:12:16.541646 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bda169-249a-4cc6-b2ab-9dca55ae9516 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:12:16.543067 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bda169-249a-4cc6-b2ab-9dca55ae9516 service neutron] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:12:16.552206 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1473/2944] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:12:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:12:16.817941 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd65d51e-9373-4396-b771-6f6de0c24205 None None] Authenticating user token {{(pid=98474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:12:16.819498 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.fernet_utils [None req-dd65d51e-9373-4396-b771-6f6de0c24205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:12:16.832874 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd65d51e-9373-4396-b771-6f6de0c24205 None None] Validating token access rules against request {{(pid=98474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:12:16.837695 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2661f72e-5dde-4f8f-a812-ee2d5068d4d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d735c10f69940bfb89355f7b5643d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4d88030405047648869d4fa21dc117c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:12:16.838428 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2661f72e-5dde-4f8f-a812-ee2d5068d4d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:12:16.838708 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2661f72e-5dde-4f8f-a812-ee2d5068d4d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:12:16.838982 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2661f72e-5dde-4f8f-a812-ee2d5068d4d0 admin admin] PATH_INFO: `/v3/projects/42171d0e6d7c478bb45a1d49d4f20f94` {{(pid=98474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:12:16.840115 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2661f72e-5dde-4f8f-a812-ee2d5068d4d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42171d0e6d7c478bb45a1d49d4f20f94)` {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:12:16.842047 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2661f72e-5dde-4f8f-a812-ee2d5068d4d0 admin admin] RBAC: Authorization granted {{(pid=98474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:12:16.963280 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:12:16.979756 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-2661f72e-5dde-4f8f-a812-ee2d5068d4d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42171d0e6d7c478bb45a1d49d4f20f94', 'request_id': 'req-2661f72e-5dde-4f8f-a812-ee2d5068d4d0'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:12:16.986272 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-2661f72e-5dde-4f8f-a812-ee2d5068d4d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42171d0e6d7c478bb45a1d49d4f20f94', 'request_id': 'req-2661f72e-5dde-4f8f-a812-ee2d5068d4d0'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:12:17.107571 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-2661f72e-5dde-4f8f-a812-ee2d5068d4d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42171d0e6d7c478bb45a1d49d4f20f94', 'request_id': 'req-2661f72e-5dde-4f8f-a812-ee2d5068d4d0'} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:12:17.119689 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-2661f72e-5dde-4f8f-a812-ee2d5068d4d0 admin admin] The token cache is being invalidate because project 42171d0e6d7c478bb45a1d49d4f20f94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:12:17.120056 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-2661f72e-5dde-4f8f-a812-ee2d5068d4d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:12:17.120710 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG keystone.notifications [None req-2661f72e-5dde-4f8f-a812-ee2d5068d4d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:12:17.122196 dv-cinder-860212-2-smb devstack@keystone.service[98474]: [pid: 98474|app: 0|req: 1472/2945] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Oct 4 12:12:16 2022] DELETE /identity/v3/projects/42171d0e6d7c478bb45a1d49d4f20f94 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:12:26.548133 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=39,keystone:INSERT=1,keystone:DELETE=3 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:12:27.147319 dv-cinder-860212-2-smb devstack@keystone.service[98474]: DEBUG dbcounter [-] [98474] Writing DB stats keystone:DELETE=6,keystone:SELECT=14,keystone:INSERT=1 {{(pid=98474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:14:32.379081 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bda169-249a-4cc6-b2ab-9dca55ae9516 service neutron] Authenticating user token {{(pid=98475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:14:32.380477 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-23bda169-249a-4cc6-b2ab-9dca55ae9516 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:14:32.450776 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bda169-249a-4cc6-b2ab-9dca55ae9516 service neutron] Validating token access rules against request {{(pid=98475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:14:32.510116 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8be980-858e-423f-90e9-4e6277aa5046 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be119968b02440adbbbc85c553077b92', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39913dbe3e984f27a61493dd75381501', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:14:32.510732 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8be980-858e-423f-90e9-4e6277aa5046 service placement] REQUEST_METHOD: `GET` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:14:32.511014 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8be980-858e-423f-90e9-4e6277aa5046 service placement] SCRIPT_NAME: `/identity` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:14:32.511284 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8be980-858e-423f-90e9-4e6277aa5046 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:14:32.513058 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.fernet_utils [None req-4e8be980-858e-423f-90e9-4e6277aa5046 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:14:32.525133 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8be980-858e-423f-90e9-4e6277aa5046 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:14:32.526711 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8be980-858e-423f-90e9-4e6277aa5046 service placement] RBAC: Authorization granted {{(pid=98475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:14:32.537041 dv-cinder-860212-2-smb devstack@keystone.service[98475]: [pid: 98475|app: 0|req: 1474/2946] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Oct 4 12:14:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 12:14:42.532584 dv-cinder-860212-2-smb devstack@keystone.service[98475]: DEBUG dbcounter [-] [98475] Writing DB stats keystone:SELECT=58 {{(pid=98475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}